From 9dc21bf4df23720398561b5ff307653e5197e0e8 Mon Sep 17 00:00:00 2001 From: Frederik Gossen Date: Mon, 11 Dec 2023 17:08:05 -0500 Subject: [PATCH] Make readme future-proof by not using openxla_eval as an example --- benchmarks/README.md | 23 +++++++++++------------ 1 file changed, 11 insertions(+), 12 deletions(-) diff --git a/benchmarks/README.md b/benchmarks/README.md index 21432f06522d..9e3b76b24189 100644 --- a/benchmarks/README.md +++ b/benchmarks/README.md @@ -50,25 +50,24 @@ The results will be stored in a json file in `experiment_results`. ``` cd pytorch -python xla/benchmarks/experiment_runner.py \ - --dynamo=openxla_eval --dynamo=openxla --dynamo=inductor \ - --xla=PJRT --xla=None \ - --test=eval --test=train \ - --suite-name=torchbench \ - --accelerator=cuda \ - --output-dirname=experiment_results \ - --repeat=5 \ - --print-subprocess \ - --no-resume \ +python xla/benchmarks/experiment_runner.py \ + --dynamo=openxla --dynamo=inductor \ + --xla=PJRT --xla=None \ + --test=eval --test=train \ + --suite-name=torchbench \ + --accelerator=cuda \ + --output-dirname=experiment_results \ + --repeat=5 \ + --print-subprocess \ + --no-resume \ --filter="^alexnet$" ``` You can change the flags to add the configurations you are interested in. The `experiment_runner.py` will expand the options to all supported configurations. For example, in the case above, it will consider all the possible combinations -among the flags `--dynamo`, `--xla`, and `--test`, 5 of which are supported: +among the flags `--dynamo`, `--xla`, and `--test`, 4 of which are supported: - - `dynamo=openxla_eval`, `xla=PJRT`, `test=eval` - `dynamo=openxla`, `xla=PJRT`, `test=eval` - `dynamo=openxla`, `xla=PJRT`, `test=train` - `dynamo=inductor`, `xla=None`, `test=eval`