Skip to content

Commit

Permalink
Update Apex build command
Browse files Browse the repository at this point in the history
Due to pip having deprecated `--global-option` and `--build-option`,
this will be highly relevant in the future (removal is planned for 23.3,
see pypa/pip#11859).
  • Loading branch information
janEbert committed Jul 5, 2023
1 parent e0f5e03 commit 3cf93f7
Showing 1 changed file with 5 additions and 2 deletions.
7 changes: 5 additions & 2 deletions docs/source/usage_guides/megatron_lm.md
Original file line number Diff line number Diff line change
Expand Up @@ -100,7 +100,10 @@ conda install pytorch torchvision torchaudio cudatoolkit=11.3 -c pytorch
```
git clone https://github.com/NVIDIA/apex
cd apex
pip install -v --disable-pip-version-check --no-cache-dir --global-option="--cpp_ext" --global-option="--cuda_ext" ./
# if pip >= 23.1 (ref: https://pip.pypa.io/en/stable/news/#v23-1) which supports multiple `--config-settings` with the same key...
pip install -v --disable-pip-version-check --no-cache-dir --no-build-isolation --config-settings "--build-option=--cpp_ext" --config-settings "--build-option=--cuda_ext" ./
# otherwise
pip install -v --disable-pip-version-check --no-cache-dir --no-build-isolation --global-option="--cpp_ext" --global-option="--cuda_ext" ./
cd ..
```

Expand Down Expand Up @@ -580,4 +583,4 @@ b. Megatron-LM [GPTModel](https://github.com/NVIDIA/Megatron-LM/blob/main/megatr
c. Megatron-LM [T5Model](https://github.com/NVIDIA/Megatron-LM/blob/main/megatron/model/t5_model.py) :
🤗 transformers models with `t5` in config's model type, e.g.,
[T5](https://huggingface.co/docs/transformers/model_doc/t5) and
[MT5](https://huggingface.co/docs/transformers/model_doc/mt5)
[MT5](https://huggingface.co/docs/transformers/model_doc/mt5)

0 comments on commit 3cf93f7

Please sign in to comment.