Skip to content

Commit

Permalink
Bump 3rdparty/NeMo from eb9848b to abd4bf7 (#597)
Browse files Browse the repository at this point in the history
Bumps [3rdparty/NeMo](https://github.com/NVIDIA/NeMo) from `eb9848b` to
`abd4bf7`.
<details>
<summary>Commits</summary>
<ul>
<li><a
href="https://github.com/NVIDIA/NeMo/commit/abd4bf7e6961856c04404452b50e7574dd7629e4"><code>abd4bf7</code></a>
Fix calculating num_available_samples (<a
href="https://redirect.github.com/NVIDIA/NeMo/issues/11830">#11830</a>)</li>
<li><a
href="https://github.com/NVIDIA/NeMo/commit/e0c97aab8525898b00b3f372aa1a18ba409a594a"><code>e0c97aa</code></a>
NeMo 2.0 vLLM export (<a
href="https://redirect.github.com/NVIDIA/NeMo/issues/11543">#11543</a>)</li>
<li><a
href="https://github.com/NVIDIA/NeMo/commit/7f3ac6b88289048643d445ec752a4d21547f2788"><code>7f3ac6b</code></a>
Bugfix for output_generation_logits in tensorrtllm (<a
href="https://redirect.github.com/NVIDIA/NeMo/issues/11820">#11820</a>)</li>
<li><a
href="https://github.com/NVIDIA/NeMo/commit/1ab22d183e20f1f57f17a9565edbc481e6020a00"><code>1ab22d1</code></a>
In-framework deployment NeMo 2.0 nemo_export.py test (<a
href="https://redirect.github.com/NVIDIA/NeMo/issues/11749">#11749</a>)</li>
<li><a
href="https://github.com/NVIDIA/NeMo/commit/490964a0124abc48ad4e88af0c6e81c2d17268c3"><code>490964a</code></a>
Add rope scaling configs for NeMo 1 (<a
href="https://redirect.github.com/NVIDIA/NeMo/issues/11807">#11807</a>)</li>
<li><a
href="https://github.com/NVIDIA/NeMo/commit/7a2e97a2efedd78ca1061a1b67bfa215e731cc35"><code>7a2e97a</code></a>
8x22b seq len (<a
href="https://redirect.github.com/NVIDIA/NeMo/issues/11788">#11788</a>)</li>
<li><a
href="https://github.com/NVIDIA/NeMo/commit/8a596bfb45f541e02e8b07d1406444fa082902fd"><code>8a596bf</code></a>
Autodetect number of devices for torchrun executor (<a
href="https://redirect.github.com/NVIDIA/NeMo/issues/11482">#11482</a>)</li>
<li><a
href="https://github.com/NVIDIA/NeMo/commit/482ac2f7611170cb6db0fde7b2271a8e60dbc0da"><code>482ac2f</code></a>
Add BERT Embedding Models E5 Recipe (<a
href="https://redirect.github.com/NVIDIA/NeMo/issues/11787">#11787</a>)</li>
<li><a
href="https://github.com/NVIDIA/NeMo/commit/9799051a8047e1fe8d1f5fca723afc932b0e257e"><code>9799051</code></a>
Lora ckpt in HF format for NeMo AutoModel (<a
href="https://redirect.github.com/NVIDIA/NeMo/issues/11712">#11712</a>)</li>
<li><a
href="https://github.com/NVIDIA/NeMo/commit/500c827243769222af492e443472bfbf23c38fbf"><code>500c827</code></a>
build: Fix build-arg (<a
href="https://redirect.github.com/NVIDIA/NeMo/issues/11815">#11815</a>)</li>
<li>Additional commits viewable in <a
href="https://github.com/NVIDIA/NeMo/compare/eb9848b7f21a8ce520c78676dc4e1d86919e8344...abd4bf7e6961856c04404452b50e7574dd7629e4">compare
view</a></li>
</ul>
</details>
<br />


Dependabot will resolve any conflicts with this PR as long as you don't
alter it yourself. You can also trigger a rebase manually by commenting
`@dependabot rebase`.

[//]: # (dependabot-automerge-start)
[//]: # (dependabot-automerge-end)

---

<details>
<summary>Dependabot commands and options</summary>
<br />

You can trigger Dependabot actions by commenting on this PR:
- `@dependabot rebase` will rebase this PR
- `@dependabot recreate` will recreate this PR, overwriting any edits
that have been made to it
- `@dependabot merge` will merge this PR after your CI passes on it
- `@dependabot squash and merge` will squash and merge this PR after
your CI passes on it
- `@dependabot cancel merge` will cancel a previously requested merge
and block automerging
- `@dependabot reopen` will reopen this PR if it is closed
- `@dependabot close` will close this PR and stop Dependabot recreating
it. You can achieve the same result by closing it manually
- `@dependabot show <dependency name> ignore conditions` will show all
of the ignore conditions of the specified dependency
- `@dependabot ignore this major version` will close this PR and stop
Dependabot creating any more for this major version (unless you reopen
the PR or upgrade to it yourself)
- `@dependabot ignore this minor version` will close this PR and stop
Dependabot creating any more for this minor version (unless you reopen
the PR or upgrade to it yourself)
- `@dependabot ignore this dependency` will close this PR and stop
Dependabot creating any more for this dependency (unless you reopen the
PR or upgrade to it yourself)


</details>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
  • Loading branch information
dependabot[bot] authored Jan 14, 2025
1 parent db237fc commit 4edeb0a
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion 3rdparty/NeMo
Submodule NeMo updated 85 files
+94 −9 .github/workflows/cicd-main.yml
+9 −2 Dockerfile.ci
+2 −1 docs/source/nlp/information_retrieval.rst
+12 −2 examples/llm/peft/hf.py
+42 −0 examples/llm/peft/hf_vllm.py
+1 −6 nemo/collections/common/parts/utils.py
+75 −0 nemo/collections/common/tokenizers/null_tokenizer.py
+1 −0 nemo/collections/diffusion/scripts/train.sh
+21 −32 nemo/collections/llm/gpt/data/fine_tuning.py
+20 −9 nemo/collections/llm/gpt/data/packed_sequence.py
+0 −3 nemo/collections/llm/gpt/model/gemma.py
+6 −1 nemo/collections/llm/gpt/model/hf_auto_model_for_causal_lm.py
+2 −2 nemo/collections/llm/gpt/model/mixtral.py
+2 −0 nemo/collections/llm/recipes/__init__.py
+138 −0 nemo/collections/llm/recipes/bert_embedding.py
+104 −0 nemo/collections/llm/recipes/e5_340m.py
+2 −0 nemo/collections/llm/recipes/gemma_2b.py
+4 −0 nemo/collections/llm/recipes/gemma_7b.py
+1 −1 nemo/collections/llm/recipes/mixtral_8x22b.py
+21 −2 nemo/collections/llm/recipes/run/executor.py
+9 −7 nemo/collections/nlp/data/language_modeling/megatron/gpt_sft_dataset.py
+8 −4 nemo/collections/nlp/data/language_modeling/megatron/megatron_batch_samplers.py
+1 −1 nemo/collections/nlp/models/language_modeling/megatron/gemma2/gemma2_modules.py
+0 −5 nemo/collections/nlp/models/language_modeling/megatron_base_model.py
+8 −1 nemo/collections/nlp/models/language_modeling/megatron_gpt_model.py
+0 −3 nemo/collections/nlp/models/language_modeling/megatron_retro_model.py
+2 −0 nemo/collections/nlp/modules/common/megatron/megatron_init.py
+1 −1 nemo/collections/nlp/modules/common/text_generation_strategy.py
+6 −0 nemo/collections/nlp/modules/common/tokenizer_utils.py
+2 −2 nemo/collections/vlm/mllama/model/language.py
+71 −20 nemo/deploy/nlp/megatronllm_deployable.py
+3 −3 nemo/deploy/nlp/query_llm.py
+7 −0 nemo/export/__init__.py
+18 −5 nemo/export/sentencepiece_tokenizer.py
+1 −1 nemo/export/tensorrt_llm.py
+7 −1 nemo/export/trt_llm/nemo_ckpt_loader/nemo_file.py
+4 −0 nemo/export/utils/__init__.py
+28 −0 nemo/export/utils/utils.py
+38 −1 nemo/export/vllm/engine.py
+57 −28 nemo/export/vllm/model_config.py
+17 −7 nemo/export/vllm/model_converters.py
+32 −9 nemo/export/vllm/model_loader.py
+20 −4 nemo/export/vllm_hf_exporter.py
+2 −1 nemo/lightning/__init__.py
+2 −0 nemo/lightning/data.py
+97 −0 nemo/lightning/io/pl.py
+2 −0 nemo/lightning/megatron_init.py
+49 −17 nemo/lightning/pytorch/callbacks/peft.py
+1 −1 nemo/lightning/pytorch/callbacks/progress_printer.py
+2 −1 nemo/lightning/pytorch/strategies/__init__.py
+276 −0 nemo/lightning/pytorch/strategies/fsdp2_strategy.py
+1 −1 nemo/lightning/pytorch/strategies/megatron_strategy.py
+53 −2 nemo/lightning/pytorch/strategies/utils.py
+2 −0 nemo/lightning/run/plugins.py
+6 −0 requirements/requirements_deploy.txt
+2 −0 requirements/requirements_infer.txt
+1 −0 requirements/requirements_tts.txt
+1 −0 requirements/requirements_vllm.txt
+1 −2 scripts/checkpoint_converters/convert_bert_hf_to_nemo.py
+2 −0 scripts/checkpoint_converters/convert_mixtral_hf_to_nemo.py
+10 −2 scripts/checkpoint_converters/convert_qwen2_hf_to_nemo.py
+2 −1 setup.py
+0 −2 tests/collections/llm/bitexact/mixtral/pretrain_mini_mixtral.py
+2 −2 tests/collections/llm/bitexact/mixtral/run.sh
+2 −2 tests/collections/llm/gpt/model/test_mixtral.py
+0 −5 tests/collections/llm/gpt/model/test_model_import.py
+0 −1 tests/collections/llm/hf/peft_hf.py
+1 −0 tests/collections/llm/hf/peft_nemorun.py
+136 −0 tests/collections/llm/hf/sft_fsdp2.py
+1 −0 tests/collections/llm/hf/sft_nemorun.py
+75 −0 tests/collections/llm/hf/sft_nemorun_fsdp2.py
+25 −0 tests/collections/llm/hf/utils.py
+0 −2 tests/collections/llm/megatron_mixtral_pretraining.py
+10 −2 tests/collections/llm/recipes/test_mixtral_8x22b.py
+0 −0 tests/collections/vlm/hf/peft_hf.py
+0 −14 tests/conftest.py
+2 −2 tests/core/test_exp_manager.py
+46 −13 tests/export/nemo_export.py
+56 −0 tests/lightning/pytorch/strategies/test_fsdp2_strategy.py
+5 −5 tests/lightning/test_nemo_resume_from_ckpt.py
+3 −3 tests/setup/data/create_sample_jsonl.py
+66 −0 tests/setup/data/create_sample_lambada.py
+2 −0 tutorials/llm/llama-3/nemo2-sft-peft/nemo2-peft.ipynb
+2 −0 tutorials/llm/llama-3/nemo2-sft-peft/nemo2-sft.ipynb
+7 −2 tutorials/llm/mamba/mamba.rst

0 comments on commit 4edeb0a

Please sign in to comment.