Skip to content
CICD NeMo

Fix for crash with LoRA + tp_overlap_comm=false + sequence_parallel=true #5563

Sign in to view logs

Fix for crash with LoRA + tp_overlap_comm=false + sequence_parallel=true

Fix for crash with LoRA + tp_overlap_comm=false + sequence_parallel=true #5563

L2_Megatron_GPT_Pretraining_and_Resume_Training_PP2  /  main

L2_Megatron_GPT_Pretraining_and_Resume_Training_PP2 / main
succeeded Oct 17, 2024 in 3m 50s