e2e-tests

feat(moe): add gshard token rearrange optim #1127

Sign in to view logs

Run time

Learn about OS pricing on GitHub Actions

Job	Run time
training_16GPU_4DP2TP2PP_FSP (910B)	4m 12s
training_16GPU_4DP2TP2PP_MSP (910B)	3m 25s
training_16GPU_4DP2TP2PP_MTP (910B)	7m 59s
training_4GPU	2m 0s
training_8GPU_4DP2PP (910B)	7m 38s
training_8GPU_4DP2PP_ZB	1m 45s
training_8GPU_4DP2TP (910B)	3m 6s
training_8GPU_4DP2TPSP (910B)	3m 7s
training_8GPU_ISP	1m 35s
training_8GPU_ISP_CKPT	3m 15s
training_internlm2 (910B)	2m 44s
training_llama2 (910B)	3m 32s
	44m 18s