Skip to content

feat(parallel_context.py): add gqa process group to allreduce dkv (#54) #28

feat(parallel_context.py): add gqa process group to allreduce dkv (#54)

feat(parallel_context.py): add gqa process group to allreduce dkv (#54) #28

Re-run triggered February 26, 2024 02:36
Status Success
Total duration 27m 8s
Artifacts

pr_merged.yaml

on: push
acc_tests
2m 9s
acc_tests
check_loss_when_swapping_micro_num_and_micro_bsz
26m 22s
check_loss_when_swapping_micro_num_and_micro_bsz
notify_to_feishu
0s
notify_to_feishu
Fit to window
Zoom out
Zoom in

Annotations

2 warnings
acc_tests
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
check_loss_when_swapping_micro_num_and_micro_bsz
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.