master

Ii-robot!2748 fix ddp overlap-param-gather issue when param order and forward mismatch

eb1ea20f创建于 2025年8月18日历史提交

文件	最后提交记录	最后更新时间
pretrain_llama2_70B_128k_tp2_cp4_hybrid.sh	!2748 fix ddp overlap-param-gather issue when param order and forward mismatch Merge pull request !2748 from 郭鹏/master	9 个月前
pretrain_llama2_70B_128k_tp2_cp4_megatron.sh	!2748 fix ddp overlap-param-gather issue when param order and forward mismatch Merge pull request !2748 from 郭鹏/master	9 个月前
pretrain_llama2_70B_32k_tp2_pp2_vpp1_cp2_ulysses_resume.sh	!2748 fix ddp overlap-param-gather issue when param order and forward mismatch Merge pull request !2748 from 郭鹏/master	9 个月前
pretrain_llama2_70B_4k_tp2_pp2_vpp1_dp2.sh	!2748 fix ddp overlap-param-gather issue when param order and forward mismatch Merge pull request !2748 from 郭鹏/master	9 个月前
pretrain_llama2_70B_8k_tp8_x4_y2_2d.sh	!2748 fix ddp overlap-param-gather issue when param order and forward mismatch Merge pull request !2748 from 郭鹏/master	9 个月前
pretrain_llama_pp2_dp4.sh	!2748 fix ddp overlap-param-gather issue when param order and forward mismatch Merge pull request !2748 from 郭鹏/master	9 个月前