master

ascend-robot[pytorch][feature] kvallgather supports TND

045b6da8创建于 3月5日历史提交

文件	最后提交记录	最后更新时间
__init__.py	!3114 [pytorch][refactor] refactor context parallel Merge pull request !3114 from yanzhixiao/refactor-cp-0807	9 个月前
context_parallel_feature.py	[pytorch][feature] kvallgather supports TND Co-authored-by: Jia_Austin<dengjia6@huawei.com> # message auto-generated for no-merge-commit merge: !4277 merge fix_te_tnd into master [pytorch][feature] kvallgather supports TND Created-by: Jia_Austin Commit-by: Jia_Austin Merged-by: ascend-robot Description: ## What this PR does / why we need it? feat: TE tnd ## Does this PR introduce any user-facing change? NA ## How was this patch tested? Turn on and off TE CP TND See merge request: Ascend/MindSpeed-LLM!4277	2 个月前
mamba_context_parallel.py	!3114 [pytorch][refactor] refactor context parallel Merge pull request !3114 from yanzhixiao/refactor-cp-0807	9 个月前
ulysses_context_parallel.py	!3114 [pytorch][refactor] refactor context parallel Merge pull request !3114 from yanzhixiao/refactor-cp-0807	9 个月前