master

Gguofanfeng23Add triton fusion operator sort_chunks_by_idx and testcase

ddd61bdf创建于 2025年12月3日历史提交

文件	最后提交记录	最后更新时间
context_parallel	[Feature] Support full attention via Ring Attention under TND layout. Co-authored-by: zs-derrick1<1434012475@qq.com> # message auto-generated for no-merge-commit merge: !3021 merge master into master [Feature] Support full attention via Ring Attention under TND layout. Created-by: zs-derrick1 Commit-by: zs-derrick1 Merged-by: ascend-robot Description: [Feature] Support full attention via Ring Attention under TND layout. 添加新的AttentionWithCpTNDGeneral和TNDGeneralAttentionStrategy以支持TND layout在General 场景 下的Ring attention 验证结果： https://wiki.huawei.com/domains/149956/wiki/300791/WIKI202511048896138?title=_c3cd4b74 See merge request: Ascend/MindSpeed!3021	9 个月前
data_parallel	!2716 fix: async_log_allreduce Merge pull request !2716 from 邓佳/core_r0.12.1_fix_v3	1 年前
datasets	Add offline pad_data Co-authored-by: wuweiqiang24<wuweiqiang11@huawei.com> # message auto-generated for no-merge-commit merge: !2938 merge revise_preprocess_data into master Add offline pad_data Created-by: wuweiqiang24 Commit-by: wuweiqiang24 Merged-by: ascend-robot Description: 增加离线预处理pack数据集功能，可提前将数据padding到2\*CP倍，在线使用CP功能时可节约padding部分耗时 * 精度与非离线padding版本存在一定差异  * Llama2-7b，单机16k，GBS=8场景下，性能提升4.8%  See merge request: Ascend/MindSpeed!2938	10 个月前
distributed	quant fp8 optimizer	10 个月前
fusions	Add triton fusion operator sort_chunks_by_idx and testcase Signed-off-by: guofanfeng<guofanfeng1@huawei.com>	9 个月前
hccl_buffer	fix hccl for mla Co-authored-by: wuweiqiang24<wuweiqiang11@huawei.com> # message auto-generated for no-merge-commit merge: merge hccl_fix into master fix hccl for mla Created-by: wuweiqiang24 Commit-by: wuweiqiang24 Merged-by: ascend-robot Description: 1、remove the constraint of group_query_attention in hccl-group-buffer-adaptive for diverse CP conditions 2、add validation for op-cal-tflops See merge request: Ascend/MindSpeed!2855	1 年前
megatron_basic	!2800 fix inconsistent resume of weight_decay Merge pull request !2800 from wangyuansheng8/master	1 年前
memory	adapt recompute-norm feature in TE Co-authored-by: yulelanmei<huangyijie8@huawei.com> # message auto-generated for no-merge-commit merge: !3008 merge master into master adapt recompute-norm feature in TE Created-by: yulelanmei Commit-by: yulelanmei Merged-by: ascend-robot Description: 适配 transformer_engine 分支上的 norm 重计算特性 See merge request: Ascend/MindSpeed!3008	9 个月前
models	quant fp8 optimizer	10 个月前
multi_modal	disttrain intervl2 适配开箱 Co-authored-by: gcw_amOUPDs9<fuyuefeng@huawei.com> # message auto-generated for no-merge-commit merge: !2915 merge master into master disttrain intervl2 适配开箱 Created-by: gcw_amOUPDs9 Commit-by: gcw_amOUPDs9 Merged-by: ascend-robot Description: disttrain intervl2 适配开箱 disttrain intervl2 适配开箱 See merge request: Ascend/MindSpeed!2915	10 个月前
optimizer	debug	10 个月前
performance	!2635 安全：文件路径校验/权限 Merge pull request !2635 from glhyy/secmaster	1 年前
pipeline_parallel	【bug fix!!!!】fbov bugfix & info update Co-authored-by: EX_mitsu<yangjie409@h-partners.com> # message auto-generated for no-merge-commit merge: !2965 merge master into master 【bug fix!!!!】fbov bugfix & info update Created-by: EX_mitsuX Commit-by: EX_mitsu Merged-by: ascend-robot Description: 1.更新版本适配表。 2.修复dualpipeV下fbov多做一次detach导致断图的BUG。 3.在各自定义schedule特性中，修复CP loss BUG（见megatron-lm! 2756） See merge request: Ascend/MindSpeed!2965	10 个月前
tensor_parallel	quant fp8 optimizer	10 个月前
transformer	Add triton fusion operator sort_chunks_by_idx and testcase Signed-off-by: guofanfeng<guofanfeng1@huawei.com>	9 个月前
__init__.py	!359 change ascendspeed to mindspeed Merge pull request !359 from 邓佳/master	2 年前
fp8_utils.py	Support TransformerEngine Co-authored-by: MingzhenWang<wangmingzhen4@huawei.com> Co-authored-by: Muu<koimuu@163.com> Co-authored-by: x30061065<xuyuanhui3@h-partners.com> Co-authored-by: 耿瑞良<gengruiliang@huawei.com> # message auto-generated for no-merge-commit merge: !2947 merge lingqu_master into master Support TransformerEngine Created-by: mingzhenwang Commit-by: mingzhenwang;Muu;MingzhenWang;x30061065;耿瑞良 Merged-by: ascend-robot Description: 1. 支持TELinear层 2. 支持FP8计算，quantmatmul/gmm 3. 支持多种数据类型FP8/HiF8 4. 支持多种量化策略delayed/tensorwise/blockwise/mxfp8 5. TELinear层支持通算融合 See merge request: Ascend/MindSpeed!2947	10 个月前
mindspeed_parallel_group.py	!699 2d张量并行 Merge pull request !699 from liujianxing/2d_tensor_0824	1 年前
parallel_state.py	!2552 [fix bug] hccl_buff cannt be zero Merge pull request !2552 from 李宝奎/master_wtd	1 年前
simple_parallel_cfg.py	!699 2d张量并行 Merge pull request !699 from liujianxing/2d_tensor_0824	1 年前
singleton_meta.py	!699 2d张量并行 Merge pull request !699 from liujianxing/2d_tensor_0824	1 年前
tensor_parallel_y_union_cp.py	!699 2d张量并行 Merge pull request !699 from liujianxing/2d_tensor_0824	1 年前
training.py	!2223 bug fix:auto_settings 导致profile失效 Merge pull request !2223 from weijinqian_v1/master_dev	1 年前
weight_grad_store.py	!1216 安全排查修改 Merge pull request !1216 from huangzhenyu/master-icsl-no-ootb	1 年前