0
代码
代码
Issues
Pull Requests
讨论
Wiki
分析
0
ascend-robotascend-robotfeat: add custom pp layout
94e8ac1c创建于 9 小时前历史提交
文件最后提交记录最后更新时间
megatron_moe
docs: modify the structure of documents Co-authored-by: Keilo_W<wangkaiyu11@h-partners.com> # message auto-generated for no-merge-commit merge: !3287 merge docs into master docs: modify the structure of documents Created-by: Keilo_W Commit-by: Keilo_W Merged-by: ascend-robot Description: 1、Modify the structure of documents 2、Pass the ci of Doc Tools See merge request: Ascend/MindSpeed!32872 个月前
mxfp8
feat: release bf16 weights after mxfp8 quantization to optimize memory Co-authored-by: h00638954<huangzhiyuan8@huawei.com> # message auto-generated for no-merge-commit merge: !3369 merge mega_release_bf16 into master feat: release bf16 weights after mxfp8 quantization to optimize memory Created-by: sinat_20276189 Commit-by: sinat_20276189;h00638954 Merged-by: ascend-robot Description: ## What this PR does / why we need it? **背景：** 在 FP8/MXFP8 混合精度训练中，大模型（尤其是 MoE 架构）的 Linear 层完成权重量化并生成 FP8 Reuse Cache（复用缓存）后，原有的 BF16 高精度权重物理内存依然驻留在显存中直到反向传播更新。这种冗余极大地限制了单卡能容纳的模型层数。本 PR 旨在通过在量化后安全释放 BF16 权重，榨干显存红利，从而支持更深层的大模型全量megatron 训练。 ## Does this PR introduce *any* user-facing change? **无破坏性改变，对用户透明。** * **新特性使能方式介绍：** 本特性作为底层的极致显存优化，在配置了 MXFP8 量化且命中缓存复用逻辑时自动生效，无新增外露 API。 ## How was this patch tested? **正确性与有效性验证：** **显存收益验证：** 在多卡megatron 训练配置下，通过 NPU Profiling 对比优化前后的 Memory Allocated 峰值，确认静态显存占用显著下降。详见md文档描述 See merge request: Ascend/MindSpeed!33691 个月前
Automatic_Parallelism.md
docs: modify the structure of documents Co-authored-by: Keilo_W<wangkaiyu11@h-partners.com> # message auto-generated for no-merge-commit merge: !3287 merge docs into master docs: modify the structure of documents Created-by: Keilo_W Commit-by: Keilo_W Merged-by: ascend-robot Description: 1、Modify the structure of documents 2、Pass the ci of Doc Tools See merge request: Ascend/MindSpeed!32872 个月前
LayerZeRO.md
docs: modify the structure of documents Co-authored-by: Keilo_W<wangkaiyu11@h-partners.com> # message auto-generated for no-merge-commit merge: !3287 merge docs into master docs: modify the structure of documents Created-by: Keilo_W Commit-by: Keilo_W Merged-by: ascend-robot Description: 1、Modify the structure of documents 2、Pass the ci of Doc Tools See merge request: Ascend/MindSpeed!32872 个月前
activation-function-recompute.md
docs: modify the structure of documents Co-authored-by: Keilo_W<wangkaiyu11@h-partners.com> # message auto-generated for no-merge-commit merge: !3287 merge docs into master docs: modify the structure of documents Created-by: Keilo_W Commit-by: Keilo_W Merged-by: ascend-robot Description: 1、Modify the structure of documents 2、Pass the ci of Doc Tools See merge request: Ascend/MindSpeed!32872 个月前
aiqos.md
feat(ut/qos/torch): 补充ut，修复代码遗漏BUG Co-authored-by: Klayyy<wanglei886@h-partners.com> # message auto-generated for no-merge-commit merge: !3309 merge master into master feat(ut/qos/torch): 补充ut，修复代码遗漏BUG Created-by: Klayyy Commit-by: Klayyy Merged-by: ascend-robot Description: 1.补充AI QOS特性feature UT 2.ut补充过程中，自检代码，修复BUG 2.1 torch_npu._C._distributed_c10d.ProcessGroupHCCL.Options()调用名称修改 2.2 qos_feature.py 中 raiseValueError 提示词完善 2.3 qos.py中对于最小冲突度组合中优先级的赋值部分，去掉重复代码，去掉无用库导入，_PARALLEL_TYPES中有逗号未添加 2.4 qos.py中 应是sdma qos 部分的处理，误使用roce 3.补充H2D QOS 对于 PCIE异步通道的使用，对于DCMI接口新建set_h2d_qos接口，提供给python调用 4.修改aiQos Readme中关于DCMI接口的调用，补充DCMI接口SO编译方法 See merge request: Ascend/MindSpeed!33092 个月前
alibi.md
docs: modify the structure of documents Co-authored-by: Keilo_W<wangkaiyu11@h-partners.com> # message auto-generated for no-merge-commit merge: !3287 merge docs into master docs: modify the structure of documents Created-by: Keilo_W Commit-by: Keilo_W Merged-by: ascend-robot Description: 1、Modify the structure of documents 2、Pass the ci of Doc Tools See merge request: Ascend/MindSpeed!32872 个月前
async-ddp-param-gather.md
docs: modify the structure of documents Co-authored-by: Keilo_W<wangkaiyu11@h-partners.com> # message auto-generated for no-merge-commit merge: !3287 merge docs into master docs: modify the structure of documents Created-by: Keilo_W Commit-by: Keilo_W Merged-by: ascend-robot Description: 1、Modify the structure of documents 2、Pass the ci of Doc Tools See merge request: Ascend/MindSpeed!32872 个月前
async-ddp.md
docs: modify the structure of documents Co-authored-by: Keilo_W<wangkaiyu11@h-partners.com> # message auto-generated for no-merge-commit merge: !3287 merge docs into master docs: modify the structure of documents Created-by: Keilo_W Commit-by: Keilo_W Merged-by: ascend-robot Description: 1、Modify the structure of documents 2、Pass the ci of Doc Tools See merge request: Ascend/MindSpeed!32872 个月前
async-log-allreduce.md
docs: modify the structure of documents Co-authored-by: Keilo_W<wangkaiyu11@h-partners.com> # message auto-generated for no-merge-commit merge: !3287 merge docs into master docs: modify the structure of documents Created-by: Keilo_W Commit-by: Keilo_W Merged-by: ascend-robot Description: 1、Modify the structure of documents 2、Pass the ci of Doc Tools See merge request: Ascend/MindSpeed!32872 个月前
auto_settings.md
docs: modify the structure of documents Co-authored-by: Keilo_W<wangkaiyu11@h-partners.com> # message auto-generated for no-merge-commit merge: !3287 merge docs into master docs: modify the structure of documents Created-by: Keilo_W Commit-by: Keilo_W Merged-by: ascend-robot Description: 1、Modify the structure of documents 2、Pass the ci of Doc Tools See merge request: Ascend/MindSpeed!32872 个月前
automated-pipeline.md
docs: modify the structure of documents Co-authored-by: Keilo_W<wangkaiyu11@h-partners.com> # message auto-generated for no-merge-commit merge: !3287 merge docs into master docs: modify the structure of documents Created-by: Keilo_W Commit-by: Keilo_W Merged-by: ascend-robot Description: 1、Modify the structure of documents 2、Pass the ci of Doc Tools See merge request: Ascend/MindSpeed!32872 个月前
balanced_moe.md
docs:add bm parameter usage restriction Co-authored-by: lizhi<lizhi166@huawei.com> # message auto-generated for no-merge-commit merge: !3395 merge add-bm-docs-limit into master docs:add bm parameter usage restriction Created-by: Liz_ Commit-by: lizhi Merged-by: gp513 Description: What this PR does / why we need it? Please describe the background and detailed changes of the PR. If it is a bugfix, please attach the related issue. Does this PR introduce any user-facing change? Please describe whether the PR will result in any user-facing usage changes. If there is related documentation, please specify its path. How was this patch tested? Please explain how to verify the correctness and effectiveness of this feature, as well as its usage constraints and limitations. See merge request: Ascend/MindSpeed!33951 个月前
communication-over-computation.md
docs: modify the structure of documents Co-authored-by: Keilo_W<wangkaiyu11@h-partners.com> # message auto-generated for no-merge-commit merge: !3287 merge docs into master docs: modify the structure of documents Created-by: Keilo_W Commit-by: Keilo_W Merged-by: ascend-robot Description: 1、Modify the structure of documents 2、Pass the ci of Doc Tools See merge request: Ascend/MindSpeed!32872 个月前
compress-tensor.md
docs: modify the structure of documents Co-authored-by: Keilo_W<wangkaiyu11@h-partners.com> # message auto-generated for no-merge-commit merge: !3287 merge docs into master docs: modify the structure of documents Created-by: Keilo_W Commit-by: Keilo_W Merged-by: ascend-robot Description: 1、Modify the structure of documents 2、Pass the ci of Doc Tools See merge request: Ascend/MindSpeed!32872 个月前
context_parallelism_kv_cache.md
[docs] update docs Co-authored-by: Keilo_W<wangkaiyu11@h-partners.com> # message auto-generated for no-merge-commit merge: !3397 merge master into master [docs] update docs Created-by: Keilo_W Commit-by: Keilo_W Merged-by: gp513 Description: What this PR does / why we need it? Please describe the background and detailed changes of the PR. If it is a bugfix, please attach the related issue. Does this PR introduce any user-facing change? Please describe whether the PR will result in any user-facing usage changes. If there is related documentation, please specify its path. How was this patch tested? Please explain how to verify the correctness and effectiveness of this feature, as well as its usage constraints and limitations. See merge request: Ascend/MindSpeed!33971 个月前
conv3d_sequence_paralle.md
docs: modify the structure of documents Co-authored-by: Keilo_W<wangkaiyu11@h-partners.com> # message auto-generated for no-merge-commit merge: !3287 merge docs into master docs: modify the structure of documents Created-by: Keilo_W Commit-by: Keilo_W Merged-by: ascend-robot Description: 1、Modify the structure of documents 2、Pass the ci of Doc Tools See merge request: Ascend/MindSpeed!32872 个月前
custom_fsdp.md
docs: modify the structure of documents Co-authored-by: Keilo_W<wangkaiyu11@h-partners.com> # message auto-generated for no-merge-commit merge: !3287 merge docs into master docs: modify the structure of documents Created-by: Keilo_W Commit-by: Keilo_W Merged-by: ascend-robot Description: 1、Modify the structure of documents 2、Pass the ci of Doc Tools See merge request: Ascend/MindSpeed!32872 个月前
data-parallel.md
docs: modify the structure of documents Co-authored-by: Keilo_W<wangkaiyu11@h-partners.com> # message auto-generated for no-merge-commit merge: !3287 merge docs into master docs: modify the structure of documents Created-by: Keilo_W Commit-by: Keilo_W Merged-by: ascend-robot Description: 1、Modify the structure of documents 2、Pass the ci of Doc Tools See merge request: Ascend/MindSpeed!32872 个月前
dist_ckpt.md
docs: modify the structure of documents Co-authored-by: Keilo_W<wangkaiyu11@h-partners.com> # message auto-generated for no-merge-commit merge: !3287 merge docs into master docs: modify the structure of documents Created-by: Keilo_W Commit-by: Keilo_W Merged-by: ascend-robot Description: 1、Modify the structure of documents 2、Pass the ci of Doc Tools See merge request: Ascend/MindSpeed!32872 个月前
distributed-optimizer.md
docs: modify the structure of documents Co-authored-by: Keilo_W<wangkaiyu11@h-partners.com> # message auto-generated for no-merge-commit merge: !3287 merge docs into master docs: modify the structure of documents Created-by: Keilo_W Commit-by: Keilo_W Merged-by: ascend-robot Description: 1、Modify the structure of documents 2、Pass the ci of Doc Tools See merge request: Ascend/MindSpeed!32872 个月前
double-ring.md
docs: modify the structure of documents Co-authored-by: Keilo_W<wangkaiyu11@h-partners.com> # message auto-generated for no-merge-commit merge: !3287 merge docs into master docs: modify the structure of documents Created-by: Keilo_W Commit-by: Keilo_W Merged-by: ascend-robot Description: 1、Modify the structure of documents 2、Pass the ci of Doc Tools See merge request: Ascend/MindSpeed!32872 个月前
dualpipev.md
docs: modify the structure of documents Co-authored-by: Keilo_W<wangkaiyu11@h-partners.com> # message auto-generated for no-merge-commit merge: !3287 merge docs into master docs: modify the structure of documents Created-by: Keilo_W Commit-by: Keilo_W Merged-by: ascend-robot Description: 1、Modify the structure of documents 2、Pass the ci of Doc Tools See merge request: Ascend/MindSpeed!32872 个月前
eod-reset.md
docs: modify the structure of documents Co-authored-by: Keilo_W<wangkaiyu11@h-partners.com> # message auto-generated for no-merge-commit merge: !3287 merge docs into master docs: modify the structure of documents Created-by: Keilo_W Commit-by: Keilo_W Merged-by: ascend-robot Description: 1、Modify the structure of documents 2、Pass the ci of Doc Tools See merge request: Ascend/MindSpeed!32872 个月前
feature_list.md
docs:modify document Co-authored-by: z60112595<zhaotao68@h-partners.com> # message auto-generated for no-merge-commit merge: !3490 merge master into master docs:modify document Created-by: kali00 Commit-by: z60112595 Merged-by: ascend-robot Description: What this PR does / why we need it? https://gitcode.com/Ascend/MindSpeed/issues/163 1、将26.0.0_core_r0.12.1的docs下的资料修改内容合入到master中 2、给“说明”标签增加换行 3、将特性列表和自定义算子列表中的超链接修改成相对链接 Does this PR introduce any user-facing change? Please describe whether the PR will result in any user-facing usage changes. If there is related documentation, please specify its path. How was this patch tested? Please explain how to verify the correctness and effectiveness of this feature, as well as its usage constraints and limitations. See merge request: Ascend/MindSpeed!34907 天前
flash-attention.md
docs: modify the structure of documents Co-authored-by: Keilo_W<wangkaiyu11@h-partners.com> # message auto-generated for no-merge-commit merge: !3287 merge docs into master docs: modify the structure of documents Created-by: Keilo_W Commit-by: Keilo_W Merged-by: ascend-robot Description: 1、Modify the structure of documents 2、Pass the ci of Doc Tools See merge request: Ascend/MindSpeed!32872 个月前
fsdp2.md
docs: modify the structure of documents Co-authored-by: Keilo_W<wangkaiyu11@h-partners.com> # message auto-generated for no-merge-commit merge: !3287 merge docs into master docs: modify the structure of documents Created-by: Keilo_W Commit-by: Keilo_W Merged-by: ascend-robot Description: 1、Modify the structure of documents 2、Pass the ci of Doc Tools See merge request: Ascend/MindSpeed!32872 个月前
fused_ema_adamw_optimizer.md
docs: modify the structure of documents Co-authored-by: Keilo_W<wangkaiyu11@h-partners.com> # message auto-generated for no-merge-commit merge: !3287 merge docs into master docs: modify the structure of documents Created-by: Keilo_W Commit-by: Keilo_W Merged-by: ascend-robot Description: 1、Modify the structure of documents 2、Pass the ci of Doc Tools See merge request: Ascend/MindSpeed!32872 个月前
fusion-attn-v2.md
docs: modify the structure of documents Co-authored-by: Keilo_W<wangkaiyu11@h-partners.com> # message auto-generated for no-merge-commit merge: !3287 merge docs into master docs: modify the structure of documents Created-by: Keilo_W Commit-by: Keilo_W Merged-by: ascend-robot Description: 1、Modify the structure of documents 2、Pass the ci of Doc Tools See merge request: Ascend/MindSpeed!32872 个月前
generate-mask.md
docs: modify the structure of documents Co-authored-by: Keilo_W<wangkaiyu11@h-partners.com> # message auto-generated for no-merge-commit merge: !3287 merge docs into master docs: modify the structure of documents Created-by: Keilo_W Commit-by: Keilo_W Merged-by: ascend-robot Description: 1、Modify the structure of documents 2、Pass the ci of Doc Tools See merge request: Ascend/MindSpeed!32872 个月前
hccl-group-buffer-set.md
docs: modify the structure of documents Co-authored-by: Keilo_W<wangkaiyu11@h-partners.com> # message auto-generated for no-merge-commit merge: !3287 merge docs into master docs: modify the structure of documents Created-by: Keilo_W Commit-by: Keilo_W Merged-by: ascend-robot Description: 1、Modify the structure of documents 2、Pass the ci of Doc Tools See merge request: Ascend/MindSpeed!32872 个月前
hccl-replace-gloo.md
docs: modify the structure of documents Co-authored-by: Keilo_W<wangkaiyu11@h-partners.com> # message auto-generated for no-merge-commit merge: !3287 merge docs into master docs: modify the structure of documents Created-by: Keilo_W Commit-by: Keilo_W Merged-by: ascend-robot Description: 1、Modify the structure of documents 2、Pass the ci of Doc Tools See merge request: Ascend/MindSpeed!32872 个月前
hybrid-context-parallel.md
docs: modify the structure of documents Co-authored-by: Keilo_W<wangkaiyu11@h-partners.com> # message auto-generated for no-merge-commit merge: !3287 merge docs into master docs: modify the structure of documents Created-by: Keilo_W Commit-by: Keilo_W Merged-by: ascend-robot Description: 1、Modify the structure of documents 2、Pass the ci of Doc Tools See merge request: Ascend/MindSpeed!32872 个月前
kvallgather-context-parallel.md
docs: modify the structure of documents Co-authored-by: Keilo_W<wangkaiyu11@h-partners.com> # message auto-generated for no-merge-commit merge: !3287 merge docs into master docs: modify the structure of documents Created-by: Keilo_W Commit-by: Keilo_W Merged-by: ascend-robot Description: 1、Modify the structure of documents 2、Pass the ci of Doc Tools See merge request: Ascend/MindSpeed!32872 个月前
low-precision-optimizer.md
fix: add low precision opt verification Co-authored-by: yulelanmei<huangyijie8@huawei.com> # message auto-generated for no-merge-commit merge: !3494 merge master into master fix: add low precision opt verification Created-by: yulelanmei Commit-by: yulelanmei Merged-by: ascend-robot Description: What this PR does / why we need it? The low precision optimizer features: --quant-states & --quant-grads are incompatible with --swap-optimizer, but no verification right now. Does this PR introduce any user-facing change? When user uses both parameters, a verification message is displayed. How was this patch tested? Turn on both parameters in a train script in addition. See merge request: Ascend/MindSpeed!34948 天前
mc2.md
docs: modify the structure of documents Co-authored-by: Keilo_W<wangkaiyu11@h-partners.com> # message auto-generated for no-merge-commit merge: !3287 merge docs into master docs: modify the structure of documents Created-by: Keilo_W Commit-by: Keilo_W Merged-by: ascend-robot Description: 1、Modify the structure of documents 2、Pass the ci of Doc Tools See merge request: Ascend/MindSpeed!32872 个月前
moe-token-permute-and-unpermute.md
docs: modify the structure of documents Co-authored-by: Keilo_W<wangkaiyu11@h-partners.com> # message auto-generated for no-merge-commit merge: !3287 merge docs into master docs: modify the structure of documents Created-by: Keilo_W Commit-by: Keilo_W Merged-by: ascend-robot Description: 1、Modify the structure of documents 2、Pass the ci of Doc Tools See merge request: Ascend/MindSpeed!32872 个月前
moe_expert_load_balance_placeemnt.md
[docs] update docs Co-authored-by: Keilo_W<wangkaiyu11@h-partners.com> # message auto-generated for no-merge-commit merge: !3397 merge master into master [docs] update docs Created-by: Keilo_W Commit-by: Keilo_W Merged-by: gp513 Description: What this PR does / why we need it? Please describe the background and detailed changes of the PR. If it is a bugfix, please attach the related issue. Does this PR introduce any user-facing change? Please describe whether the PR will result in any user-facing usage changes. If there is related documentation, please specify its path. How was this patch tested? Please explain how to verify the correctness and effectiveness of this feature, as well as its usage constraints and limitations. See merge request: Ascend/MindSpeed!33971 个月前
multi-head-latent-attention.md
[docs] update version numbers and related hyperlinks in documentation, and move png figures into 'figures' directory Co-authored-by: fanlu5<fanlu5@huawei.com> # message auto-generated for no-merge-commit merge: !3472 merge master into master [docs] update version numbers and related hyperlinks in documentation, and move png figures into 'figures' directory Created-by: fanlu5 Commit-by: fanlu5 Merged-by: ascend-robot Description: What this PR does / why we need it? update version numbers and related hyperlinks in documentation, and move png figures into 'figures' directory - Update README.md and installation guide with latest changes - Update ops documentation and release notes - move png figures into 'figures' directory Does this PR introduce any user-facing change? NA How was this patch tested? NA See merge request: Ascend/MindSpeed!347219 天前
multi_parameter_pipeline.md
docs: modify the structure of documents Co-authored-by: Keilo_W<wangkaiyu11@h-partners.com> # message auto-generated for no-merge-commit merge: !3287 merge docs into master docs: modify the structure of documents Created-by: Keilo_W Commit-by: Keilo_W Merged-by: ascend-robot Description: 1、Modify the structure of documents 2、Pass the ci of Doc Tools See merge request: Ascend/MindSpeed!32872 个月前
multi_parameter_pipeline_and_variable_seq_lengths.md
docs: modify the structure of documents Co-authored-by: Keilo_W<wangkaiyu11@h-partners.com> # message auto-generated for no-merge-commit merge: !3287 merge docs into master docs: modify the structure of documents Created-by: Keilo_W Commit-by: Keilo_W Merged-by: ascend-robot Description: 1、Modify the structure of documents 2、Pass the ci of Doc Tools See merge request: Ascend/MindSpeed!32872 个月前
muon-optimizer.md
feat: add mcore muon Co-authored-by: wuweiqiang24<1005334931@qq.com> Co-authored-by: wuweiqiang24<wuweiqiang11@huawei.com> # message auto-generated for no-merge-commit merge: !3442 merge add_mcore_muon into master feat: add mcore muon Created-by: wuweiqiang24 Commit-by: wuweiqiang24 Merged-by: ascend-robot Description: 1、增加Muon优化器特性 2、Muon + TP兼容适配 3、Muon + Zero兼容适配 See merge request: Ascend/MindSpeed!34428 天前
noop-layers.md
docs: modify the structure of documents Co-authored-by: Keilo_W<wangkaiyu11@h-partners.com> # message auto-generated for no-merge-commit merge: !3287 merge docs into master docs: modify the structure of documents Created-by: Keilo_W Commit-by: Keilo_W Merged-by: ascend-robot Description: 1、Modify the structure of documents 2、Pass the ci of Doc Tools See merge request: Ascend/MindSpeed!32872 个月前
norm-recompute.md
docs: modify the structure of documents Co-authored-by: Keilo_W<wangkaiyu11@h-partners.com> # message auto-generated for no-merge-commit merge: !3287 merge docs into master docs: modify the structure of documents Created-by: Keilo_W Commit-by: Keilo_W Merged-by: ascend-robot Description: 1、Modify the structure of documents 2、Pass the ci of Doc Tools See merge request: Ascend/MindSpeed!32872 个月前
npu_datadump.md
docs: modify the structure of documents Co-authored-by: Keilo_W<wangkaiyu11@h-partners.com> # message auto-generated for no-merge-commit merge: !3287 merge docs into master docs: modify the structure of documents Created-by: Keilo_W Commit-by: Keilo_W Merged-by: ascend-robot Description: 1、Modify the structure of documents 2、Pass the ci of Doc Tools See merge request: Ascend/MindSpeed!32872 个月前
npu_deterministic.md
docs: modify the structure of documents Co-authored-by: Keilo_W<wangkaiyu11@h-partners.com> # message auto-generated for no-merge-commit merge: !3287 merge docs into master docs: modify the structure of documents Created-by: Keilo_W Commit-by: Keilo_W Merged-by: ascend-robot Description: 1、Modify the structure of documents 2、Pass the ci of Doc Tools See merge request: Ascend/MindSpeed!32872 个月前
npu_matmul_add.md
docs:modify document Co-authored-by: z60112595<zhaotao68@h-partners.com> # message auto-generated for no-merge-commit merge: !3490 merge master into master docs:modify document Created-by: kali00 Commit-by: z60112595 Merged-by: ascend-robot Description: What this PR does / why we need it? https://gitcode.com/Ascend/MindSpeed/issues/163 1、将26.0.0_core_r0.12.1的docs下的资料修改内容合入到master中 2、给“说明”标签增加换行 3、将特性列表和自定义算子列表中的超链接修改成相对链接 Does this PR introduce any user-facing change? Please describe whether the PR will result in any user-facing usage changes. If there is related documentation, please specify its path. How was this patch tested? Please explain how to verify the correctness and effectiveness of this feature, as well as its usage constraints and limitations. See merge request: Ascend/MindSpeed!34907 天前
ops_flops_cal.md
docs: modify the structure of documents Co-authored-by: Keilo_W<wangkaiyu11@h-partners.com> # message auto-generated for no-merge-commit merge: !3287 merge docs into master docs: modify the structure of documents Created-by: Keilo_W Commit-by: Keilo_W Merged-by: ascend-robot Description: 1、Modify the structure of documents 2、Pass the ci of Doc Tools See merge request: Ascend/MindSpeed!32872 个月前
pipeline-model-parallel-layout.md
feat: add custom pp layout Co-authored-by: wuweiqiang24<wuweiqiang11@huawei.com> # message auto-generated for no-merge-commit merge: !3496 merge add_pp_layout into master feat: add custom pp layout Created-by: wuweiqiang24 Commit-by: wuweiqiang24 Merged-by: ascend-robot Description: 新增pipeline-model-parallel-layout功能，支持自定义PP每个stage的层排布 验证链接：https://wiki.huawei.com/domains/137239/wiki/268925/WIKI2026052611233549 issue: https://gitcode.com/Ascend/MindSpeed/issues/166 See merge request: Ascend/MindSpeed!34969 小时前
pipeline-parallel.md
docs: modify the structure of documents Co-authored-by: Keilo_W<wangkaiyu11@h-partners.com> # message auto-generated for no-merge-commit merge: !3287 merge docs into master docs: modify the structure of documents Created-by: Keilo_W Commit-by: Keilo_W Merged-by: ascend-robot Description: 1、Modify the structure of documents 2、Pass the ci of Doc Tools See merge request: Ascend/MindSpeed!32872 个月前
preprocess-eod-data.md
docs: modify the structure of documents Co-authored-by: Keilo_W<wangkaiyu11@h-partners.com> # message auto-generated for no-merge-commit merge: !3287 merge docs into master docs: modify the structure of documents Created-by: Keilo_W Commit-by: Keilo_W Merged-by: ascend-robot Description: 1、Modify the structure of documents 2、Pass the ci of Doc Tools See merge request: Ascend/MindSpeed!32872 个月前
qat_quant.md
add w8a16 quant Co-authored-by: wangjunhang<wangjunhang7@huawei.com> # message auto-generated for no-merge-commit merge: !3460 merge Dev_W8A16 into master add w8a16 quant Created-by: goodflower9 Commit-by: wangjunhang Merged-by: ascend-robot Description: What this PR does / why we need it? This PR adds W8A16 MXFP8 QAT support based on the existing QAT flow. Does this PR introduce any user-facing change? Yes. Users can enable W8A16 MXFP8 QAT with: ``` --qat-scheme w8a16-mxfp8 ``` Related doc: ``` docs/zh/features/qat_quant.md ``` How was this patch tested? Enable fake quantization by adding the parameter --qat-scheme w8a16-mxfp8 https://wiki.huawei.com/domains/76578/wiki/233229/WIKI2026051211063362 See merge request: Ascend/MindSpeed!34603 天前
recomputation.md
docs: modify the structure of documents Co-authored-by: Keilo_W<wangkaiyu11@h-partners.com> # message auto-generated for no-merge-commit merge: !3287 merge docs into master docs: modify the structure of documents Created-by: Keilo_W Commit-by: Keilo_W Merged-by: ascend-robot Description: 1、Modify the structure of documents 2、Pass the ci of Doc Tools See merge request: Ascend/MindSpeed!32872 个月前
recompute_independent_pipelining.md
docs: modify the structure of documents Co-authored-by: Keilo_W<wangkaiyu11@h-partners.com> # message auto-generated for no-merge-commit merge: !3287 merge docs into master docs: modify the structure of documents Created-by: Keilo_W Commit-by: Keilo_W Merged-by: ascend-robot Description: 1、Modify the structure of documents 2、Pass the ci of Doc Tools See merge request: Ascend/MindSpeed!32872 个月前
reset-bucket-group-order.md
docs: modify the structure of documents Co-authored-by: Keilo_W<wangkaiyu11@h-partners.com> # message auto-generated for no-merge-commit merge: !3287 merge docs into master docs: modify the structure of documents Created-by: Keilo_W Commit-by: Keilo_W Merged-by: ascend-robot Description: 1、Modify the structure of documents 2、Pass the ci of Doc Tools See merge request: Ascend/MindSpeed!32872 个月前
reuse-fp32-param.md
docs: modify the structure of documents Co-authored-by: Keilo_W<wangkaiyu11@h-partners.com> # message auto-generated for no-merge-commit merge: !3287 merge docs into master docs: modify the structure of documents Created-by: Keilo_W Commit-by: Keilo_W Merged-by: ascend-robot Description: 1、Modify the structure of documents 2、Pass the ci of Doc Tools See merge request: Ascend/MindSpeed!32872 个月前
ring-attention-context-parallel.md
docs: modify the structure of documents Co-authored-by: Keilo_W<wangkaiyu11@h-partners.com> # message auto-generated for no-merge-commit merge: !3287 merge docs into master docs: modify the structure of documents Created-by: Keilo_W Commit-by: Keilo_W Merged-by: ascend-robot Description: 1、Modify the structure of documents 2、Pass the ci of Doc Tools See merge request: Ascend/MindSpeed!32872 个月前
rms_norm.md
docs: modify the structure of documents Co-authored-by: Keilo_W<wangkaiyu11@h-partners.com> # message auto-generated for no-merge-commit merge: !3287 merge docs into master docs: modify the structure of documents Created-by: Keilo_W Commit-by: Keilo_W Merged-by: ascend-robot Description: 1、Modify the structure of documents 2、Pass the ci of Doc Tools See merge request: Ascend/MindSpeed!32872 个月前
rotary-embedding.md
docs: modify the structure of documents Co-authored-by: Keilo_W<wangkaiyu11@h-partners.com> # message auto-generated for no-merge-commit merge: !3287 merge docs into master docs: modify the structure of documents Created-by: Keilo_W Commit-by: Keilo_W Merged-by: ascend-robot Description: 1、Modify the structure of documents 2、Pass the ci of Doc Tools See merge request: Ascend/MindSpeed!32872 个月前
sequence-parallel.md
docs: modify the structure of documents Co-authored-by: Keilo_W<wangkaiyu11@h-partners.com> # message auto-generated for no-merge-commit merge: !3287 merge docs into master docs: modify the structure of documents Created-by: Keilo_W Commit-by: Keilo_W Merged-by: ascend-robot Description: 1、Modify the structure of documents 2、Pass the ci of Doc Tools See merge request: Ascend/MindSpeed!32872 个月前
shared-experts.md
docs: modify the structure of documents Co-authored-by: Keilo_W<wangkaiyu11@h-partners.com> # message auto-generated for no-merge-commit merge: !3287 merge docs into master docs: modify the structure of documents Created-by: Keilo_W Commit-by: Keilo_W Merged-by: ascend-robot Description: 1、Modify the structure of documents 2、Pass the ci of Doc Tools See merge request: Ascend/MindSpeed!32872 个月前
smart_swap.md
docs: modify the structure of documents Co-authored-by: Keilo_W<wangkaiyu11@h-partners.com> # message auto-generated for no-merge-commit merge: !3287 merge docs into master docs: modify the structure of documents Created-by: Keilo_W Commit-by: Keilo_W Merged-by: ascend-robot Description: 1、Modify the structure of documents 2、Pass the ci of Doc Tools See merge request: Ascend/MindSpeed!32872 个月前
swap-optimizer.md
feat: SwapMuon add save/load ckpt support Co-authored-by: JialiZheng<jializheng@huawei.com> # message auto-generated for no-merge-commit merge: !3518 merge master into master feat: SwapMuon add save/load ckpt support Created-by: JialiZheng1 Commit-by: JialiZheng Merged-by: ascend-robot Description: SwapMuon add save/load ckpt support RFC：https://gitcode.com/Ascend/MindSpeed/issues/164 See merge request: Ascend/MindSpeed!351811 小时前
swap_attention.md
docs: modify the structure of documents Co-authored-by: Keilo_W<wangkaiyu11@h-partners.com> # message auto-generated for no-merge-commit merge: !3287 merge docs into master docs: modify the structure of documents Created-by: Keilo_W Commit-by: Keilo_W Merged-by: ascend-robot Description: 1、Modify the structure of documents 2、Pass the ci of Doc Tools See merge request: Ascend/MindSpeed!32872 个月前
swiglu.md
docs: modify the structure of documents Co-authored-by: Keilo_W<wangkaiyu11@h-partners.com> # message auto-generated for no-merge-commit merge: !3287 merge docs into master docs: modify the structure of documents Created-by: Keilo_W Commit-by: Keilo_W Merged-by: ascend-robot Description: 1、Modify the structure of documents 2、Pass the ci of Doc Tools See merge request: Ascend/MindSpeed!32872 个月前
te-comparsion-online.md
docs: modify the structure of documents Co-authored-by: Keilo_W<wangkaiyu11@h-partners.com> # message auto-generated for no-merge-commit merge: !3287 merge docs into master docs: modify the structure of documents Created-by: Keilo_W Commit-by: Keilo_W Merged-by: ascend-robot Description: 1、Modify the structure of documents 2、Pass the ci of Doc Tools See merge request: Ascend/MindSpeed!32872 个月前
tensor-parallel-2d.md
docs: modify the structure of documents Co-authored-by: Keilo_W<wangkaiyu11@h-partners.com> # message auto-generated for no-merge-commit merge: !3287 merge docs into master docs: modify the structure of documents Created-by: Keilo_W Commit-by: Keilo_W Merged-by: ascend-robot Description: 1、Modify the structure of documents 2、Pass the ci of Doc Tools See merge request: Ascend/MindSpeed!32872 个月前
tensor-parallel.md
docs: modify the structure of documents Co-authored-by: Keilo_W<wangkaiyu11@h-partners.com> # message auto-generated for no-merge-commit merge: !3287 merge docs into master docs: modify the structure of documents Created-by: Keilo_W Commit-by: Keilo_W Merged-by: ascend-robot Description: 1、Modify the structure of documents 2、Pass the ci of Doc Tools See merge request: Ascend/MindSpeed!32872 个月前
transformer_engine.md
feat: mxfp8-32x32 quant Co-authored-by: kyle_zhangchi<zhangchi158@huawei.com> # message auto-generated for no-merge-commit merge: !3471 merge feat_mxfp8-32x32 into master feat: mxfp8-32x32 quant Created-by: kyle_zhangchi Commit-by: kyle_zhangchi Merged-by: ascend-robot Description: ## What this PR does / why we need it? 在Megatron框架下新增mxfp8-32x32量化算子，降低权重显存占用 ## Does this PR introduce *any* user-facing change? --fp8-recipe新增mxfp8-32x32选项 https://gitcode.com/Ascend/MindSpeed/commit/e065cbca6873bfc02661d088b07d90224333e87d?ref=feat_mxfp8-32x32&prId=3471 ## How was this patch tested? 验证文档 https://wiki.huawei.com/domains/170864/wiki/367830/WIKI2026051111046509 See merge request: Ascend/MindSpeed!34717 天前
ulysses-context-parallel.md
docs: modify the structure of documents Co-authored-by: Keilo_W<wangkaiyu11@h-partners.com> # message auto-generated for no-merge-commit merge: !3287 merge docs into master docs: modify the structure of documents Created-by: Keilo_W Commit-by: Keilo_W Merged-by: ascend-robot Description: 1、Modify the structure of documents 2、Pass the ci of Doc Tools See merge request: Ascend/MindSpeed!32872 个月前
unaligned-pipeline.md
docs: modify the structure of documents Co-authored-by: Keilo_W<wangkaiyu11@h-partners.com> # message auto-generated for no-merge-commit merge: !3287 merge docs into master docs: modify the structure of documents Created-by: Keilo_W Commit-by: Keilo_W Merged-by: ascend-robot Description: 1、Modify the structure of documents 2、Pass the ci of Doc Tools See merge request: Ascend/MindSpeed!32872 个月前
unaligned-ring-context-parallel.md
docs: modify the structure of documents Co-authored-by: Keilo_W<wangkaiyu11@h-partners.com> # message auto-generated for no-merge-commit merge: !3287 merge docs into master docs: modify the structure of documents Created-by: Keilo_W Commit-by: Keilo_W Merged-by: ascend-robot Description: 1、Modify the structure of documents 2、Pass the ci of Doc Tools See merge request: Ascend/MindSpeed!32872 个月前
unaligned-ulysses-context-parallel.md
docs: modify the structure of documents Co-authored-by: Keilo_W<wangkaiyu11@h-partners.com> # message auto-generated for no-merge-commit merge: !3287 merge docs into master docs: modify the structure of documents Created-by: Keilo_W Commit-by: Keilo_W Merged-by: ascend-robot Description: 1、Modify the structure of documents 2、Pass the ci of Doc Tools See merge request: Ascend/MindSpeed!32872 个月前
unaligned_linear.md
docs: modify the structure of documents Co-authored-by: Keilo_W<wangkaiyu11@h-partners.com> # message auto-generated for no-merge-commit merge: !3287 merge docs into master docs: modify the structure of documents Created-by: Keilo_W Commit-by: Keilo_W Merged-by: ascend-robot Description: 1、Modify the structure of documents 2、Pass the ci of Doc Tools See merge request: Ascend/MindSpeed!32872 个月前
variable_seq_lengths.md
docs: modify the structure of documents Co-authored-by: Keilo_W<wangkaiyu11@h-partners.com> # message auto-generated for no-merge-commit merge: !3287 merge docs into master docs: modify the structure of documents Created-by: Keilo_W Commit-by: Keilo_W Merged-by: ascend-robot Description: 1、Modify the structure of documents 2、Pass the ci of Doc Tools See merge request: Ascend/MindSpeed!32872 个月前
verl-ckpt-acceleration.md
[docs] update version numbers and related hyperlinks in documentation, and move png figures into 'figures' directory Co-authored-by: fanlu5<fanlu5@huawei.com> # message auto-generated for no-merge-commit merge: !3472 merge master into master [docs] update version numbers and related hyperlinks in documentation, and move png figures into 'figures' directory Created-by: fanlu5 Commit-by: fanlu5 Merged-by: ascend-robot Description: What this PR does / why we need it? update version numbers and related hyperlinks in documentation, and move png figures into 'figures' directory - Update README.md and installation guide with latest changes - Update ops documentation and release notes - move png figures into 'figures' directory Does this PR introduce any user-facing change? NA How was this patch tested? NA See merge request: Ascend/MindSpeed!347219 天前
virtual-optimizer.md
docs: modify the structure of documents Co-authored-by: Keilo_W<wangkaiyu11@h-partners.com> # message auto-generated for no-merge-commit merge: !3287 merge docs into master docs: modify the structure of documents Created-by: Keilo_W Commit-by: Keilo_W Merged-by: ascend-robot Description: 1、Modify the structure of documents 2、Pass the ci of Doc Tools See merge request: Ascend/MindSpeed!32872 个月前
virtual-pipeline-parallel.md
docs: modify the structure of documents Co-authored-by: Keilo_W<wangkaiyu11@h-partners.com> # message auto-generated for no-merge-commit merge: !3287 merge docs into master docs: modify the structure of documents Created-by: Keilo_W Commit-by: Keilo_W Merged-by: ascend-robot Description: 1、Modify the structure of documents 2、Pass the ci of Doc Tools See merge request: Ascend/MindSpeed!32872 个月前