已关闭
[Feature]: GLM DSA sparse attention and KPool infrastructure #87
guozhihua2创建于 6 天前关闭于 4 天前
6 天前 添加了label:feature
leizhenzhen23
6 天前 评论:
6 天前 评论:
👋 您好,欢迎向 MindSpeed-Bridge 提交 Issue!
我们已收到您的反馈,感谢你对开源社区的支持。🎉
📅 处理时效: 维护团队将在 24 小时内 查看并回复您的问题(工作日)。
🔍 自助查询: 在等待期间,建议您先查阅社区文档,可能已有解决方案:
🚨 紧急联系: 如果您的问题非常紧急,可通过以下方式联系我们:
📧 邮箱:[ leizhenzhen4@huawei.com ]
请确保 Issue 描述清晰,包含复现步骤和日志,这将帮助我们更快定位问题。谢谢!


6 天前 添加了label:triaged
6 天前 关联了pull request:feat(glm): add GLM DSA sparse attention and KPool infrastructure
5 天前 关联了pull request:feat: support GLM-5.3-Flash
4 天前 关闭了 issue
4 天前 issue状态由 TODO 改变为 DONE
4 天前 添加了label:resolved
Background
GLM-5.3-Flash introduces hybrid attention (KDA linear attention alternating with DSA sparse attention) on top of the existing GLM5/GLM5.2 DSA stack. The sparse-attention groundwork (KPool indexer, kvallgather CP path for DSA, index-share reuse across shared decoder layers) is shared infrastructure that should land and be reviewed independently of the GLM53Flash model itself.
Expected Changes
kpool.py,kpool_ascend.py) with fixed-width top-k layout and Ascend fused kernels.dsa_kvallgather_context_parallel.py: kvallgather CP path for DSA, including contiguous/lightning-indexer localization branches.glm_dsa_index_share.pyholder module.features/megatron/{glm,glm_vl,qwen_vl,common}andfeatures/megatron_bridge/{glm_vl,common}; OptimizeSendRecvCommFeature (dual-group ordinary P2P for PP send/recv) and Qwen3ASRAutoConfigFeature added.tests/poc/glm5andtests/poc/glm52.The GLM53Flash model, data pipeline and ST land in follow-up PRs that depend on this one.
Acceptance Criteria
python -m py_compilepasses on all new/changed files; repository pre-commit hooks pass on the PR diff.