昇腾SD类模型推理引擎
| Files | Last commit | Last update |
|---|---|---|
update: 更新文件 PULL_REQUEST_TEMPLATE.md Signed-off-by: limuyuan31 <limuyuan3@huawei.com> | 10 months ago | |
[dev]同步最新代码 Co-authored-by: mazhixin00_00<mazhixin7@huawei.com> | 11 months ago | |
[feature]新增BlockSparseAttention算子的plugin和UT Co-authored-by: lanwangli<lanwangli@huawei.com> # message auto-generated for no-merge-commit merge: !73 merge bsa_op2_host into dev [feature]新增BlockSparseAttention算子的plugin和UT Created-by: mazhixin00_00 Commit-by: lanwangli Merged-by: ascend-robot Description: [feature]新增BlockSparseAttention算子、以及plugin和UT **单算子调用** import torch torch.ops.load_library("mindiesd/plugin/libPTAExtensionOPS.so") output = torch.ops.mindie.block_sparse_attention( query=query, key=key, value=value, sparse_mask=smask, sparse_count_table=sparse_count_table, input_layout="BNSD", num_heads=query.shape[1] , num_key_value_heads=key.shape[1], scale_value = query.shape[-1] **-0.5, causal=False ) - sparse_mask:稀疏 mask,shape 为 (BatchSize, NumHeads, Sn1, Sn2),其中 Sn1 = (SeqLenQ + SparseSize - 1)//SparseSize,Sn2 = Align((SeqLenKV + SparseSize - 1)//SparseSize, 32),数据类型支持int8。 - sparse_count_table:为 sparse_mask 对最后一维的求和,shape 为 (BatchSize, NumHeads, Sn1),数据类型支持int32。 - input_layout:目前只支持BNSD、BSND和BSH **全量测试结果**  **单算子测试结果**  See merge request: Ascend/MindIE-SD!73 | 10 months ago | |
[bugfix]修复稀疏算子不支持A3的问题 Co-authored-by: mazhixin00_00<mazhixin7@huawei.com> # message auto-generated for no-merge-commit merge: !105 merge op_a3 into dev [bugfix]修复稀疏算子不支持A3的问题 Created-by: mazhixin00_00 Commit-by: mazhixin00_00 Merged-by: ascend-robot Description: <!-- PR描述模板更新日期:20251224 --> # Which issue(s) this PR fixes or accomplishes 稀疏算子 BlockSparseAttention 和 SparseBlockEstimate 支持A3 # Test Report SparseBlockEstimate算子plugin  BlockSparseAttention算子plugin  稀疏算子  See merge request: Ascend/MindIE-SD!105 | 10 months ago | |
[dev]同步最新代码 Co-authored-by: mazhixin00_00<mazhixin7@huawei.com> | 11 months ago | |
[Docs]更新README中developer_guide软件包安装顺序、安装描述 Co-authored-by: zhouwenxue<zhouwenxue2@huawei.com> # message auto-generated for no-merge-commit merge: !99 merge dev into dev [Docs]更新README中developer_guide软件包安装顺序、安装描述 Created-by: zhou-wenxue Commit-by: zhouwenxue Merged-by: ascend-robot Description: # Purpose 1、更新developer_guide中gcc,g++安装顺序,这一步要在torch、 torch_npu之前 2、在驱动固件、CANN的安装部分,提供相关超链接跳转到相对应文档手册 3、修改安装后的验证命令 4、补充依赖wheel 5、补充说明是在SD仓路径下运行wan推理命令 6、contributing中说明开发者提PR提到dev分支 See merge request: Ascend/MindIE-SD!99 | 10 months ago | |
[Refactor]移除冗余模块代码,与模型解耦,删除和模型相关代码 Co-authored-by: weixin_44144262<lijinxi2@huawei.com> # message auto-generated for no-merge-commit merge: !15 merge del into dev [Refactor]移除冗余模块代码,与模型解耦,删除和模型相关代码 Created-by: weixin_44144262 Commit-by: weixin_44144262 Merged-by: ascend-robot Description: 移除冗余代码,与模型解耦,删除和模型相关代码  See merge request: Ascend/MindIE-SD!15 | 10 months ago | |
[dev]同步最新代码 Co-authored-by: mazhixin00_00<mazhixin7@huawei.com> | 11 months ago | |
rf_v3改名为rf_v2,和论文保持名字一致 Co-authored-by: mazhixin00_00<mazhixin7@huawei.com> # message auto-generated for no-merge-commit merge: !110 merge rf_v2 into dev rf_v3改名为rf_v2,和论文保持名字一致 Created-by: mazhixin00_00 Commit-by: mazhixin00_00 Merged-by: ascend-robot Description: rf_v3改名为rf_v2 See merge request: Ascend/MindIE-SD!110 | 10 months ago | |
rf_v3改名为rf_v2,和论文保持名字一致 Co-authored-by: mazhixin00_00<mazhixin7@huawei.com> # message auto-generated for no-merge-commit merge: !110 merge rf_v2 into dev rf_v3改名为rf_v2,和论文保持名字一致 Created-by: mazhixin00_00 Commit-by: mazhixin00_00 Merged-by: ascend-robot Description: rf_v3改名为rf_v2 See merge request: Ascend/MindIE-SD!110 | 10 months ago | |
[dev]同步最新代码 Co-authored-by: mazhixin00_00<mazhixin7@huawei.com> | 11 months ago | |
[dev]同步最新代码 Co-authored-by: mazhixin00_00<mazhixin7@huawei.com> | 11 months ago | |
[dev]同步最新代码 Co-authored-by: mazhixin00_00<mazhixin7@huawei.com> | 11 months ago | |
[Docs]更新README中developer_guide软件包安装顺序、安装描述 Co-authored-by: zhouwenxue<zhouwenxue2@huawei.com> # message auto-generated for no-merge-commit merge: !99 merge dev into dev [Docs]更新README中developer_guide软件包安装顺序、安装描述 Created-by: zhou-wenxue Commit-by: zhouwenxue Merged-by: ascend-robot Description: # Purpose 1、更新developer_guide中gcc,g++安装顺序,这一步要在torch、 torch_npu之前 2、在驱动固件、CANN的安装部分,提供相关超链接跳转到相对应文档手册 3、修改安装后的验证命令 4、补充依赖wheel 5、补充说明是在SD仓路径下运行wan推理命令 6、contributing中说明开发者提PR提到dev分支 See merge request: Ascend/MindIE-SD!99 | 10 months ago | |
更新MindIE安全说明 Co-authored-by: z00897138<zhaorifa@huawei.com> # message auto-generated for no-merge-commit merge: !83 merge dev into dev 更新MindIE安全说明 Created-by: zhaorifa263 Commit-by: z00897138 Merged-by: ascend-robot Description: <!-- PR描述模板更新日期:20250115 --> **What type of PR is this?** > 根据当前PR的情况,选择保留一个: > > 其他: /kind task 。 **What does this PR do / why do we need it** : 新增对MindIE的安全声明 **Which issue(s) this PR fixes** : > Fixes #NA **Special notes for your reviewers**: > 描述关键注意点,风险点,让检视专家重点协助把关。 **Self CheckList** : > PR提交人对以下CheckList自检项进行全量自检,自检通过或不涉及,均修改 [ ] 为 [x] - [x] PR标题和描述,是否按格式填写 - [x] 代码注释是否完备,是否正确记录错误日志 - [x] 若涉及对外接口变更,是否已通过变更评审,是否考虑兼容性影响 - [x] 是否通过本地IDE对代码进行静态检查、格式化处理 - [x] 是否进行空指针校验 - [x] 是否进行返回值校验 (禁止使用void屏蔽安全函数、自研函数返回值,C++标准库函数确认无问题可以屏蔽) - [x] 若存在资源申请,使用后是否正确释放 - [x] 若涉及多线程场景,是否考虑并发和死锁 - [x] 是否充分考虑接口的异常场景 - [x] 新增或修改的代码是否完成DT测试,且测试覆盖率达到标准要求 **Committer CheckList** : > Committer 对以下CheckList项进行全量检视,通过或不涉及,均修改 [ ] 为 [x] - [ ] PR功能单一,超500行代码上库前需要集体检视,超1000行代码需要拆分PR - [ ] PR中的有效检视意见,是否均已修改完成,Reviewer/Committer已回复ok - [ ] 测试用例覆盖场景是否完备,自测试报告是否完整 - [ ] 是否选择正确的上库分支 - [ ] PR加分是否满足要求 - [ ] 若涉及对外接口变更,是否已通过变更评审,是否考虑兼容性影响 - [ ] 是否进行返回值校验 (禁止使用void屏蔽安全函数、自研函数返回值,C++标准库函数确认无问题可以屏蔽) - [ ] 若存在资源申请,使用后是否正确释放 - [ ] 若涉及多线程场景,是否考虑并发和死锁 - [ ] DT增量行覆盖率要求80% **Test Report** : > 各团队根据需要自定制格式,描述关键信息,附上截图。特殊情况请用文字做补充说明。 <!-- Optional, customized as needed. 各团队根据需要自定制格式,描述关键信息,可以附上截图. --> See merge request: Ascend/MindIE-SD!83 | 10 months ago | |
[Docs]更新README中developer_guide软件包安装顺序、安装描述 Co-authored-by: zhouwenxue<zhouwenxue2@huawei.com> # message auto-generated for no-merge-commit merge: !99 merge dev into dev [Docs]更新README中developer_guide软件包安装顺序、安装描述 Created-by: zhou-wenxue Commit-by: zhouwenxue Merged-by: ascend-robot Description: # Purpose 1、更新developer_guide中gcc,g++安装顺序,这一步要在torch、 torch_npu之前 2、在驱动固件、CANN的安装部分,提供相关超链接跳转到相对应文档手册 3、修改安装后的验证命令 4、补充依赖wheel 5、补充说明是在SD仓路径下运行wan推理命令 6、contributing中说明开发者提PR提到dev分支 See merge request: Ascend/MindIE-SD!99 | 10 months ago | |
[dev]同步最新代码 Co-authored-by: mazhixin00_00<mazhixin7@huawei.com> | 11 months ago | |
修改出包名称为mindiesd、支持非默认cann toolkit安装路径 Co-authored-by: changetheway<guotaoyuan1@h-partners.com> # message auto-generated for no-merge-commit merge: !57 merge dev into dev [BUGFIX]修改出包名称为mindiesd、支持非默认cann toolkit安装路径 Created-by: changetheway Commit-by: changetheway Merged-by: lanwangli Description: 1、之前出包名称是mindie_sd,安装卸载都是pip install/show/uninstall mindie_sd,调用时却需要import mindiesd。统一成mindiesd的命名。 2、支持依赖非默认的cann toolkit安装路径 See merge request: Ascend/MindIE-SD!57 | 10 months ago |
MindIE-SD
Description
昇腾SD类模型推理引擎
Software Architecture
Software architecture description
Installation
- xxxx
- xxxx
- xxxx
Instructions
- xxxx
- xxxx
- xxxx
Contribution
- Fork the repository
- Create Feat_xxx branch
- Commit your code
- Create Pull Request
Gitee Feature
- You can use Readme_XXX.md to support different languages, such as Readme_en.md, Readme_zh.md
- Gitee blog blog.gitee.com
- Explore open source project https://gitee.com/explore
- The most valuable open source project GVP
- The manual of Gitee https://gitee.com/help
- The most popular members https://gitee.com/gitee-stars/