Star81
129
代码
代码
Issues101
Pull Requests25
流水线
项目讨论
Wiki
分析
Star81
129
ascend-robotascend-robot[Feature][ops]将 fused infer attention score 算子迁移到 MindIE-SD
2cb5249d创建于 7月4日历史提交
文件最后提交记录最后更新时间
incre_flash_attention_tiling.cpp
[Feature][ops]将 fused infer attention score 算子迁移到 MindIE-SD Co-authored-by: jiajin_qi<qijiajin1@huawei.com> # message auto-generated for no-merge-commit merge: !436 merge dev into dev [Feature][ops]将 fused infer attention score 算子迁移到 MindIE-SD Created-by: jiajin_qi Commit-by: jiajin_qi Merged-by: ascend-robot Description: Which issue(s) this PR fixes or accomplishes Fix part of #ISSUE 198 Purpose 为 incre_flash_attention 算子新增 host 侧完整 tiling 实现，支撑推理场景的 tiling 数据结构与计算流程。 主要新增内容（位于 csrc/ops/incre_flash_attention/op_host/）： tiling 数据结构定义：incre_flash_attention_tiling.h、incre_flash_attention_tiling_base.h、incre_flash_attention_tiling_struct.h，覆盖 Base / Core / SingleCore / SplitKV / InitOutput / Prefix 等参数 主 tiling 计算逻辑：incre_flash_attention_tiling.cpp，含对齐、分核、sparse 处理等基础工具 MLA（Multi-head Latent Attention）支持：incre_flash_attention_tiling_mla.h，定义 MLA 专属 Base/Core/SingleCore 参数与 AIC 核数约束 V2 版本实现：incre_flash_attention_tiling_v2.cpp、incre_flash_attention_tiling_v2.h，扩展 prefix 与 V2 tiling data tiling 校验：incre_flash_attention_tiling_check.cpp 上下文与实现细节：incre_flash_attention_tiling_context.h、incre_flash_attention_tiling_impl.h Test Plan 编译算子组件： bash build/build_ops.sh bash build/build_ascendc_ops.sh 运行 fused infer attention score UT： bash tests/ops/fused_infer_attention_score/run_fia_arch35_ut.sh 运行 Python 侧 fused infer attention score 测试： pytest tests/ops/fused_infer_attention_score/test_fused_infer_attention_score_v2.py Wan2.2 5B TI2V w8a8f8推理测试 Test Report 待补充： bash build/build_ops.sh: ok bash build/build_ascendc_ops.sh: ok bash tests/ops/fused_infer_attention_score/run_fia_arch35_ut.sh: passed pytest tests/ops/fused_infer_attention_score/test_fused_infer_attention_score_v2.py: passed Wan2.2 5B TI2V w8a8f8推理测试正常 See merge request: Ascend/MindIE-SD!436
1 个月前
incre_flash_attention_tiling.h
[Feature][ops]将 fused infer attention score 算子迁移到 MindIE-SD Co-authored-by: jiajin_qi<qijiajin1@huawei.com> # message auto-generated for no-merge-commit merge: !436 merge dev into dev [Feature][ops]将 fused infer attention score 算子迁移到 MindIE-SD Created-by: jiajin_qi Commit-by: jiajin_qi Merged-by: ascend-robot Description: Which issue(s) this PR fixes or accomplishes Fix part of #ISSUE 198 Purpose 为 incre_flash_attention 算子新增 host 侧完整 tiling 实现，支撑推理场景的 tiling 数据结构与计算流程。 主要新增内容（位于 csrc/ops/incre_flash_attention/op_host/）： tiling 数据结构定义：incre_flash_attention_tiling.h、incre_flash_attention_tiling_base.h、incre_flash_attention_tiling_struct.h，覆盖 Base / Core / SingleCore / SplitKV / InitOutput / Prefix 等参数 主 tiling 计算逻辑：incre_flash_attention_tiling.cpp，含对齐、分核、sparse 处理等基础工具 MLA（Multi-head Latent Attention）支持：incre_flash_attention_tiling_mla.h，定义 MLA 专属 Base/Core/SingleCore 参数与 AIC 核数约束 V2 版本实现：incre_flash_attention_tiling_v2.cpp、incre_flash_attention_tiling_v2.h，扩展 prefix 与 V2 tiling data tiling 校验：incre_flash_attention_tiling_check.cpp 上下文与实现细节：incre_flash_attention_tiling_context.h、incre_flash_attention_tiling_impl.h Test Plan 编译算子组件： bash build/build_ops.sh bash build/build_ascendc_ops.sh 运行 fused infer attention score UT： bash tests/ops/fused_infer_attention_score/run_fia_arch35_ut.sh 运行 Python 侧 fused infer attention score 测试： pytest tests/ops/fused_infer_attention_score/test_fused_infer_attention_score_v2.py Wan2.2 5B TI2V w8a8f8推理测试 Test Report 待补充： bash build/build_ops.sh: ok bash build/build_ascendc_ops.sh: ok bash tests/ops/fused_infer_attention_score/run_fia_arch35_ut.sh: passed pytest tests/ops/fused_infer_attention_score/test_fused_infer_attention_score_v2.py: passed Wan2.2 5B TI2V w8a8f8推理测试正常 See merge request: Ascend/MindIE-SD!436
1 个月前
incre_flash_attention_tiling_base.h
[Feature][ops]将 fused infer attention score 算子迁移到 MindIE-SD Co-authored-by: jiajin_qi<qijiajin1@huawei.com> # message auto-generated for no-merge-commit merge: !436 merge dev into dev [Feature][ops]将 fused infer attention score 算子迁移到 MindIE-SD Created-by: jiajin_qi Commit-by: jiajin_qi Merged-by: ascend-robot Description: Which issue(s) this PR fixes or accomplishes Fix part of #ISSUE 198 Purpose 为 incre_flash_attention 算子新增 host 侧完整 tiling 实现，支撑推理场景的 tiling 数据结构与计算流程。 主要新增内容（位于 csrc/ops/incre_flash_attention/op_host/）： tiling 数据结构定义：incre_flash_attention_tiling.h、incre_flash_attention_tiling_base.h、incre_flash_attention_tiling_struct.h，覆盖 Base / Core / SingleCore / SplitKV / InitOutput / Prefix 等参数 主 tiling 计算逻辑：incre_flash_attention_tiling.cpp，含对齐、分核、sparse 处理等基础工具 MLA（Multi-head Latent Attention）支持：incre_flash_attention_tiling_mla.h，定义 MLA 专属 Base/Core/SingleCore 参数与 AIC 核数约束 V2 版本实现：incre_flash_attention_tiling_v2.cpp、incre_flash_attention_tiling_v2.h，扩展 prefix 与 V2 tiling data tiling 校验：incre_flash_attention_tiling_check.cpp 上下文与实现细节：incre_flash_attention_tiling_context.h、incre_flash_attention_tiling_impl.h Test Plan 编译算子组件： bash build/build_ops.sh bash build/build_ascendc_ops.sh 运行 fused infer attention score UT： bash tests/ops/fused_infer_attention_score/run_fia_arch35_ut.sh 运行 Python 侧 fused infer attention score 测试： pytest tests/ops/fused_infer_attention_score/test_fused_infer_attention_score_v2.py Wan2.2 5B TI2V w8a8f8推理测试 Test Report 待补充： bash build/build_ops.sh: ok bash build/build_ascendc_ops.sh: ok bash tests/ops/fused_infer_attention_score/run_fia_arch35_ut.sh: passed pytest tests/ops/fused_infer_attention_score/test_fused_infer_attention_score_v2.py: passed Wan2.2 5B TI2V w8a8f8推理测试正常 See merge request: Ascend/MindIE-SD!436
1 个月前
incre_flash_attention_tiling_check.cpp
[Feature][ops]将 fused infer attention score 算子迁移到 MindIE-SD Co-authored-by: jiajin_qi<qijiajin1@huawei.com> # message auto-generated for no-merge-commit merge: !436 merge dev into dev [Feature][ops]将 fused infer attention score 算子迁移到 MindIE-SD Created-by: jiajin_qi Commit-by: jiajin_qi Merged-by: ascend-robot Description: Which issue(s) this PR fixes or accomplishes Fix part of #ISSUE 198 Purpose 为 incre_flash_attention 算子新增 host 侧完整 tiling 实现，支撑推理场景的 tiling 数据结构与计算流程。 主要新增内容（位于 csrc/ops/incre_flash_attention/op_host/）： tiling 数据结构定义：incre_flash_attention_tiling.h、incre_flash_attention_tiling_base.h、incre_flash_attention_tiling_struct.h，覆盖 Base / Core / SingleCore / SplitKV / InitOutput / Prefix 等参数 主 tiling 计算逻辑：incre_flash_attention_tiling.cpp，含对齐、分核、sparse 处理等基础工具 MLA（Multi-head Latent Attention）支持：incre_flash_attention_tiling_mla.h，定义 MLA 专属 Base/Core/SingleCore 参数与 AIC 核数约束 V2 版本实现：incre_flash_attention_tiling_v2.cpp、incre_flash_attention_tiling_v2.h，扩展 prefix 与 V2 tiling data tiling 校验：incre_flash_attention_tiling_check.cpp 上下文与实现细节：incre_flash_attention_tiling_context.h、incre_flash_attention_tiling_impl.h Test Plan 编译算子组件： bash build/build_ops.sh bash build/build_ascendc_ops.sh 运行 fused infer attention score UT： bash tests/ops/fused_infer_attention_score/run_fia_arch35_ut.sh 运行 Python 侧 fused infer attention score 测试： pytest tests/ops/fused_infer_attention_score/test_fused_infer_attention_score_v2.py Wan2.2 5B TI2V w8a8f8推理测试 Test Report 待补充： bash build/build_ops.sh: ok bash build/build_ascendc_ops.sh: ok bash tests/ops/fused_infer_attention_score/run_fia_arch35_ut.sh: passed pytest tests/ops/fused_infer_attention_score/test_fused_infer_attention_score_v2.py: passed Wan2.2 5B TI2V w8a8f8推理测试正常 See merge request: Ascend/MindIE-SD!436
1 个月前
incre_flash_attention_tiling_context.h
[Feature][ops]将 fused infer attention score 算子迁移到 MindIE-SD Co-authored-by: jiajin_qi<qijiajin1@huawei.com> # message auto-generated for no-merge-commit merge: !436 merge dev into dev [Feature][ops]将 fused infer attention score 算子迁移到 MindIE-SD Created-by: jiajin_qi Commit-by: jiajin_qi Merged-by: ascend-robot Description: Which issue(s) this PR fixes or accomplishes Fix part of #ISSUE 198 Purpose 为 incre_flash_attention 算子新增 host 侧完整 tiling 实现，支撑推理场景的 tiling 数据结构与计算流程。 主要新增内容（位于 csrc/ops/incre_flash_attention/op_host/）： tiling 数据结构定义：incre_flash_attention_tiling.h、incre_flash_attention_tiling_base.h、incre_flash_attention_tiling_struct.h，覆盖 Base / Core / SingleCore / SplitKV / InitOutput / Prefix 等参数 主 tiling 计算逻辑：incre_flash_attention_tiling.cpp，含对齐、分核、sparse 处理等基础工具 MLA（Multi-head Latent Attention）支持：incre_flash_attention_tiling_mla.h，定义 MLA 专属 Base/Core/SingleCore 参数与 AIC 核数约束 V2 版本实现：incre_flash_attention_tiling_v2.cpp、incre_flash_attention_tiling_v2.h，扩展 prefix 与 V2 tiling data tiling 校验：incre_flash_attention_tiling_check.cpp 上下文与实现细节：incre_flash_attention_tiling_context.h、incre_flash_attention_tiling_impl.h Test Plan 编译算子组件： bash build/build_ops.sh bash build/build_ascendc_ops.sh 运行 fused infer attention score UT： bash tests/ops/fused_infer_attention_score/run_fia_arch35_ut.sh 运行 Python 侧 fused infer attention score 测试： pytest tests/ops/fused_infer_attention_score/test_fused_infer_attention_score_v2.py Wan2.2 5B TI2V w8a8f8推理测试 Test Report 待补充： bash build/build_ops.sh: ok bash build/build_ascendc_ops.sh: ok bash tests/ops/fused_infer_attention_score/run_fia_arch35_ut.sh: passed pytest tests/ops/fused_infer_attention_score/test_fused_infer_attention_score_v2.py: passed Wan2.2 5B TI2V w8a8f8推理测试正常 See merge request: Ascend/MindIE-SD!436
1 个月前
incre_flash_attention_tiling_impl.h
[Feature][ops]将 fused infer attention score 算子迁移到 MindIE-SD Co-authored-by: jiajin_qi<qijiajin1@huawei.com> # message auto-generated for no-merge-commit merge: !436 merge dev into dev [Feature][ops]将 fused infer attention score 算子迁移到 MindIE-SD Created-by: jiajin_qi Commit-by: jiajin_qi Merged-by: ascend-robot Description: Which issue(s) this PR fixes or accomplishes Fix part of #ISSUE 198 Purpose 为 incre_flash_attention 算子新增 host 侧完整 tiling 实现，支撑推理场景的 tiling 数据结构与计算流程。 主要新增内容（位于 csrc/ops/incre_flash_attention/op_host/）： tiling 数据结构定义：incre_flash_attention_tiling.h、incre_flash_attention_tiling_base.h、incre_flash_attention_tiling_struct.h，覆盖 Base / Core / SingleCore / SplitKV / InitOutput / Prefix 等参数 主 tiling 计算逻辑：incre_flash_attention_tiling.cpp，含对齐、分核、sparse 处理等基础工具 MLA（Multi-head Latent Attention）支持：incre_flash_attention_tiling_mla.h，定义 MLA 专属 Base/Core/SingleCore 参数与 AIC 核数约束 V2 版本实现：incre_flash_attention_tiling_v2.cpp、incre_flash_attention_tiling_v2.h，扩展 prefix 与 V2 tiling data tiling 校验：incre_flash_attention_tiling_check.cpp 上下文与实现细节：incre_flash_attention_tiling_context.h、incre_flash_attention_tiling_impl.h Test Plan 编译算子组件： bash build/build_ops.sh bash build/build_ascendc_ops.sh 运行 fused infer attention score UT： bash tests/ops/fused_infer_attention_score/run_fia_arch35_ut.sh 运行 Python 侧 fused infer attention score 测试： pytest tests/ops/fused_infer_attention_score/test_fused_infer_attention_score_v2.py Wan2.2 5B TI2V w8a8f8推理测试 Test Report 待补充： bash build/build_ops.sh: ok bash build/build_ascendc_ops.sh: ok bash tests/ops/fused_infer_attention_score/run_fia_arch35_ut.sh: passed pytest tests/ops/fused_infer_attention_score/test_fused_infer_attention_score_v2.py: passed Wan2.2 5B TI2V w8a8f8推理测试正常 See merge request: Ascend/MindIE-SD!436
1 个月前
incre_flash_attention_tiling_mla.h
[Feature][ops]将 fused infer attention score 算子迁移到 MindIE-SD Co-authored-by: jiajin_qi<qijiajin1@huawei.com> # message auto-generated for no-merge-commit merge: !436 merge dev into dev [Feature][ops]将 fused infer attention score 算子迁移到 MindIE-SD Created-by: jiajin_qi Commit-by: jiajin_qi Merged-by: ascend-robot Description: Which issue(s) this PR fixes or accomplishes Fix part of #ISSUE 198 Purpose 为 incre_flash_attention 算子新增 host 侧完整 tiling 实现，支撑推理场景的 tiling 数据结构与计算流程。 主要新增内容（位于 csrc/ops/incre_flash_attention/op_host/）： tiling 数据结构定义：incre_flash_attention_tiling.h、incre_flash_attention_tiling_base.h、incre_flash_attention_tiling_struct.h，覆盖 Base / Core / SingleCore / SplitKV / InitOutput / Prefix 等参数 主 tiling 计算逻辑：incre_flash_attention_tiling.cpp，含对齐、分核、sparse 处理等基础工具 MLA（Multi-head Latent Attention）支持：incre_flash_attention_tiling_mla.h，定义 MLA 专属 Base/Core/SingleCore 参数与 AIC 核数约束 V2 版本实现：incre_flash_attention_tiling_v2.cpp、incre_flash_attention_tiling_v2.h，扩展 prefix 与 V2 tiling data tiling 校验：incre_flash_attention_tiling_check.cpp 上下文与实现细节：incre_flash_attention_tiling_context.h、incre_flash_attention_tiling_impl.h Test Plan 编译算子组件： bash build/build_ops.sh bash build/build_ascendc_ops.sh 运行 fused infer attention score UT： bash tests/ops/fused_infer_attention_score/run_fia_arch35_ut.sh 运行 Python 侧 fused infer attention score 测试： pytest tests/ops/fused_infer_attention_score/test_fused_infer_attention_score_v2.py Wan2.2 5B TI2V w8a8f8推理测试 Test Report 待补充： bash build/build_ops.sh: ok bash build/build_ascendc_ops.sh: ok bash tests/ops/fused_infer_attention_score/run_fia_arch35_ut.sh: passed pytest tests/ops/fused_infer_attention_score/test_fused_infer_attention_score_v2.py: passed Wan2.2 5B TI2V w8a8f8推理测试正常 See merge request: Ascend/MindIE-SD!436
1 个月前
incre_flash_attention_tiling_struct.h
[Feature][ops]将 fused infer attention score 算子迁移到 MindIE-SD Co-authored-by: jiajin_qi<qijiajin1@huawei.com> # message auto-generated for no-merge-commit merge: !436 merge dev into dev [Feature][ops]将 fused infer attention score 算子迁移到 MindIE-SD Created-by: jiajin_qi Commit-by: jiajin_qi Merged-by: ascend-robot Description: Which issue(s) this PR fixes or accomplishes Fix part of #ISSUE 198 Purpose 为 incre_flash_attention 算子新增 host 侧完整 tiling 实现，支撑推理场景的 tiling 数据结构与计算流程。 主要新增内容（位于 csrc/ops/incre_flash_attention/op_host/）： tiling 数据结构定义：incre_flash_attention_tiling.h、incre_flash_attention_tiling_base.h、incre_flash_attention_tiling_struct.h，覆盖 Base / Core / SingleCore / SplitKV / InitOutput / Prefix 等参数 主 tiling 计算逻辑：incre_flash_attention_tiling.cpp，含对齐、分核、sparse 处理等基础工具 MLA（Multi-head Latent Attention）支持：incre_flash_attention_tiling_mla.h，定义 MLA 专属 Base/Core/SingleCore 参数与 AIC 核数约束 V2 版本实现：incre_flash_attention_tiling_v2.cpp、incre_flash_attention_tiling_v2.h，扩展 prefix 与 V2 tiling data tiling 校验：incre_flash_attention_tiling_check.cpp 上下文与实现细节：incre_flash_attention_tiling_context.h、incre_flash_attention_tiling_impl.h Test Plan 编译算子组件： bash build/build_ops.sh bash build/build_ascendc_ops.sh 运行 fused infer attention score UT： bash tests/ops/fused_infer_attention_score/run_fia_arch35_ut.sh 运行 Python 侧 fused infer attention score 测试： pytest tests/ops/fused_infer_attention_score/test_fused_infer_attention_score_v2.py Wan2.2 5B TI2V w8a8f8推理测试 Test Report 待补充： bash build/build_ops.sh: ok bash build/build_ascendc_ops.sh: ok bash tests/ops/fused_infer_attention_score/run_fia_arch35_ut.sh: passed pytest tests/ops/fused_infer_attention_score/test_fused_infer_attention_score_v2.py: passed Wan2.2 5B TI2V w8a8f8推理测试正常 See merge request: Ascend/MindIE-SD!436
1 个月前
incre_flash_attention_tiling_v2.cpp
[Feature][ops]将 fused infer attention score 算子迁移到 MindIE-SD Co-authored-by: jiajin_qi<qijiajin1@huawei.com> # message auto-generated for no-merge-commit merge: !436 merge dev into dev [Feature][ops]将 fused infer attention score 算子迁移到 MindIE-SD Created-by: jiajin_qi Commit-by: jiajin_qi Merged-by: ascend-robot Description: Which issue(s) this PR fixes or accomplishes Fix part of #ISSUE 198 Purpose 为 incre_flash_attention 算子新增 host 侧完整 tiling 实现，支撑推理场景的 tiling 数据结构与计算流程。 主要新增内容（位于 csrc/ops/incre_flash_attention/op_host/）： tiling 数据结构定义：incre_flash_attention_tiling.h、incre_flash_attention_tiling_base.h、incre_flash_attention_tiling_struct.h，覆盖 Base / Core / SingleCore / SplitKV / InitOutput / Prefix 等参数 主 tiling 计算逻辑：incre_flash_attention_tiling.cpp，含对齐、分核、sparse 处理等基础工具 MLA（Multi-head Latent Attention）支持：incre_flash_attention_tiling_mla.h，定义 MLA 专属 Base/Core/SingleCore 参数与 AIC 核数约束 V2 版本实现：incre_flash_attention_tiling_v2.cpp、incre_flash_attention_tiling_v2.h，扩展 prefix 与 V2 tiling data tiling 校验：incre_flash_attention_tiling_check.cpp 上下文与实现细节：incre_flash_attention_tiling_context.h、incre_flash_attention_tiling_impl.h Test Plan 编译算子组件： bash build/build_ops.sh bash build/build_ascendc_ops.sh 运行 fused infer attention score UT： bash tests/ops/fused_infer_attention_score/run_fia_arch35_ut.sh 运行 Python 侧 fused infer attention score 测试： pytest tests/ops/fused_infer_attention_score/test_fused_infer_attention_score_v2.py Wan2.2 5B TI2V w8a8f8推理测试 Test Report 待补充： bash build/build_ops.sh: ok bash build/build_ascendc_ops.sh: ok bash tests/ops/fused_infer_attention_score/run_fia_arch35_ut.sh: passed pytest tests/ops/fused_infer_attention_score/test_fused_infer_attention_score_v2.py: passed Wan2.2 5B TI2V w8a8f8推理测试正常 See merge request: Ascend/MindIE-SD!436
1 个月前
incre_flash_attention_tiling_v2.h
[Feature][ops]将 fused infer attention score 算子迁移到 MindIE-SD Co-authored-by: jiajin_qi<qijiajin1@huawei.com> # message auto-generated for no-merge-commit merge: !436 merge dev into dev [Feature][ops]将 fused infer attention score 算子迁移到 MindIE-SD Created-by: jiajin_qi Commit-by: jiajin_qi Merged-by: ascend-robot Description: Which issue(s) this PR fixes or accomplishes Fix part of #ISSUE 198 Purpose 为 incre_flash_attention 算子新增 host 侧完整 tiling 实现，支撑推理场景的 tiling 数据结构与计算流程。 主要新增内容（位于 csrc/ops/incre_flash_attention/op_host/）： tiling 数据结构定义：incre_flash_attention_tiling.h、incre_flash_attention_tiling_base.h、incre_flash_attention_tiling_struct.h，覆盖 Base / Core / SingleCore / SplitKV / InitOutput / Prefix 等参数 主 tiling 计算逻辑：incre_flash_attention_tiling.cpp，含对齐、分核、sparse 处理等基础工具 MLA（Multi-head Latent Attention）支持：incre_flash_attention_tiling_mla.h，定义 MLA 专属 Base/Core/SingleCore 参数与 AIC 核数约束 V2 版本实现：incre_flash_attention_tiling_v2.cpp、incre_flash_attention_tiling_v2.h，扩展 prefix 与 V2 tiling data tiling 校验：incre_flash_attention_tiling_check.cpp 上下文与实现细节：incre_flash_attention_tiling_context.h、incre_flash_attention_tiling_impl.h Test Plan 编译算子组件： bash build/build_ops.sh bash build/build_ascendc_ops.sh 运行 fused infer attention score UT： bash tests/ops/fused_infer_attention_score/run_fia_arch35_ut.sh 运行 Python 侧 fused infer attention score 测试： pytest tests/ops/fused_infer_attention_score/test_fused_infer_attention_score_v2.py Wan2.2 5B TI2V w8a8f8推理测试 Test Report 待补充： bash build/build_ops.sh: ok bash build/build_ascendc_ops.sh: ok bash tests/ops/fused_infer_attention_score/run_fia_arch35_ut.sh: passed pytest tests/ops/fused_infer_attention_score/test_fused_infer_attention_score_v2.py: passed Wan2.2 5B TI2V w8a8f8推理测试正常 See merge request: Ascend/MindIE-SD!436
1 个月前