| 文件 | 最后提交记录 | 最后更新时间 |
|---|---|---|
Add npu_all_gather_base_mm testcase Co-authored-by: wang-guangbin<wgb_strive@163.com> # message auto-generated for no-merge-commit merge: !3339 merge allgather into master Add npu_all_gather_base_mm testcase Created-by: wang-guangbin Commit-by: wang-guangbin Merged-by: ascend-robot Description: <!-- Thanks for sending a pull request! --> **What type of PR is this?** > Uncomment only one /kind <> line, hit enter to put that in a new line, and remove leading whitespaces from that line: > > /kind bug > /kind task > /kind feature **What does this PR do / why do we need it**: **Special notes for your reviewers**: 本地验证通过:  See merge request: Ascend/op-plugin!3339 | 1 年前 | |
| 1 年前 | ||
| 1 年前 | ||
OP hash supports thread-level Co-authored-by: wang-guangbin<wgb_strive@163.com> # message auto-generated for no-merge-commit merge: !3867 merge 7.3.0 into 7.3.0 OP hash supports thread-level Created-by: wang-guangbin Commit-by: wang-guangbin Merged-by: ascend-robot Description: <!-- Thanks for sending a pull request! --> **What type of PR is this?** > Uncomment only one /kind <> line, hit enter to put that in a new line, and remove leading whitespaces from that line: > > /kind bug > /kind task > /kind feature **What does this PR do / why do we need it**: op仓的atb op复用采用线程级单例。 当前op仓的atb缓存设计为进程级别的单列,多线程场景存在op复用冲突,atb底层的setup和exector不支持相同的op在不同线程。 **Special notes for your reviewers**: See merge request: Ascend/op-plugin!3867 | 9 个月前 | |
| 1 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
OP hash supports thread-level Co-authored-by: wang-guangbin<wgb_strive@163.com> # message auto-generated for no-merge-commit merge: !3867 merge 7.3.0 into 7.3.0 OP hash supports thread-level Created-by: wang-guangbin Commit-by: wang-guangbin Merged-by: ascend-robot Description: <!-- Thanks for sending a pull request! --> **What type of PR is this?** > Uncomment only one /kind <> line, hit enter to put that in a new line, and remove leading whitespaces from that line: > > /kind bug > /kind task > /kind feature **What does this PR do / why do we need it**: op仓的atb op复用采用线程级单例。 当前op仓的atb缓存设计为进程级别的单列,多线程场景存在op复用冲突,atb底层的setup和exector不支持相同的op在不同线程。 **Special notes for your reviewers**: See merge request: Ascend/op-plugin!3867 | 9 个月前 | |
OP hash supports thread-level Co-authored-by: wang-guangbin<wgb_strive@163.com> # message auto-generated for no-merge-commit merge: !3867 merge 7.3.0 into 7.3.0 OP hash supports thread-level Created-by: wang-guangbin Commit-by: wang-guangbin Merged-by: ascend-robot Description: <!-- Thanks for sending a pull request! --> **What type of PR is this?** > Uncomment only one /kind <> line, hit enter to put that in a new line, and remove leading whitespaces from that line: > > /kind bug > /kind task > /kind feature **What does this PR do / why do we need it**: op仓的atb op复用采用线程级单例。 当前op仓的atb缓存设计为进程级别的单列,多线程场景存在op复用冲突,atb底层的setup和exector不支持相同的op在不同线程。 **Special notes for your reviewers**: See merge request: Ascend/op-plugin!3867 | 9 个月前 | |
| 1 年前 | ||
PA surpport aclgraph Co-authored-by: wang-guangbin<wgb_strive@163.com> # message auto-generated for no-merge-commit merge: merge atb into master PA surpport aclgraph Created-by: wang-guangbin Commit-by: wang-guangbin Merged-by: ascend-robot Description: <!-- Thanks for sending a pull request! --> **What type of PR is this?** > Uncomment only one /kind <> line, hit enter to put that in a new line, and remove leading whitespaces from that line: > > /kind bug > /kind task > /kind feature **What does this PR do / why do we need it**: 1. ATB,C++接入方式下发方式新增workpspace支持外部传入,以支持aclgraph的update特性。 2. 新增特性使能atb pa接口,支持aclgraph **Special notes for your reviewers**: See merge request: Ascend/op-plugin!3204 | 1 年前 | |
| 1 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
PA surpport aclgraph Co-authored-by: wang-guangbin<wgb_strive@163.com> # message auto-generated for no-merge-commit merge: merge atb into master PA surpport aclgraph Created-by: wang-guangbin Commit-by: wang-guangbin Merged-by: ascend-robot Description: <!-- Thanks for sending a pull request! --> **What type of PR is this?** > Uncomment only one /kind <> line, hit enter to put that in a new line, and remove leading whitespaces from that line: > > /kind bug > /kind task > /kind feature **What does this PR do / why do we need it**: 1. ATB,C++接入方式下发方式新增workpspace支持外部传入,以支持aclgraph的update特性。 2. 新增特性使能atb pa接口,支持aclgraph **Special notes for your reviewers**: See merge request: Ascend/op-plugin!3204 | 1 年前 | |
Fix potential integer overflow issues in npu_paged_cache_load Co-authored-by: wang-guangbin<wgb_strive@163.com> # message auto-generated for no-merge-commit merge: !3413 merge bugfix into master Fix potential integer overflow issues in npu_paged_cache_load Created-by: wang-guangbin Commit-by: wang-guangbin Merged-by: ascend-robot Description: <!-- Thanks for sending a pull request! --> **What type of PR is this?** > Uncomment only one /kind <> line, hit enter to put that in a new line, and remove leading whitespaces from that line: > > /kind bug > /kind task > /kind feature **What does this PR do / why do we need it**: **Special notes for your reviewers**: See merge request: Ascend/op-plugin!3413 | 11 个月前 | |
| 1 年前 | ||
OP hash supports thread-level Co-authored-by: wang-guangbin<wgb_strive@163.com> # message auto-generated for no-merge-commit merge: !3867 merge 7.3.0 into 7.3.0 OP hash supports thread-level Created-by: wang-guangbin Commit-by: wang-guangbin Merged-by: ascend-robot Description: <!-- Thanks for sending a pull request! --> **What type of PR is this?** > Uncomment only one /kind <> line, hit enter to put that in a new line, and remove leading whitespaces from that line: > > /kind bug > /kind task > /kind feature **What does this PR do / why do we need it**: op仓的atb op复用采用线程级单例。 当前op仓的atb缓存设计为进程级别的单列,多线程场景存在op复用冲突,atb底层的setup和exector不支持相同的op在不同线程。 **Special notes for your reviewers**: See merge request: Ascend/op-plugin!3867 | 9 个月前 | |
OP hash supports thread-level Co-authored-by: wang-guangbin<wgb_strive@163.com> # message auto-generated for no-merge-commit merge: !3867 merge 7.3.0 into 7.3.0 OP hash supports thread-level Created-by: wang-guangbin Commit-by: wang-guangbin Merged-by: ascend-robot Description: <!-- Thanks for sending a pull request! --> **What type of PR is this?** > Uncomment only one /kind <> line, hit enter to put that in a new line, and remove leading whitespaces from that line: > > /kind bug > /kind task > /kind feature **What does this PR do / why do we need it**: op仓的atb op复用采用线程级单例。 当前op仓的atb缓存设计为进程级别的单列,多线程场景存在op复用冲突,atb底层的setup和exector不支持相同的op在不同线程。 **Special notes for your reviewers**: See merge request: Ascend/op-plugin!3867 | 9 个月前 | |
| 1 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
适配支持两类算子:ffn_worker_scheduler_/ffn_worker_scheduler、 attention_worker_scheduler_/attention_worker_scheduler Co-authored-by: panweicheng<panweicheng@huawei.com> # message auto-generated for no-merge-commit merge: !3397 merge master into master 适配支持两类算子:ffn_worker_scheduler_/ffn_worker_scheduler、 attention_worker_scheduler_/attention_worker_scheduler Created-by: pwc10490 Commit-by: panweicheng Merged-by: ascend-robot Description: <!-- Thanks for sending a pull request! --> **What type of PR is this?** > /kind feature **What does this PR do / why do we need it**: 适配支持两类算子: torch_npu.attention_worker_scheduler torch_npu.attention_worker_scheduler_(inplace算子) torch_npu.ffn_worker_scheduler torch_npu.ffn_worker_scheduler_(inplace算子) **Special notes for your reviewers**: See merge request: Ascend/op-plugin!3397 | 11 个月前 | |
barrier Co-authored-by: davon<liuwenda4@huawei.com> # message auto-generated for no-merge-commit merge: !3372 merge master into master barrier Created-by: Davon14272 Commit-by: davon Merged-by: ascend-robot Description: <!-- Thanks for sending a pull request! --> **What type of PR is this?** > Uncomment only one /kind <> line, hit enter to put that in a new line, and remove leading whitespaces from that line: > > /kind feature **What does this PR do / why do we need it**: _npu_distribute_barrier adds two optional inputs: time_out and elastic_info **Special notes for your reviewers**: See merge request: Ascend/op-plugin!3372 | 11 个月前 | |
适配支持两类算子:ffn_worker_scheduler_/ffn_worker_scheduler、 attention_worker_scheduler_/attention_worker_scheduler Co-authored-by: panweicheng<panweicheng@huawei.com> # message auto-generated for no-merge-commit merge: !3397 merge master into master 适配支持两类算子:ffn_worker_scheduler_/ffn_worker_scheduler、 attention_worker_scheduler_/attention_worker_scheduler Created-by: pwc10490 Commit-by: panweicheng Merged-by: ascend-robot Description: <!-- Thanks for sending a pull request! --> **What type of PR is this?** > /kind feature **What does this PR do / why do we need it**: 适配支持两类算子: torch_npu.attention_worker_scheduler torch_npu.attention_worker_scheduler_(inplace算子) torch_npu.ffn_worker_scheduler torch_npu.ffn_worker_scheduler_(inplace算子) **Special notes for your reviewers**: See merge request: Ascend/op-plugin!3397 | 11 个月前 | |
| 1 年前 | ||
| 1 年前 | ||
| 2 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 2 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
mlaprologV3 update from master to 7.3.0 Co-authored-by: Le_666<yuanle2@huawei.com> # message auto-generated for no-merge-commit merge: !3706 merge 7.3.0 into 7.3.0 mlaprologV3 update from master to 7.3.0 Created-by: Le_666 Commit-by: Le_666 Merged-by: ascend-robot Description: <!-- Thanks for sending a pull request! --> **What type of PR is this?** > Uncomment only one /kind <> line, hit enter to put that in a new line, and remove leading whitespaces from that line: > > /kind bug > /kind task > /kind feature **What does this PR do / why do we need it**: 主线对MlaPrologV3算子接口信息进行了修改,现已修改完毕,主线运行正常。目前根据需求将主线的稳定代码,同步至商分分支 **Special notes for your reviewers**: See merge request: Ascend/op-plugin!3706 | 10 个月前 | |
| 1 年前 | ||
| 1 年前 | ||
npu_mm_reduce_scatter_base support quant and comm_mode aiv Co-authored-by: wang-guangbin<wgb_strive@163.com> # message auto-generated for no-merge-commit merge: merge mm_rs into master npu_mm_reduce_scatter_base support quant and comm_mode aiv Created-by: wang-guangbin Commit-by: wang-guangbin Merged-by: ascend-robot Description: <!-- Thanks for sending a pull request! --> **What type of PR is this?** > Uncomment only one /kind <> line, hit enter to put that in a new line, and remove leading whitespaces from that line: > > /kind bug > /kind task > /kind feature **What does this PR do / why do we need it**: **Special notes for your reviewers**: 本地验证通过  See merge request: Ascend/op-plugin!3194 | 1 年前 | |
| 1 年前 | ||
mc2 dispatch&combine v2 add aclnnV4 for 7.3.0 Co-authored-by: yyoean<1114146082@qq.com> # message auto-generated for no-merge-commit merge: !3539 merge 7.3.0 into 7.3.0 mc2 dispatch&combine v2 add aclnnV4 for 7.3.0 Created-by: yyoean Commit-by: yyoean Merged-by: ascend-robot Description: <!-- Thanks for sending a pull request! --> **What type of PR is this?** > Uncomment only one /kind <> line, hit enter to put that in a new line, and remove leading whitespaces from that line: > > /kind bug > /kind task > /kind feature **What does this PR do / why do we need it**: **Special notes for your reviewers**: https://gitcode.com/Ascend/op-plugin/issues/25 See merge request: Ascend/op-plugin!3539 | 10 个月前 | |
| 1 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
mc2 dispatch&combine v2 add aclnnV4 for 7.3.0 Co-authored-by: yyoean<1114146082@qq.com> # message auto-generated for no-merge-commit merge: !3539 merge 7.3.0 into 7.3.0 mc2 dispatch&combine v2 add aclnnV4 for 7.3.0 Created-by: yyoean Commit-by: yyoean Merged-by: ascend-robot Description: <!-- Thanks for sending a pull request! --> **What type of PR is this?** > Uncomment only one /kind <> line, hit enter to put that in a new line, and remove leading whitespaces from that line: > > /kind bug > /kind task > /kind feature **What does this PR do / why do we need it**: **Special notes for your reviewers**: https://gitcode.com/Ascend/op-plugin/issues/25 See merge request: Ascend/op-plugin!3539 | 10 个月前 | |
| 1 年前 | ||
| 1 年前 | ||
| 2 年前 | ||
| 1 年前 | ||
| 2 年前 | ||
| 1 年前 | ||
Add handling logic for y2Out shape. Co-authored-by: 花无懿<liuxuehui4@huawei.com> # message auto-generated for no-merge-commit merge: !3771 merge 7.3.0 into 7.3.0 Add handling logic for y2Out shape. Created-by: huawuyi Commit-by: 花无懿 Merged-by: ascend-robot Description: <!-- Thanks for sending a pull request! --> **What type of PR is this?** > Uncomment only one /kind <> line, hit enter to put that in a new line, and remove leading whitespaces from that line: > > /kind bug > /kind task > /kind feature **What does this PR do / why do we need it**: **Special notes for your reviewers**: See merge request: Ascend/op-plugin!3771 | 10 个月前 | |
npu_add_rms_norm_quant_v2 Co-authored-by: LG<luguang6@huawei.com> # message auto-generated for no-merge-commit merge: merge add_rms_norm_quant_v2 into master npu_add_rms_norm_quant_v2 Created-by: Lu_G Commit-by: LG Merged-by: ascend-robot Description: <!-- Thanks for sending a pull request! --> **What type of PR is this?** > Uncomment only one /kind <> line, hit enter to put that in a new line, and remove leading whitespaces from that line: > /kind feature **What does this PR do / why do we need it**: 修改npu_add_rms_norm_quant接口,增加beta入参,接入aclnnAddRMSNormQuantV2算子 **Special notes for your reviewers**: See merge request: Ascend/op-plugin!3172 | 1 年前 | |
| 1 年前 | ||
| 1 年前 | ||
support tnd format Co-authored-by: ghost<zhengwenbang@huawei.com> # message auto-generated for no-merge-commit merge: !3355 merge master into master support tnd format Created-by: weixin_44564637 Commit-by: ghost Merged-by: ascend-robot Description: <!-- Thanks for sending a pull request! --> **What type of PR is this?** > Uncomment only one /kind <> line, hit enter to put that in a new line, and remove leading whitespaces from that line: > > /kind bug > /kind task > /kind feature **What does this PR do / why do we need it**: **Special notes for your reviewers**: See merge request: Ascend/op-plugin!3355 | 1 年前 | |
Add npu_attention_update interface Co-authored-by: huawuyi<liuxuehui4@huawei.com> # message auto-generated for no-merge-commit merge: merge master into master Add npu_attention_update interface Created-by: huawuyi Commit-by: huawuyi Merged-by: ascend-robot Description: <!-- Thanks for sending a pull request! --> **What type of PR is this?** > Uncomment only one /kind <> line, hit enter to put that in a new line, and remove leading whitespaces from that line: > > /kind bug > /kind task > /kind feature **What does this PR do / why do we need it**: **Special notes for your reviewers**: See merge request: Ascend/op-plugin!3166 | 1 年前 | |
Add AttentionWorkerCombine PTA Co-authored-by: weixin_36491311<lingwanxin@huawei.com> # message auto-generated for no-merge-commit merge: merge master into master Add AttentionWorkerCombine PTA Created-by: weixin_36491311 Commit-by: weixin_36491311 Merged-by: ascend-robot Description: <!-- Thanks for sending a pull request! --> **What type of PR is this?** > Uncomment only one /kind <> line, hit enter to put that in a new line, and remove leading whitespaces from that line: > > /kind bug > /kind task > /kind feature **What does this PR do / why do we need it**: **Special notes for your reviewers**: See merge request: Ascend/op-plugin!3176 | 1 年前 | |
| 1 年前 | ||
| 1 年前 | ||
add npu_clipped_swiglu Co-authored-by: jzj007<jiangzhijie9@huawei.com> # message auto-generated for no-merge-commit merge: !3527 merge 7.3.0CS into 7.3.0 add npu_clipped_swiglu Created-by: jzj007 Commit-by: jzj007 Merged-by: ascend-robot Description: <!-- Thanks for sending a pull request! --> **What type of PR is this?** > Uncomment only one /kind <> line, hit enter to put that in a new line, and remove leading whitespaces from that line: > > /kind feature **What does this PR do / why do we need it**: 新增npu_clipped_swiglu接口 **Special notes for your reviewers**: See merge request: Ascend/op-plugin!3527 | 11 个月前 | |
| 1 年前 | ||
| 1 年前 | ||
| 2 年前 | ||
| 2 年前 | ||
| 1 年前 | ||
| 2 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
add FfnWorkerBatching Co-authored-by: 安冬<andong2@huawei.com> # message auto-generated for no-merge-commit merge: merge master into master add FfnWorkerBatching Created-by: andong_hw Commit-by: 安冬 Merged-by: ascend-robot Description: <!-- Thanks for sending a pull request! --> **What type of PR is this?** > Uncomment only one /kind <> line, hit enter to put that in a new line, and remove leading whitespaces from that line: > > /kind bug > /kind task > /kind feature **What does this PR do / why do we need it**: **Special notes for your reviewers**: See merge request: Ascend/op-plugin!3179 | 1 年前 | |
remove keep_prob cast Co-authored-by: caihualilili<liangfuzhan@h-partners.com> # message auto-generated for no-merge-commit merge: merge keep_prob_remove_cast into master remove keep_prob cast Created-by: caihualilili Commit-by: caihualilili Merged-by: ascend-robot Description: <!-- Thanks for sending a pull request! --> **What type of PR is this?** > Uncomment only one /kind <> line, hit enter to put that in a new line, and remove leading whitespaces from that line: > > /kind bug > /kind task > /kind feature **What does this PR do / why do we need it**: **Special notes for your reviewers**: See merge request: Ascend/op-plugin!3200 | 1 年前 | |
remove keep_prob cast Co-authored-by: caihualilili<liangfuzhan@h-partners.com> # message auto-generated for no-merge-commit merge: merge keep_prob_remove_cast into master remove keep_prob cast Created-by: caihualilili Commit-by: caihualilili Merged-by: ascend-robot Description: <!-- Thanks for sending a pull request! --> **What type of PR is this?** > Uncomment only one /kind <> line, hit enter to put that in a new line, and remove leading whitespaces from that line: > > /kind bug > /kind task > /kind feature **What does this PR do / why do we need it**: **Special notes for your reviewers**: See merge request: Ascend/op-plugin!3200 | 1 年前 | |
[feat]npu_fusion_attention_v2 adapt for fav5 Co-authored-by: zqwenn<zhangqiongwen@huawei.com> # message auto-generated for no-merge-commit merge: !3522 merge 7.3.0_fav5_adpt into 7.3.0 [feat]npu_fusion_attention_v2 adapt for fav5 Created-by: zqwenn Commit-by: zqwenn Merged-by: ascend-robot Description: <!-- Thanks for sending a pull request! --> **What type of PR is this?** > Uncomment only one /kind <> line, hit enter to put that in a new line, and remove leading whitespaces from that line: > > /kind bug > /kind task > /kind feature **What does this PR do / why do we need it**: **Special notes for your reviewers**: npu_fusion_attention_v2新增softmax_layout和sink入参 新增场景测试用例下一个pr提交 See merge request: Ascend/op-plugin!3522 | 11 个月前 | |
remove keep_prob cast Co-authored-by: caihualilili<liangfuzhan@h-partners.com> # message auto-generated for no-merge-commit merge: merge keep_prob_remove_cast into master remove keep_prob cast Created-by: caihualilili Commit-by: caihualilili Merged-by: ascend-robot Description: <!-- Thanks for sending a pull request! --> **What type of PR is this?** > Uncomment only one /kind <> line, hit enter to put that in a new line, and remove leading whitespaces from that line: > > /kind bug > /kind task > /kind feature **What does this PR do / why do we need it**: **Special notes for your reviewers**: See merge request: Ascend/op-plugin!3200 | 1 年前 | |
PA模式QKV D不等长场景下InferShape适配 Co-authored-by: cgagaboy<zengxiansheng1@huawei.com> # message auto-generated for no-merge-commit merge: !3346 merge master into master PA模式QKV D不等长场景下InferShape适配 Created-by: cgagaboy Commit-by: cgagaboy Merged-by: ascend-robot Description: <!-- Thanks for sending a pull request! --> **What type of PR is this?** > Uncomment only one /kind <> line, hit enter to put that in a new line, and remove leading whitespaces from that line: > > /kind bug > /kind task > /kind feature **What does this PR do / why do we need it**: **Special notes for your reviewers**: See merge request: Ascend/op-plugin!3346 | 1 年前 | |
| 1 年前 | ||
support npu_fused_infer_attention_score_v2 tiling update in NPUGraph Co-authored-by: fengye<vinsmoke.feng@huawei.com> # message auto-generated for no-merge-commit merge: !3925 merge 7.3.0 into 7.3.0 support npu_fused_infer_attention_score_v2 tiling update in NPUGraph Created-by: fengye0903 Commit-by: fengye Merged-by: ascend-robot Description: <!-- Thanks for sending a pull request! --> **What type of PR is this?** > Uncomment only one /kind <> line, hit enter to put that in a new line, and remove leading whitespaces from that line: > > /kind bug > /kind task > /kind feature **What does this PR do / why do we need it**: #@unittest.skip( # "Skipping due to outdated CANN version; please update CANN to the latest version and remove this skip") #@SupportedDevices(['Ascend910B']) def test_npu_fused_infer_attention_score_v2_ifa_return_lse_return_softmax_lse_true_with_workspace(self, device="npu"): query = torch.randn(1, 32, 1, 128, dtype=torch.float16).npu() key = torch.randn(1, 32, 2048, 128, dtype=torch.float16).npu() value = torch.randn(1, 32, 2048, 128, dtype=torch.float16).npu() head_dim = 128 return_softmax_lse = True supported_output, lse_out = self.supported_op_exec(query, key, value, head_dim, 1, 32, 1, return_softmax_lse) custom_output = self.custom_op_exec_with_workspace(query, key, value, head_dim, True) attention_output = custom_output[0] softmaxlse_output = custom_output[1] if __name__ == "__main__": run_tests() [root@devserver-hps-feb34b1c-00033 f00941739]# python ./op-plugin/test/test_custom_ops/test_npu_fused_infer_attention_score_v2_with_workspace.py ss. ---------------------------------------------------------------------- Ran 3 tests in 2.006s OK (skipped=2) **Special notes for your reviewers**: See merge request: Ascend/op-plugin!3925 | 9 个月前 | |
add _npu_fused_infer_attention_score_infer_output Co-authored-by: yanpengquan<yanpengquan@huawei.com> # message auto-generated for no-merge-commit merge: !3930 merge 7.3.0_fused into 7.3.0 add _npu_fused_infer_attention_score_infer_output Created-by: wangchao430 Commit-by: yanpengquan Merged-by: ascend-robot Description: <!-- Thanks for sending a pull request! --> **What type of PR is this?** > Uncomment only one /kind <> line, hit enter to put that in a new line, and remove leading whitespaces from that line: > > /kind bug > /kind task > /kind feature **What does this PR do / why do we need it**: **Special notes for your reviewers**:  See merge request: Ascend/op-plugin!3930 | 9 个月前 | |
| 1 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
Added support for the npu_gelu_mul operator. Co-authored-by: shi-jiaxin9<shijiaxin10@h-partners.com> # message auto-generated for no-merge-commit merge: !3418 merge master into master Added support for the npu_gelu_mul operator. Created-by: shi-jiaxin9 Commit-by: shi-jiaxin9 Merged-by: ascend-robot Description: <!-- Thanks for sending a pull request! --> **What type of PR is this?** > Uncomment only one /kind <> line, hit enter to put that in a new line, and remove leading whitespaces from that line: > > /kind feature **What does this PR do / why do we need it**: Added support for the npu_gelu_mul operator. **Special notes for your reviewers**: See merge request: Ascend/op-plugin!3418 | 11 个月前 | |
| 1 年前 | ||
| 1 年前 | ||
| 2 年前 | ||
npu_quantize接口input数据格式支持NZ Co-authored-by: wkp<1289706727@qq.com> # message auto-generated for no-merge-commit merge: merge master-quantize into master npu_quantize接口input数据格式支持NZ Created-by: kunpengW Commit-by: wkp Merged-by: ascend-robot Description: <!-- Thanks for sending a pull request! --> **What type of PR is this?** > Uncomment only one /kind <> line, hit enter to put that in a new line, and remove leading whitespaces from that line: > > /kind bug > /kind task > /kind feature **What does this PR do / why do we need it**: **Special notes for your reviewers**:  See merge request: Ascend/op-plugin!3219 | 1 年前 | |
update meta func Co-authored-by: Zichun Ye<zichun.ye@huawei.com> # message auto-generated for no-merge-commit merge: !3791 merge meta_update_730 into 7.3.0 update meta func Created-by: zichun_ye Commit-by: Zichun Ye Merged-by: ascend-robot Description: <!-- Thanks for sending a pull request! --> **What type of PR is this?** > Uncomment only one /kind <> line, hit enter to put that in a new line, and remove leading whitespaces from that line: > > /kind bug > /kind task > /kind feature **What does this PR do / why do we need it**: **Special notes for your reviewers**: See merge request: Ascend/op-plugin!3791 | 10 个月前 | |
GMMFR adds support for cumsum in groulist and none option in shareInput. Co-authored-by: lilening<lilening@huawei.com> # message auto-generated for no-merge-commit merge: !3581 merge 7.3.0 into 7.3.0 GMMFR adds support for cumsum in groulist and none option in shareInput. Created-by: lilening Commit-by: lilening Merged-by: ascend-robot Description: <!-- Thanks for sending a pull request! --> **What type of PR is this?** > Uncomment only one /kind <> line, hit enter to put that in a new line, and remove leading whitespaces from that line: > > /kind feature **What does this PR do / why do we need it**: GMMFR adds support for cumsum in groulist and none option in shareInput. **Special notes for your reviewers**: See merge request: Ascend/op-plugin!3581 | 10 个月前 | |
| 1 年前 | ||
create pta of gmm_swiglu_v2. Co-authored-by: liuyan121<liuyan171@huawei.com> # message auto-generated for no-merge-commit merge: !3369 merge master into master create pta of gmm_swiglu_v2. Created-by: liuyan121 Commit-by: liuyan121 Merged-by: ascend-robot Description: <!-- Thanks for sending a pull request! --> **What type of PR is this?** > Uncomment only one /kind <> line, hit enter to put that in a new line, and remove leading whitespaces from that line: > > /kind bug > /kind task > /kind feature **What does this PR do / why do we need it**: **Special notes for your reviewers**: See merge request: Ascend/op-plugin!3369 | 11 个月前 | |
| 1 年前 | ||
新增算子LI\QLI\SFA\QSFA Co-authored-by: zzzyh22<zhangyaohui22@huawei.com> # message auto-generated for no-merge-commit merge: !3521 merge 7.3.0 into 7.3.0 新增算子LI\QLI\SFA\QSFA Created-by: zzzyh22 Commit-by: zzzyh22 Merged-by: ascend-robot Description: <!-- Thanks for sending a pull request! --> **What type of PR is this?** > Uncomment only one /kind <> line, hit enter to put that in a new line, and remove leading whitespaces from that line: > /kind bug > /kind task > >kind feature **What does this PR do / why do we need it**: 根据需求新增LI\QLI\SFA\QSFA四个算子,其中 SFA算子通过“只计算关键部分”大幅减少计算量,优化算子性能。 QSFA在SFA的基础上支持了Per-Token-Head-Tile-128量化输入。 LI算子基于一系列操作得到每一个 token 对应的 Top-k个位置。 LIQ在LI的基础上支持了Per-Token-Head量化输入。 **Special notes for your reviewers**: See merge request: Ascend/op-plugin!3521 | 10 个月前 | |
add kv_rms_norm_rope_cache v2 Co-authored-by: 15084323657<xulin91@huawei.com> # message auto-generated for no-merge-commit merge: !3528 merge KvRmsNormRopeCacheV2 into 7.3.0 add kv_rms_norm_rope_cache v2 Created-by: Alen2434 Commit-by: 15084323657 Merged-by: ascend-robot Description: 算子新增v2功能实现: kv_rms_norm_rope_cache_支持kv分离(新增可选输入tensor v)和ROPE(RMS(Dk))计算 tiling,kernel侧,增加非对称量化和Norm下量化功能。 实现输入kv N维度扩展 <!-- Thanks for sending a pull request! --> **What type of PR is this?** > Uncomment only one /kind <> line, hit enter to put that in a new line, and remove leading whitespaces from that line: > > /kind bug > /kind task > /kind feature **What does this PR do / why do we need it**: **Special notes for your reviewers**: See merge request: Ascend/op-plugin!3528 | 11 个月前 | |
| 2 年前 | ||
新增算子LI\QLI\SFA\QSFA Co-authored-by: zzzyh22<zhangyaohui22@huawei.com> # message auto-generated for no-merge-commit merge: !3521 merge 7.3.0 into 7.3.0 新增算子LI\QLI\SFA\QSFA Created-by: zzzyh22 Commit-by: zzzyh22 Merged-by: ascend-robot Description: <!-- Thanks for sending a pull request! --> **What type of PR is this?** > Uncomment only one /kind <> line, hit enter to put that in a new line, and remove leading whitespaces from that line: > /kind bug > /kind task > >kind feature **What does this PR do / why do we need it**: 根据需求新增LI\QLI\SFA\QSFA四个算子,其中 SFA算子通过“只计算关键部分”大幅减少计算量,优化算子性能。 QSFA在SFA的基础上支持了Per-Token-Head-Tile-128量化输入。 LI算子基于一系列操作得到每一个 token 对应的 Top-k个位置。 LIQ在LI的基础上支持了Per-Token-Head量化输入。 **Special notes for your reviewers**: See merge request: Ascend/op-plugin!3521 | 10 个月前 | |
| 2 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 2 年前 | ||
| 1 年前 | ||
special case divert to moe init routing V2 Co-authored-by: yaolu_happy<yaolu15@huawei.com> # message auto-generated for no-merge-commit merge: merge moe_init_routing_v3 into master special case divert to moe init routing V2 Created-by: yaolu_happy Commit-by: yaolu_happy Merged-by: ascend-robot Description: <!-- Thanks for sending a pull request! --> **What type of PR is this?** > Uncomment only one /kind <> line, hit enter to put that in a new line, and remove leading whitespaces from that line: > > /kind bug > /kind task > /kind feature **What does this PR do / why do we need it**: **Special notes for your reviewers**: See merge request: Ascend/op-plugin!3227 | 1 年前 | |
| 1 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
新增算子LI\QLI\SFA\QSFA Co-authored-by: zzzyh22<zhangyaohui22@huawei.com> # message auto-generated for no-merge-commit merge: !3521 merge 7.3.0 into 7.3.0 新增算子LI\QLI\SFA\QSFA Created-by: zzzyh22 Commit-by: zzzyh22 Merged-by: ascend-robot Description: <!-- Thanks for sending a pull request! --> **What type of PR is this?** > Uncomment only one /kind <> line, hit enter to put that in a new line, and remove leading whitespaces from that line: > /kind bug > /kind task > >kind feature **What does this PR do / why do we need it**: 根据需求新增LI\QLI\SFA\QSFA四个算子,其中 SFA算子通过“只计算关键部分”大幅减少计算量,优化算子性能。 QSFA在SFA的基础上支持了Per-Token-Head-Tile-128量化输入。 LI算子基于一系列操作得到每一个 token 对应的 Top-k个位置。 LIQ在LI的基础上支持了Per-Token-Head量化输入。 **Special notes for your reviewers**: See merge request: Ascend/op-plugin!3521 | 10 个月前 | |
[master] aclnnQuantMatmulV5 W4A4 support for PerGroup quantization Co-authored-by: Slightwind<caoyi31@huawei.com> # message auto-generated for no-merge-commit merge: !3314 merge master_w4a4_pergroup into master [master] aclnnQuantMatmulV5 W4A4 support for PerGroup quantization Created-by: Slightwind Commit-by: Slightwind Merged-by: ascend-robot Description: * 新增了 npu_quant_matmul接口对W4A4 PerGroup场景的支持,底层调用aclnnQuantMatmulV5算子。 See merge request: Ascend/op-plugin!3314 | 1 年前 | |
| 1 年前 | ||
| 2 年前 | ||
npu_quantize接口input数据格式支持NZ Co-authored-by: wkp<1289706727@qq.com> # message auto-generated for no-merge-commit merge: merge master-quantize into master npu_quantize接口input数据格式支持NZ Created-by: kunpengW Commit-by: wkp Merged-by: ascend-robot Description: <!-- Thanks for sending a pull request! --> **What type of PR is this?** > Uncomment only one /kind <> line, hit enter to put that in a new line, and remove leading whitespaces from that line: > > /kind bug > /kind task > /kind feature **What does this PR do / why do we need it**: **Special notes for your reviewers**:  See merge request: Ascend/op-plugin!3219 | 1 年前 | |
Add recurrent_gated_delta_rule Co-authored-by: NeverLCY<liuchunyuan@huawei.com> # message auto-generated for no-merge-commit merge: !3602 merge RGDR_7.3.0 into 7.3.0 Add recurrent_gated_delta_rule Created-by: NeverLCY Commit-by: NeverLCY Merged-by: ascend-robot Description: <!-- Thanks for sending a pull request! --> **What type of PR is this?** > Uncomment only one /kind <> line, hit enter to put that in a new line, and remove leading whitespaces from that line: > > /kind bug > /kind task > /kind feature **What does this PR do / why do we need it**: **Special notes for your reviewers**: See merge request: Ascend/op-plugin!3602 | 10 个月前 | |
| 2 年前 | ||
| 1 年前 | ||
add npu_rms_norm_quant interface again Co-authored-by: lihui488<lihui488@huawei.com> # message auto-generated for no-merge-commit merge: merge develop into master add npu_rms_norm_quant interface again Created-by: lihui488 Commit-by: lihui488 Merged-by: ascend-robot Description: <!-- Thanks for sending a pull request! --> **What type of PR is this?** > Uncomment only one /kind <> line, hit enter to put that in a new line, and remove leading whitespaces from that line: > > /kind bug > /kind task > /kind feature **What does this PR do / why do we need it**: **Special notes for your reviewers**: See merge request: Ascend/op-plugin!3214 | 1 年前 | |
Added support for three-dimensional TND in both forward and reverse inputs of aclnnRotaryPositionEmbedding. Co-authored-by: shi-jiaxin9<shijiaxin10@h-partners.com> # message auto-generated for no-merge-commit merge: !3550 merge 7.3.0 into 7.3.0 Added support for three-dimensional TND in both forward and reverse inputs of aclnnRotaryPositionEmbedding. Created-by: shi-jiaxin9 Commit-by: shi-jiaxin9 Merged-by: ascend-robot Description: <!-- Thanks for sending a pull request! --> **What type of PR is this?** > Uncomment only one /kind <> line, hit enter to put that in a new line, and remove leading whitespaces from that line: > > /kind feature **What does this PR do / why do we need it**: Added support for three-dimensional TND in both forward and reverse inputs of aclnnRotaryPositionEmbedding. **Special notes for your reviewers**: See merge request: Ascend/op-plugin!3550 | 10 个月前 | |
Added support for three-dimensional TND in both forward and reverse inputs of aclnnRotaryPositionEmbedding. Co-authored-by: shi-jiaxin9<shijiaxin10@h-partners.com> # message auto-generated for no-merge-commit merge: !3550 merge 7.3.0 into 7.3.0 Added support for three-dimensional TND in both forward and reverse inputs of aclnnRotaryPositionEmbedding. Created-by: shi-jiaxin9 Commit-by: shi-jiaxin9 Merged-by: ascend-robot Description: <!-- Thanks for sending a pull request! --> **What type of PR is this?** > Uncomment only one /kind <> line, hit enter to put that in a new line, and remove leading whitespaces from that line: > > /kind feature **What does this PR do / why do we need it**: Added support for three-dimensional TND in both forward and reverse inputs of aclnnRotaryPositionEmbedding. **Special notes for your reviewers**: See merge request: Ascend/op-plugin!3550 | 10 个月前 | |
| 1 年前 | ||
add npu_sim_exponential_ Co-authored-by: liangsongwei<liangsongwei@huawei.com> # message auto-generated for no-merge-commit merge: !3623 merge 7.3.0 into 7.3.0 add npu_sim_exponential_ Created-by: liangsongwei Commit-by: liangsongwei Merged-by: ascend-robot Description: <!-- Thanks for sending a pull request! --> **What type of PR is this?** > Uncomment only one /kind <> line, hit enter to put that in a new line, and remove leading whitespaces from that line: > > /kind bug > /kind task > /kind feature **What does this PR do / why do we need it**: **Special notes for your reviewers**: See merge request: Ascend/op-plugin!3623 | 10 个月前 | |
Modify SFA documentation/Supplement use cases where sparse_size is 0 Co-authored-by: zzzyh22<zhangyaohui22@huawei.com> # message auto-generated for no-merge-commit merge: !3762 merge 7.3.0 into 7.3.0 Modify SFA documentation/Supplement use cases where sparse_size is 0 Created-by: zzzyh22 Commit-by: zzzyh22 Merged-by: ascend-robot Description: <!-- Thanks for sending a pull request! --> **What type of PR is this?** > Uncomment only one /kind <> line, hit enter to put that in a new line, and remove leading whitespaces from that line: > > kind bug > /kind task > /kind feature **What does this PR do / why do we need it**: Supplement the parameter description of the SFA operator, adding explanations for attention_mode and sparse_block_size; add test cases for SFA anomaly interception. **Special notes for your reviewers**: See merge request: Ascend/op-plugin!3762 | 10 个月前 | |
| 1 年前 | ||
| 1 年前 | ||
add torch_npu.npu_swiglu_quant api, based on aclnnSwiGluQuantV2 Co-authored-by: zhaoyu20121997<nanzhaogang@qq.com> # message auto-generated for no-merge-commit merge: merge swiglu_pr into master add torch_npu.npu_swiglu_quant api, based on aclnnSwiGluQuantV2 Created-by: zhaoyu20121997 Commit-by: zhaoyu20121997 Merged-by: ascend-robot Description: <!-- Thanks for sending a pull request! --> **What type of PR is this?** > Uncomment only one /kind <> line, hit enter to put that in a new line, and remove leading whitespaces from that line: > /kind feature **What does this PR do / why do we need it**: 新增torch_npu.npu_swiglu_quant接口,接入aclnnSwiGluQuantV2算子 **Special notes for your reviewers**: 接口说明请参考提交的文件docs/context/torch_npu-npu_swiglu_quant.md See merge request: Ascend/op-plugin!3167 | 1 年前 | |
Modify the Added support for scenarios where p or k is set to None in npu_top_k_top_p. Co-authored-by: shi-jiaxin9<shijiaxin10@h-partners.com> # message auto-generated for no-merge-commit merge: !3344 merge master into master Modify the Added support for scenarios where p or k is set to None in npu_top_k_top_p. Created-by: shi-jiaxin9 Commit-by: shi-jiaxin9 Merged-by: ascend-robot Description: **What type of PR is this?** > Uncomment only one /kind <> line, hit enter to put that in a new line, and remove leading whitespaces from that line: > > /kind feature **What does this PR do / why do we need it**: Modify the Added support for scenarios where p or k is set to None in npu_top_k_top_p. **Special notes for your reviewers**: See merge request: Ascend/op-plugin!3344 | 1 年前 | |
| 1 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 2 年前 | ||
| 2 年前 | ||
| 2 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
Fix the documentation and UT scripts for the TopKtopPSample operator Co-authored-by: liubo<liubo483@huawei.com> # message auto-generated for no-merge-commit merge: merge master into master Fix the documentation and UT scripts for the TopKtopPSample operator Created-by: sptlb68 Commit-by: liubo Merged-by: ascend-robot Description: <!-- Thanks for sending a pull request! --> **What type of PR is this?** > Uncomment only one /kind <> line, hit enter to put that in a new line, and remove leading whitespaces from that line: > > /kind bug **What does this PR do / why do we need it**: pta脚本计算分支判断条件修改,md文档格式调整,与aclnn对齐 **Special notes for your reviewers**: See merge request: Ascend/op-plugin!3170 | 1 年前 | |
| 1 年前 | ||
| 1 年前 |
| 文件 | 最后提交记录 | 最后更新时间 |
|---|---|---|
| 1 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 9 个月前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 9 个月前 | ||
| 9 个月前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 11 个月前 | ||
| 1 年前 | ||
| 9 个月前 | ||
| 9 个月前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 11 个月前 | ||
| 11 个月前 | ||
| 11 个月前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 2 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 2 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 10 个月前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 10 个月前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 10 个月前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 2 年前 | ||
| 1 年前 | ||
| 2 年前 | ||
| 1 年前 | ||
| 10 个月前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 11 个月前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 2 年前 | ||
| 2 年前 | ||
| 1 年前 | ||
| 2 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 11 个月前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 9 个月前 | ||
| 9 个月前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 11 个月前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 2 年前 | ||
| 1 年前 | ||
| 10 个月前 | ||
| 10 个月前 | ||
| 1 年前 | ||
| 11 个月前 | ||
| 1 年前 | ||
| 10 个月前 | ||
| 11 个月前 | ||
| 2 年前 | ||
| 10 个月前 | ||
| 2 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 2 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 10 个月前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 2 年前 | ||
| 1 年前 | ||
| 10 个月前 | ||
| 2 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 10 个月前 | ||
| 10 个月前 | ||
| 1 年前 | ||
| 10 个月前 | ||
| 10 个月前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 2 年前 | ||
| 2 年前 | ||
| 2 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 1 年前 |