Merged
fused_causal_conv1d修改cache_indices的拦截 #10073
xiapengcheng5Add on Aug 14
fused_causal_conv1d修改cache_indices的拦截 #10073
Merged
Pull Request has been successfully merged by CANN-robot.
(Thank you for xiapengcheng5's contribution.)Aug 14 Created pull request, commit d38aeb5e
atomgit-bot
Aug 14 Comments:
Aug 14 Comments:
变更摘要
本 PR 主要调整 fused_causal_conv1d 的 host 侧 tiling 校验逻辑,围绕 cache_indices 的拦截条件进行修改:放宽 conv_states/cache_states 首维与 batch、cache_indices 总元素数之间的约束,同时在 BH tiling 中新增对权重 kernelSize_ 必须为 3 的校验,并同步更新相关算子文档。
主要改动
- 新增
kernelSize_校验(BH tiling): 在FusedCausalConv1dCutBHTiling::GetShapeInfo中新增校验,权重第 0 维kernelSize_不等于 3 时记录错误并返回ge::GRAPH_FAILED。 - 移除
conv_states与batch的约束(BH tiling): 删除FusedCausalConv1dCutBHTiling::ValidateConvStatesShape中conv_states的 shape[0] 必须大于等于batchSize_的校验。 - 移除
conv_states与cache_indices总量的约束(BH tiling): 删除FusedCausalConv1dCutBHTiling::ValidateCacheIndicesShape中conv_states的 shape[0] 必须大于等于cache_indices总元素数的校验。 - 移除
cache_states与batch的约束(BSH tiling): 删除FusedCausalConv1dCutBSHTiling::CheckCacheStatesDim中cache_states的 shape[0] 必须大于等于batch_的校验。 - 移除
cache_states与cache_indices总量的约束(BSH tiling): 删除FusedCausalConv1dCutBSHTiling::CheckCacheIndicesDim中cache_states的 shape[0] 必须大于等于cache_indices总元素数的校验。


Incorrect?
Aug 14 Added label: cann-cla/yes
CANN-robot
Aug 14 Comments:
Aug 14 Comments:
CANN-robot
Aug 14 Comments:
Aug 14 Comments:
Thanks for your pull-request.
The full list of commands accepted by me can be found at here。
You can get sig-info at here
For more, you also can visit HICANN
PR Approval Progress
✅ Congratulations! All modules have met the lgtm and approve requirements.
Module Approval Details
| module | lgtm status | approve status |
|---|---|---|
| */*/README.md | ✅ 吴瑶, 蔡雯雯, 陈娇 (3/2) | ✅ 吴瑶, 蔡雯雯 (2/1) |
| */*/docs/acl*.md | ✅ 吴瑶, 陈娇, 蔡雯雯 (3/2) | ✅ 蔡雯雯, 吴瑶 (2/1) |
| attention | ✅ yuhao_, 於欣洁 (2/2) | ✅ yuhao_, 於欣洁 (2/1) |
💡 Tip:
- Committer can comment
/approveor/lgtm- Commenting
/approveimplies both code review (lgtm) and intent to merge (approve)
CLA Signature Pass
xiapengcheng5, thanks for your pull request. All authors of the commits have signed the CLA. 👍


44 messages are collapsed here。 See more
Aug 14 Added label: approved
Aug 14 Added label: lgtm
Aug 14 Merged pull request
描述
fused_causal_conv1d修改cache_indices的拦截
关联的Issue
https://gitcode.com/cann/ops-transformer/issues/4309
测试
文档更新
attention/fused_causal_conv1d/README.md
attention/fused_causal_conv1d/docs/aclnnFusedCausalConv1d.md
attention/inplace_fused_causal_conv1d/README.md
attention/inplace_fused_causal_conv1d/docs/aclnnInplaceFusedCausalConv1d.md
类型标签