Merged
feat(quant): add per_token_cast torch.compile support #53
daisysjAdd on 13 days ago
feat(quant): add per_token_cast torch.compile support #53
Merged
daisysjAdd on 13 days ago
daisysj
13 days ago

当前PR是否有AI参与:

[x] 否

[ ] 是
__1. AI Agent 平台:
__2. AI 模型:
__3. Prompt上下文 :

PR功能描述 / 为什么需要这个合入**:

为 per_token_cast、per_token_cast_with_sf_only 和 per_token_cast_with_precomputed_sf 添加 torch.compile 入图支持,使它们能够参与 npugraph_ex 固定 shape 推理图的捕获与重放。

适配同时覆盖自动分配输出和调用方提供 out 的路径,保持原有 eager 调用方式,确保输入及只读 scale 不被修改、输出正确复用指定内存,并能感知 clamp 配置变化。

该PR关联的issue

(格式为fixes #<issue号>, 或者resolves #<issue号>): fixes #

希望检视人员了解:

改动类型 / Change Type

测试信息 / Testing

检查清单 / Checklist

likedislike
Pull Request has been successfully merged by CANN-robot.
(Thank you for daisysj's contribution.)
Ddaisysj
13 days ago Created pull request, commit 9420f05a
CANN-robot
CANN-robotCollaborators
13 days ago Comments:

Hi @daisysj, welcome to submitting your first PR to CANN!

PR Merge Steps

1. CLA Signing

If the current PR label includes cann-cla/yes, it means you have signed the CLA and can proceed to the next step. If the label includes cann-cla/no, please sign the CLA first. If you have any questions, please refer to the FAQ.

2. CI Check

Please comment /compile to trigger the CI pipeline check. If the CI run is successful, the PR will be tagged with ci-pipeline-passed and you can proceed to the next step. If the CI run fails, the PR will be tagged with ci-pipeline-failed, please check the CI logs to fix the issues in the PR. If you have any questions, please refer to the FAQ.

3. Code Review

After CI passes, please refer to the PR Approval Progress and proactively @ the committers in the table to review the code. After approval, committers will comment /lgtm and /approve. Once the lgtm and approved labels are successfully added, the PR will be merged automatically.

likedislike
CANN-robotCANN-robotCollaborators
13 days ago Added label: cann-cla/no
CANN-robotCANN-robotCollaborators
13 days ago Added label: stat/needs-squash
CANN-robot
CANN-robotCollaborators
13 days ago Comments:

Thanks for your pull-request.
The full list of commands accepted by me can be found at here.
You can get sig-info at here.
You can self-configure the PR merge rules for this repository. For more details, please refer to Here.
For more, you also can visit HICANN.


PR Approval Progress

✅ Congratulations! All modules have met the lgtm and approve requirements.

Module Approval Details

module lgtm status approve status
repo-cann/ops-tilelang ✅ ChaoyangJi, kevin365 (2/2) ✅ kevin365 (1/1)

💡 Tip:

  • Committer can comment /approve or /lgtm
  • Commenting /approve implies both code review (lgtm) and intent to merge (approve)

CLA Signature Pass

daisysj, thanks for your pull request. All authors of the commits have signed the CLA. 👍

likedislike
84 messages are collapsed here。 See more
wangkaiCollaborators
9 days ago Comments:

/approve
/lgtm

likedislike
CANN-robotCANN-robotCollaborators
9 days ago Added label: lgtmapproved
CANN-robot
CANN-robotCollaborators
9 days ago Comments:

The MR can not be merged, because of CodeReview discussion not resolved

If you want to solve this problem, you can click here to do it in the FAQs.

likedislike
ChaoyangJiChaoyangJiCollaborators
9 days ago Resolved final issue
CANN-robotCANN-robotCollaborators
9 days ago Merged pull request