pytorch:基于昇腾NPU的PyTorch框架适配插件项目

Star851
1340
代码
代码
Issues1541
Pull Requests2229
项目讨论
Wiki
分析
Star851
1340

作为 Ascend for PyTorch 社区的核心组件，TorchNPU 是昇腾专为 PyTorch 打造的深度学习适配插件，使 PyTorch 框架能够直接调用昇腾 NPU，为开发者提供昇腾 AI 处理器的超强算力。

分支95Tags247
文件最后提交记录最后更新时间
.ci
!12588 add test/profiler Merge pull request !12588 from huangyunlong/2.4profile
2 年前
.gitee
add pull request template
4 年前
.github
!17049 TORCH MAIN SYNC : manylinux_2_28_aarch64 (cxx11_abi=1) Merge pull request !17049 from dilililiwhy/main_sync_20241115
1 年前
ci
support for 3.12 3.13 Co-authored-by: huangyunlong2022<huangyunlong4@h-partners.com> # message auto-generated for no-merge-commit merge: !26307 merge 2.8v into v2.8.0 support for 3.12 3.13 Created-by: huangyunlong2022 Commit-by: huangyunlong2022 Merged-by: ascend-robot Description: <!-- Thanks for sending a pull request! --> **What type of PR is this?** > Uncomment only one /kind <> line, hit enter to put that in a new line, and remove leading whitespaces from that line: > > /kind bug > /kind task > /kind feature **What does this PR do / why do we need it**: **Which issue(s) this PR fixes**: <!-- *Automatically closes linked issue when PR is merged. Usage: Fixes #<issue number>, or Fixes (paste link of issue). --> Fixes # **Special notes for your reviewers**: See merge request: Ascend/pytorch!26307
9 个月前
cmake
[Feature]support abi configuration for libtorch_npu.
2 年前
codegen
Support registering functions on AutogradPrivateUse1 via YAML dispatch configuration Co-authored-by: shaoyf02<shaoyifan1@huawei.com> # message auto-generated for no-merge-commit merge: merge 280_autograd into v2.8.0 Support registering functions on AutogradPrivateUse1 via YAML dispatch configuration Created-by: shaoyf Commit-by: shaoyf02 Merged-by: ascend-robot Description: <!-- Thanks for sending a pull request! --> **What type of PR is this?** > Uncomment only one /kind <> line, hit enter to put that in a new line, and remove leading whitespaces from that line: > > /kind bug > /kind task > /kind feature **What does this PR do / why do we need it**: 背景：解决高版本下默认针对没有注册autograd相关key但进行反向的api的告警 方案：通过提供支持添加dispatch字段注册到autogradprivateuse1上，避免出现告警： 例如： - func: npu_moe_token_unpermute_with_routing_map(Tensor permuted_tokens, Tensor sorted_indices, int[] restore_shape, *, Tensor? probs=None, Tensor? routing_map=None, bool drop_and_pad=False) -> Tensor op_api: [v2.1, newest] dispatch: AutogradPrivateUse1: npu_moe_token_unpermute_with_routing_map 具体样例： 添加dispatch前存在告警，添加后无 [W919 12:36:08.793215810 compiler_depend.ts:67] Warning: npu::npu_moe_token_unpermute_with_routing_map: an autograd kernel was not registered to the Autograd key(s) but we are trying to backprop through it. This may lead to silently incorrect behavior. This behavior is deprecated and will be removed in a future version of PyTorch. If your operator is differentiable, please ensure you have registered an autograd kernel to the correct Autograd key (e.g. DispatchKey::Autograd, DispatchKey::CompositeImplicitAutograd). If your operator is not differentiable, or to squash this warning and use the previous behavior, please register torch::CppFunction::makeFallthrough() to DispatchKey::Autograd. (function operator()) **Which issue(s) this PR fixes**: <!-- *Automatically closes linked issue when PR is merged. Usage: Fixes #<issue number>, or Fixes (paste link of issue). --> Fixes # **Special notes for your reviewers**: See merge request: Ascend/pytorch!25031
11 个月前
docs
!6640 Add api info of pytorch ascend adapter Merge pull request !6640 from 李佳伟/master
2 年前
examples
!15927 delete cpp_extensions examples Merge pull request !15927 from 詹昊/master
1 年前
figures
!23099 add cve info Merge pull request !23099 from 王超/v2.8.0_cve
1 年前
test
[AI辅助研发]pyton dt测试用例生成 clean code问题处理
8 个月前
third_party
Update op_plugin commit id Co-authored-by: pta-robot<pta_robot@163.com> # message auto-generated for no-merge-commit merge: !27362 merge v2.8.0 into v2.8.0 Update op_plugin commit id Created-by: pta-robot Commit-by: pta-robot Merged-by: ascend-robot Description: Commited by @pta-robot at 2025-12-01 23:01:32. See merge request: Ascend/pytorch!27362
8 个月前
tools
!22007 [master] fix typo for flight_recorder Merge pull request !22007 from yinqian/master
1 年前
torch_npu
profiler: set the msmonitor status to uninitialized when the polling subprocess ends Co-authored-by: z30043230<zhaiyibo@h-partners.com> # message auto-generated for no-merge-commit merge: !27273 merge v2.8.0 into v2.8.0 profiler: set the msmonitor status to uninitialized when the polling subprocess ends Created-by: zyb_230 Commit-by: z30043230 Merged-by: ascend-robot Description: <!-- Thanks for sending a pull request! --> **What type of PR is this?** > Uncomment only one /kind <> line, hit enter to put that in a new line, and remove leading whitespaces from that line: > > /kind bug > /kind task > /kind feature /kind bug **What does this PR do / why do we need it**: 之前修改上报方式为实际业务进程上报状态，而不是监控子进程，然后在最后进程结束时finalize的时候会重置状态，这个重置状态是所有进程都会调用的，不对，应该只需要重置一次，不然有的进程提前结束（即使是非业务进程）就会提前把状态置为Uninitialized,导致后面所有命令无效 **Which issue(s) this PR fixes**: <!-- *Automatically closes linked issue when PR is merged. Usage: Fixes #<issue number>, or Fixes (paste link of issue). --> Fixes # ![image.png](https://raw.gitcode.com/user-images/assets/7404318/d5cdcb2c-fac8-47ce-a44e-34093d61ed8d/image.png 'image.png') ![image.png](https://raw.gitcode.com/user-images/assets/7404318/14ad3d1b-23f7-4403-b65c-9632d67ccbd8/image.png 'image.png') **Special notes for your reviewers**: See merge request: Ascend/pytorch!27273
8 个月前
.gitignore
!20745 ignore diff in _op_plugin_docs.py Merge pull request !20745 from 姜怡文/main_ig
1 年前
.gitmodules
Update torchair (GitCode) Co-authored-by: dilililiwhy<why.wuhuanyu@huawei.com> # message auto-generated for no-merge-commit merge: !26139 merge update_torchair_280 into v2.8.0 Update torchair (GitCode) Created-by: dilililiwhy Commit-by: dilililiwhy Merged-by: ascend-robot Description: <!-- Thanks for sending a pull request! --> **What type of PR is this?** > Uncomment only one /kind <> line, hit enter to put that in a new line, and remove leading whitespaces from that line: > > /kind bug > /kind task > /kind feature **What does this PR do / why do we need it**: **Which issue(s) this PR fixes**: <!-- *Automatically closes linked issue when PR is merged. Usage: Fixes #<issue number>, or Fixes (paste link of issue). --> Fixes # **Special notes for your reviewers**: See merge request: Ascend/pytorch!26139
9 个月前
CMakeLists.txt
add aot inductor for v2.8.0 Co-authored-by: Zichun Ye<zichun.ye@huawei.com> Co-authored-by: kkjocker<hexuanyu1@huawei.com> # message auto-generated for no-merge-commit merge: !25446 merge aoti_280 into v2.8.0 add aot inductor for v2.8.0 Created-by: kkjocker Commit-by: kkjocker;Zichun Ye Merged-by: ascend-robot Description: <!-- Thanks for sending a pull request! --> **What type of PR is this?** > Uncomment only one /kind <> line, hit enter to put that in a new line, and remove leading whitespaces from that line: > > /kind bug > /kind task > /kind feature **What does this PR do / why do we need it**: **Which issue(s) this PR fixes**: <!-- *Automatically closes linked issue when PR is merged. Usage: Fixes #<issue number>, or Fixes (paste link of issue). --> Fixes # **Special notes for your reviewers**: See merge request: Ascend/pytorch!25446
9 个月前
CONTRIBUTING.zh.md
Update URL (gitcode) Co-authored-by: dilililiwhy<why.wuhuanyu@huawei.com> # message auto-generated for no-merge-commit merge: merge update_url_280 into v2.8.0 Update URL (gitcode) Created-by: dilililiwhy Commit-by: dilililiwhy Merged-by: ascend-robot Description: <!-- Thanks for sending a pull request! --> **What type of PR is this?** > Uncomment only one /kind <> line, hit enter to put that in a new line, and remove leading whitespaces from that line: > > /kind bug > /kind task > /kind feature **What does this PR do / why do we need it**: **Which issue(s) this PR fixes**: <!-- *Automatically closes linked issue when PR is merged. Usage: Fixes #<issue number>, or Fixes (paste link of issue). --> Fixes # **Special notes for your reviewers**: See merge request: Ascend/pytorch!24862
11 个月前
LICENSE
!11194 update license and open_source_software Merge pull request !11194 from 郭光浩/master
2 年前
OWNERS
Update URL (gitcode) Co-authored-by: dilililiwhy<why.wuhuanyu@huawei.com> # message auto-generated for no-merge-commit merge: merge update_url_280 into v2.8.0 Update URL (gitcode) Created-by: dilililiwhy Commit-by: dilililiwhy Merged-by: ascend-robot Description: <!-- Thanks for sending a pull request! --> **What type of PR is this?** > Uncomment only one /kind <> line, hit enter to put that in a new line, and remove leading whitespaces from that line: > > /kind bug > /kind task > /kind feature **What does this PR do / why do we need it**: **Which issue(s) this PR fixes**: <!-- *Automatically closes linked issue when PR is merged. Usage: Fixes #<issue number>, or Fixes (paste link of issue). --> Fixes # **Special notes for your reviewers**: See merge request: Ascend/pytorch!24862
11 个月前
README.md
update readme Co-authored-by: guoguanghao<guoguanghao@huawei.com> # message auto-generated for no-merge-commit merge: !25925 merge v2.8.0 into v2.8.0 update readme Created-by: guoguanghao Commit-by: guoguanghao Merged-by: ascend-robot Description: <!-- Thanks for sending a pull request! --> **What type of PR is this?** > Uncomment only one /kind <> line, hit enter to put that in a new line, and remove leading whitespaces from that line: > > /kind bug > /kind task > /kind feature **What does this PR do / why do we need it**: **Which issue(s) this PR fixes**: <!-- *Automatically closes linked issue when PR is merged. Usage: Fixes #<issue number>, or Fixes (paste link of issue). --> Fixes # **Special notes for your reviewers**: See merge request: Ascend/pytorch!25925
10 个月前
README.zh.md
update readme Co-authored-by: guoguanghao<guoguanghao@huawei.com> # message auto-generated for no-merge-commit merge: !25925 merge v2.8.0 into v2.8.0 update readme Created-by: guoguanghao Commit-by: guoguanghao Merged-by: ascend-robot Description: <!-- Thanks for sending a pull request! --> **What type of PR is this?** > Uncomment only one /kind <> line, hit enter to put that in a new line, and remove leading whitespaces from that line: > > /kind bug > /kind task > /kind feature **What does this PR do / why do we need it**: **Which issue(s) this PR fixes**: <!-- *Automatically closes linked issue when PR is merged. Usage: Fixes #<issue number>, or Fixes (paste link of issue). --> Fixes # **Special notes for your reviewers**: See merge request: Ascend/pytorch!25925
10 个月前
SECURITYNOTE.md
add submodule torch mlir Co-authored-by: lijintao<lijintao14@huawei.com> # message auto-generated for no-merge-commit merge: !25899 merge 14-add-submodule-torch-mlir into v2.8.0 add submodule torch mlir Created-by: gent1e Commit-by: lijintao Merged-by: ascend-robot Description: <!-- Thanks for sending a pull request! --> **What type of PR is this?** > Uncomment only one /kind <> line, hit enter to put that in a new line, and remove leading whitespaces from that line: > > /kind bug > /kind task > /kind feature **What does this PR do / why do we need it**: **Which issue(s) this PR fixes**: <!-- *Automatically closes linked issue when PR is merged. Usage: Fixes #<issue number>, or Fixes (paste link of issue). --> Fixes # **Special notes for your reviewers**: See merge request: Ascend/pytorch!25899
10 个月前
Third_Party_Open_Source_Software_Notice
update readme Co-authored-by: guoguanghao<guoguanghao@huawei.com> # message auto-generated for no-merge-commit merge: !25925 merge v2.8.0 into v2.8.0 update readme Created-by: guoguanghao Commit-by: guoguanghao Merged-by: ascend-robot Description: <!-- Thanks for sending a pull request! --> **What type of PR is this?** > Uncomment only one /kind <> line, hit enter to put that in a new line, and remove leading whitespaces from that line: > > /kind bug > /kind task > /kind feature **What does this PR do / why do we need it**: **Which issue(s) this PR fixes**: <!-- *Automatically closes linked issue when PR is merged. Usage: Fixes #<issue number>, or Fixes (paste link of issue). --> Fixes # **Special notes for your reviewers**: See merge request: Ascend/pytorch!25925
10 个月前
build_libtorch_npu.py
add aot inductor for v2.8.0 Co-authored-by: Zichun Ye<zichun.ye@huawei.com> Co-authored-by: kkjocker<hexuanyu1@huawei.com> # message auto-generated for no-merge-commit merge: !25446 merge aoti_280 into v2.8.0 add aot inductor for v2.8.0 Created-by: kkjocker Commit-by: kkjocker;Zichun Ye Merged-by: ascend-robot Description: <!-- Thanks for sending a pull request! --> **What type of PR is this?** > Uncomment only one /kind <> line, hit enter to put that in a new line, and remove leading whitespaces from that line: > > /kind bug > /kind task > /kind feature **What does this PR do / why do we need it**: **Which issue(s) this PR fixes**: <!-- *Automatically closes linked issue when PR is merged. Usage: Fixes #<issue number>, or Fixes (paste link of issue). --> Fixes # **Special notes for your reviewers**: See merge request: Ascend/pytorch!25446
9 个月前
env.sh
!22658 cleancode Merge pull request !22658 from SCh-zx/clm
1 年前
generate_code.sh
!9507 Add test cases and fix possible problems with cp in some environments Merge pull request !9507 from shaoyf/doc/master
2 年前
requirements.txt
!23609 Release 2.8.0rc1 Merge pull request !23609 from dilililiwhy/280_release_issue
1 年前
setup.cfg
Update URL (gitcode) Co-authored-by: dilililiwhy<why.wuhuanyu@huawei.com> # message auto-generated for no-merge-commit merge: merge update_url_280 into v2.8.0 Update URL (gitcode) Created-by: dilililiwhy Commit-by: dilililiwhy Merged-by: ascend-robot Description: <!-- Thanks for sending a pull request! --> **What type of PR is this?** > Uncomment only one /kind <> line, hit enter to put that in a new line, and remove leading whitespaces from that line: > > /kind bug > /kind task > /kind feature **What does this PR do / why do we need it**: **Which issue(s) this PR fixes**: <!-- *Automatically closes linked issue when PR is merged. Usage: Fixes #<issue number>, or Fixes (paste link of issue). --> Fixes # **Special notes for your reviewers**: See merge request: Ascend/pytorch!24862
11 个月前
setup.py
add aot inductor for v2.8.0 Co-authored-by: Zichun Ye<zichun.ye@huawei.com> Co-authored-by: kkjocker<hexuanyu1@huawei.com> # message auto-generated for no-merge-commit merge: !25446 merge aoti_280 into v2.8.0 add aot inductor for v2.8.0 Created-by: kkjocker Commit-by: kkjocker;Zichun Ye Merged-by: ascend-robot Description: <!-- Thanks for sending a pull request! --> **What type of PR is this?** > Uncomment only one /kind <> line, hit enter to put that in a new line, and remove leading whitespaces from that line: > > /kind bug > /kind task > /kind feature **What does this PR do / why do we need it**: **Which issue(s) this PR fixes**: <!-- *Automatically closes linked issue when PR is merged. Usage: Fixes #<issue number>, or Fixes (paste link of issue). --> Fixes # **Special notes for your reviewers**: See merge request: Ascend/pytorch!25446
9 个月前
version.txt
update version to 2.8.0.post3 Co-authored-by: shaoyf02<shaoyifan1@huawei.com> # message auto-generated for no-merge-commit merge: !26540 merge cherry-pick-mr-26514-1763035625908-auto into v2.8.0 update version to 2.8.0.post3 Created-by: shaoyf Commit-by: shaoyf02 Merged-by: ascend-robot Description: <!-- Thanks for sending a pull request! --> **What type of PR is this?** > Uncomment only one /kind <> line, hit enter to put that in a new line, and remove leading whitespaces from that line: > > /kind bug > /kind task > /kind feature **What does this PR do / why do we need it**: **Which issue(s) this PR fixes**: <!-- *Automatically closes linked issue when PR is merged. Usage: Fixes #<issue number>, or Fixes (paste link of issue). --> Fixes # **Special notes for your reviewers**: See merge request: Ascend/pytorch!26540
9 个月前

Ascend Extension for PyTorch插件

简介

本项目开发了名为torch_npu的Ascend Extension for PyTorch插件，使昇腾NPU可以适配PyTorch框架，为使用PyTorch框架的开发者提供昇腾AI处理器的超强算力。

昇腾为基于华为昇腾处理器和软件的行业应用及服务提供全栈AI计算基础设施。您可以通过访问昇腾社区，了解关于昇腾的更多信息。

版本说明

PyTorch与Python版本配套表

PyTorch版本 Python版本
PyTorch1.11.0 Python3.7.x(>=3.7.5), Python3.8.x, Python3.9.x, Python3.10.x
PyTorch2.1.0 Python3.8.x, Python3.9.x, Python3.10.x, Python 3.11.x
PyTorch2.2.0 Python3.8.x, Python3.9.x, Python3.10.x
PyTorch2.3.1 Python3.8.x, Python3.9.x, Python3.10.x, Python 3.11.x
PyTorch2.4.0 Python3.8.x, Python3.9.x, Python3.10.x, Python 3.11.x
PyTorch2.5.1 Python3.9.x, Python3.10.x, Python 3.11.x
PyTorch2.6.0 Python3.9.x, Python3.10.x, Python 3.11.x
PyTorch2.7.1 Python3.9.x, Python3.10.x, Python 3.11.x
PyTorch2.8.0 Python3.9.x, Python3.10.x, Python 3.11.x

昇腾辅助软件

Ascend Extension for PyTorch的分支名称采用{PyTorch版本}-{昇腾版本}命名规则，前者为Ascend Extension for PyTorch匹配的PyTorch版本，后者为Ascend Extension for PyTorch版本号，详细匹配如下：

CANN版本 支持的PyTorch版本 支持的Extension版本 GitCode分支
CANN 8.3.RC1 2.8.0 2.8.0 v2.8.0-7.2.0
2.7.1 2.7.1 v2.7.1-7.2.0
2.6.0 2.6.0.post3 v2.6.0-7.2.0
2.1.0 2.1.0.post17 v2.1.0-7.2.0
CANN 8.2.RC1 2.6.0 2.6.0 v2.6.0-7.1.0
2.5.1 2.5.1.post1 v2.5.1-7.1.0
2.1.0 2.1.0.post13 v2.1.0-7.1.0
CANN 8.1.RC1 2.5.1 2.5.1 v2.5.1-7.0.0
2.4.0 2.4.0.post4 v2.4.0-7.0.0
2.3.1 2.3.1.post6 v2.3.1-7.0.0
2.1.0 2.1.0.post12 v2.1.0-7.0.0
CANN 8.0.0 2.4.0 2.4.0.post2 v2.4.0-6.0.0
2.3.1 2.3.1.post4 v2.3.1-6.0.0
2.1.0 2.1.0.post10 v2.1.0-6.0.0
CANN 8.0.RC3 2.4.0 2.4.0 v2.4.0-6.0.rc3
2.3.1 2.3.1.post2 v2.3.1-6.0.rc3
2.1.0 2.1.0.post8 v2.1.0-6.0.rc3
CANN 8.0.RC2 2.3.1 2.3.1 v2.3.1-6.0.rc2
2.2.0 2.2.0.post2 v2.2.0-6.0.rc2
2.1.0 2.1.0.post6 v2.1.0-6.0.rc2
1.11.0 1.11.0.post14 v1.11.0-6.0.rc2
CANN 8.0.RC1 2.2.0 2.2.0 v2.2.0-6.0.rc1
2.1.0 2.1.0.post4 v2.1.0-6.0.rc1
1.11.0 1.11.0.post11 v1.11.0-6.0.rc1
CANN 7.0.0 2.1.0 2.1.0 v2.1.0-5.0.0
2.0.1 2.0.1.post1 v2.0.1-5.0.0
1.11.0 1.11.0.post8 v1.11.0-5.0.0
CANN 7.0.RC1 2.1.0 2.1.0.rc1 v2.1.0-5.0.rc3
2.0.1 2.0.1 v2.0.1-5.0.rc3
1.11.0 1.11.0.post4 v1.11.0-5.0.rc3
CANN 6.3.RC3.1 1.11.0 1.11.0.post3 v1.11.0-5.0.rc2.2
CANN 6.3.RC3 1.11.0 1.11.0.post2 v1.11.0-5.0.rc2.1
CANN 6.3.RC2 2.0.1 2.0.1.rc1 v2.0.1-5.0.rc2
1.11.0 1.11.0.post1 v1.11.0-5.0.rc2
1.8.1 1.8.1.post2 v1.8.1-5.0.rc2
CANN 6.3.RC1 1.11.0 1.11.0 v1.11.0-5.0.rc1
1.8.1 1.8.1.post1 v1.8.1-5.0.rc1
CANN 6.0.1 1.5.0 1.5.0.post8 v1.5.0-3.0.0
1.8.1 1.8.1 v1.8.1-3.0.0
1.11.0 1.11.0.rc2（beta) v1.11.0-3.0.0
CANN 6.0.RC1 1.5.0 1.5.0.post7 v1.5.0-3.0.rc3
1.8.1 1.8.1.rc3 v1.8.1-3.0.rc3
1.11.0 1.11.0.rc1（beta) v1.11.0-3.0.rc3
CANN 5.1.RC2 1.5.0 1.5.0.post6 v1.5.0-3.0.rc2
1.8.1 1.8.1.rc2 v1.8.1-3.0.rc2
CANN 5.1.RC1 1.5.0 1.5.0.post5 v1.5.0-3.0.rc1
1.8.1 1.8.1.rc1 v1.8.1-3.0.rc1
CANN 5.0.4 1.5.0 1.5.0.post4 2.0.4.tr5
CANN 5.0.3 1.8.1 1.5.0.post3 2.0.3.tr5
CANN 5.0.2 1.5.0 1.5.0.post2 2.0.2.tr5

快速入门

基于CNN模型识别手写数字的脚本，对在GPU上训练的该脚本代码进行修改，使其可以迁移到昇腾NPU上进行训练。具体操作请参见Ascend Extension for PyTorch 快速入门。

环境部署

使用二进制文件进行安装

我们为用户提供可以快速安装torch_npu的whl安装包。在安装torch_npu之前，您需要先安装CANN软件。昇腾辅助软件中有更多关于CANN的版本信息。请参考CANN安装指南获取CANN安装包。

  1. 安装PyTorch

    通过 pip 安装 PyTorch。

    aarch64:

    pip3 install torch==2.8.0

    x86:

    pip3 install torch==2.8.0+cpu  --index-url https://download.pytorch.org/whl/cpu

    若使用pip命令安装失败，请使用下载链接或进入PyTorch官方网站进行查询下载对应版本。

    架构 Python版本 下载链接
    x86 Python3.9 下载链接
    x86 Python3.10 下载链接
    x86 Python3.11 下载链接
    aarch64 Python3.9 下载链接
    aarch64 Python3.10 下载链接
    aarch64 Python3.11 下载链接

  2. 安装torch_npu依赖

    运行以下命令安装依赖。

    pip3 install pyyaml
pip3 install setuptools

  3. 安装torch_npu

    pip3 install torch-npu==2.8.0

    如需要保存安装日志，可在pip3 install命令后面加上参数 --log <PATH>，并对您指定的目录<PATH>做好权限管控。

使用源代码进行安装

某些特殊场景下，用户可能需要自行编译torch_npu。可以根据昇腾辅助软件表和PyTorch与Python版本配套表选择合适的分支。

推荐使用Docker镜像编译torch_npu，可以通过以下步骤获取（建议只挂载工作路径，并避开系统路径，以降低安全风险）, 生成的.whl文件路径为./dist/。

须知：
如果不使用镜像，编译时请注意gcc版本遵循约束：ARM与X86架构下推荐使用gcc 13.3。

  1. 克隆torch_npu代码仓

    git clone https://gitcode.com/ascend/pytorch.git -b v2.8.0-7.2.0 --depth 1

  2. 构建镜像

    cd pytorch/ci/docker/{arch} # {arch} for X86 or ARM
docker build -t manylinux-builder:v1 .

  3. 进入Docker容器

    docker run -it -v /{code_path}/pytorch:/home/pytorch manylinux-builder:v1 bash
# {code_path} is the torch_npu source code path

  4. 编译torch_npu

    以Python 3.9 为例。

    cd /home/pytorch
bash ci/build.sh --python=3.9

提示

如果想使用新的C++ ABI编译，请首先运行如下命令，此时推荐和社区torch包相同的编译环境：glibc 2.28, gcc 13.3.1。

export _GLIBCXX_USE_CXX11_ABI=1

同时，我们支持使用如下变量配置-fabi-version，要求和社区torch包ABI版本一致。

export _ABI_VERSION=18

安装后验证

前提

运行以下命令初始化CANN环境变量。

# Default path, change it if needed.
source /usr/local/Ascend/ascend-toolkit/set_env.sh

快速验证

可以通过以下样例快速体验昇腾NPU。

import torch
- import torch_npu # torch_npu2.5.1及以后版本可以不用手动导包

x = torch.randn(2, 2).npu()
y = torch.randn(2, 2).npu()
z = x.mm(y)

print(z)

卸载

Pytorch框架训练环境的卸载可以参考昇腾官方文档。

torch_npu的卸载只需执行命令：

pip3 uninstall torch_npu

如需要保存卸载日志，可在pip3 uninstall命令后面加上参数 --log <PATH>，并对您指定的目录<PATH>做好权限管控。

硬件配套

昇腾训练设备包含以下型号，都可作为PyTorch模型的训练环境。

产品系列 产品型号
Atlas 训练系列产品 Atlas 800 训练服务器（型号：9000）
Atlas 800 训练服务器（型号：9010）
Atlas 900 PoD（型号：9000）
Atlas 300T 训练卡（型号：9000）
Atlas 300T Pro 训练卡（型号：9000）
Atlas A2 训练系列产品 Atlas 800T A2 训练服务器
Atlas 900 A2 PoD 集群基础单元
Atlas 200T A2 Box16 异构子框
Atlas A3 训练系列产品 Atlas 800T A3 训练服务器
Atlas 900 A3 SuperPoD 超节点

昇腾推理设备包含以下型号，都可作为大模型的推理环境。

产品系列 产品型号
Atlas 800I A2推理产品 Atlas 800I A2 推理服务器

建议与交流

欢迎大家为社区做贡献。如果有任何疑问或建议，请提交GitCode Issues，我们会尽快回复。感谢您的支持。

分支维护策略

Ascend Extension for PyTorch版本分支的维护阶段如下：

状态 时间 说明
计划 1—3 个月 计划特性
开发 6—12 个月 开发新特性并修复问题，定期发布新版本。针对不同的PyTorch版本采取不同的策略，常规分支的开发周期分别为6个月，长期支持分支的开发周期为12个月
维护 1年/3.5年 常规分支维护1年,长期支持分支维护3.5年。对重大BUG进行修复，不合入新特性，并视BUG的影响发布补丁版本
生命周期终止（EOL） N/A 分支不再接受任何修改

PyTorch版本维护策略

PyTorch版本 维护策略 当前状态 发布时间 后续状态 EOL日期
2.8.0 常规分支 开发 2025/10/15 预计2026/03/15起进入维护状态 -
2.7.1 长期分支 开发 2025/10/15 预计2026/10/15起进入维护状态 -
2.6.0 常规分支 开发 2025/07/25 预计2026/01/25起进入维护状态 -
2.5.1 常规分支 维护 2024/11/08 预计2026/08/08起进入无维护状态 -
2.4.0 常规分支 维护 2024/10/15 预计2026/06/15起进入无维护状态 -
2.3.1 常规分支 维护 2024/06/06 预计2026/06/07起进入无维护状态
2.2.0 常规分支 EOL 2024/04/01 2025/10/14
2.1.0 长期支持 开发 2023/10/15 预计2025/09/15起进入维护状态
2.0.1 常规分支 EOL 2023/7/19 2024/3/14
1.11.0 长期支持 维护 2023/4/19 预计2025/09/10起进入无维护状态
1.8.1 长期支持 EOL 2022/4/10 2023/4/10
1.5.0 长期支持 EOL 2021/7/29 2022/7/29

安全声明

Ascend Extension for PyTorch插件 安全声明

参考文档

有关安装指南、模型迁移和训练/推理教程和API列表等更多详细信息，请参考昇腾社区Ascend Extension for PyTorch。

文档名称 文档链接
软件安装指南 参考链接
网络模型迁移和训练 参考链接
算子适配 参考链接
PyTorch原生接口清单 参考链接
Ascend Extension for PyTorch自定义API参考 参考链接

许可证

Ascend Extension for PyTorch插件使用BSD许可证。详见LICENSE文件。

项目介绍

作为 Ascend for PyTorch 社区的核心组件，TorchNPU 是昇腾专为 PyTorch 打造的深度学习适配插件，使 PyTorch 框架能够直接调用昇腾 NPU，为开发者提供昇腾 AI 处理器的超强算力。

Others Python8.57 K提交数pytorch深度学习
定制我的领域
README
规则集