PyPTO（发音: pai p-t-o）：Parallel Tensor/Tile Operation编程范式。

文件	最后提交记录	最后更新时间
.agents	feat(skills): Add ErrorCode Check in op develop skills Co-authored-by: xuzhenghao8<xuzhenghao8@huawei.com> # message auto-generated for no-merge-commit merge: !2155 merge master into master feat(skills): Add ErrorCode Check in op develop skills Created-by: xuzhenghao8 Commit-by: xuzhenghao8 Merged-by: cann-robot Description: Add ErrorCode Check in op develop skills See merge request: cann/pypto!2155	5 个月前
.gitcode	refactor(all): Remove trailing whitespace Co-authored-by: tsungl4<lidongsheng4@huawei.com> # message auto-generated for no-merge-commit merge: !2188 merge pre-commit into master refactor(all): Remove trailing whitespace Created-by: tsungl4 Commit-by: tsungl4 Merged-by: cann-robot Description: Introduce pre-commit tools, and remove trailing white space with default plugin Related Issue: #1017 See merge request: cann/pypto!2188	5 个月前
.opencode	refactor(agents): Refactor code merge agent to read spec docs and self-check proposals Co-authored-by: wangzheng97<wangzheng97@hisilicon.com> # message auto-generated for no-merge-commit merge: !2163 merge refactor-code-merge-agent into master refactor(agents): Refactor code merge agent to read spec docs and self-check proposals Created-by: wangzheng97 Commit-by: wangzheng97 Merged-by: cann-robot Description: refactor(agents): Refactor code merge agent to read spec docs and self-check proposals The code merge agent previously generated commit/issue/PR proposals without reading spec documents or performing compliance self-checks, which could lead to non-conforming proposals. Additionally, the commit message regex in pr-fixer error-handling allowed ci/build/chore tags that are not permitted by pr-spec.md. Changes: - Fix commit message regex in pr-fixer error-handling.md to align with pr-spec.md (remove ci/build/chore) - Refactor code merge agent workflow: renumber stages (0→1, 1→2, etc.) - Add stage 3 "Generate proposals and self-check" to read spec docs before generating proposals - Streamline document structure, remove redundant responsibility boundary table Related Issues: #994 See merge request: cann/pypto!2163	5 个月前
cmake	fix(lcov): Add support for lcov 2.3.2 Co-authored-by: DCGDDD<yangxu14@huawei.com> # message auto-generated for no-merge-commit merge: !1986 merge master into master fix(lcov): Add support for lcov 2.3.2 Created-by: DCGDDD Commit-by: DCGDDD Merged-by: cann-robot Description: fix(lcov): Add support for lcov 2.3.2 See merge request: cann/pypto!1986	5 个月前
docs	docs(distributed): Add api documentation for distributed Co-authored-by: mengziyu<mengziyu1@huawei.com> # message auto-generated for no-merge-commit merge: !1648 merge master into master docs(distributed): Add api documentation for distributed Created-by: mengziyu Commit-by: mengziyu Merged-by: cann-robot Description: 描述：增加distributed相关api文档 See merge request: cann/pypto!1648	5 个月前
examples	fix(operator): Remove redundant comments Co-authored-by: sunhaoxuan2024<sunhaoxuan3@h-partners.com> # message auto-generated for no-merge-commit merge: !2180 merge master into master fix(operator): Remove redundant comments Created-by: sunhaoxuan2024 Commit-by: sunhaoxuan2024 Merged-by: cann-robot Description: Remove redundant comments Related Issue: #1000 See merge request: cann/pypto!2180	5 个月前
framework	Add aigcode moe dispatch/combine forward-backward kernels	4 个月前
models	Update flash attention training path and docs	4 个月前
python	Add aigcode moe dispatch/combine forward-backward kernels	4 个月前
tools	refactor(all): Remove trailing whitespace Co-authored-by: tsungl4<lidongsheng4@huawei.com> # message auto-generated for no-merge-commit merge: !2188 merge pre-commit into master refactor(all): Remove trailing whitespace Created-by: tsungl4 Commit-by: tsungl4 Merged-by: cann-robot Description: Introduce pre-commit tools, and remove trailing white space with default plugin Related Issue: #1017 See merge request: cann/pypto!2188	5 个月前
.clang-format	refactor(all): Remove trailing whitespace Co-authored-by: tsungl4<lidongsheng4@huawei.com> # message auto-generated for no-merge-commit merge: !2188 merge pre-commit into master refactor(all): Remove trailing whitespace Created-by: tsungl4 Commit-by: tsungl4 Merged-by: cann-robot Description: Introduce pre-commit tools, and remove trailing white space with default plugin Related Issue: #1017 See merge request: cann/pypto!2188	5 个月前
.gitattributes	feat(dfx): Update compiler monitor api doc for tracking compilation progress and detecting timeout. Co-authored-by: z00521416<zhangyongtao7@hisilicon.com> # message auto-generated for no-merge-commit merge: !1511 merge master into master feat(dfx): Update compiler monitor api doc for tracking compilation progress and detecting timeout. Created-by: z00521416 Commit-by: z00521416 Merged-by: cann-robot Description: 1. Update compiler monitor api doc for tracking compilation progress and detecting timeout. 2. Migrate PNG files to LFS. See merge request: cann/pypto!1511	5 个月前
.gitignore	feat(build): Extend test case executor functionality Co-authored-by: DCGDDD<yangxu14@huawei.com> # message auto-generated for no-merge-commit merge: !1018 merge master into master feat(build): Extend test case executor functionality Created-by: DCGDDD Commit-by: DCGDDD Merged-by: cann-robot Description: 1. Add .arts/ directory to .gitignore to ignore WebIDE default configuration path; 2. Add/complete comments in build_ci.py and setup.py; 3. Optimize parallel execution control script to facilitate future support for Pytest scenarios. See merge request: cann/pypto!1018	6 个月前
.pre-commit-config.yaml	refactor(all): Remove trailing whitespace Co-authored-by: tsungl4<lidongsheng4@huawei.com> # message auto-generated for no-merge-commit merge: !2188 merge pre-commit into master refactor(all): Remove trailing whitespace Created-by: tsungl4 Commit-by: tsungl4 Merged-by: cann-robot Description: Introduce pre-commit tools, and remove trailing white space with default plugin Related Issue: #1017 See merge request: cann/pypto!2188	5 个月前
AGENTS.md	feat(skills): Add pypto subagents and intent/golden/design skills for operator development workflow Co-authored-by: wangzheng97<wangzheng97@hisilicon.com> # message auto-generated for no-merge-commit merge: !1622 merge feat/add-op-dev-skills into master feat(skills): Add pypto subagents and intent/golden/design skills for operator development workflow Created-by: wangzheng97 Commit-by: wangzheng97 Merged-by: cann-robot Description: ## Summary Add subagents and three skills for PyPTO operator development workflow: - pypto-intent-understanding: Transform natural language operator descriptions into structured requirement documents (spec.md) - pypto-golden-generator: Generate PyTorch golden functions and verification code based on spec.md - pypto-op-design: Generate structured design documents (design.md) with API mapping, tiling strategy, and performance parameters ## Changes ### New Skills Added 1. `.agents/skills/pypto-intent-understanding/` 2. `.agents/skills/pypto-golden-generator/` 3. `.agents/skills/pypto-op-design/` 4. `.opencode/agents` ## Test - All skill documents follow the standard skill format - Reference documents are properly structured with evidence anchoring See merge request: cann/pypto!1622	5 个月前
CMakeLists.txt	refactor(platform): Refactoring platform Co-authored-by: jiachengtang<tangjiacheng7@huawei.com> # message auto-generated for no-merge-commit merge: !1495 merge master into master refactor(platform): Refactoring platform Created-by: jiachengtang Commit-by: jiachengtang Merged-by: cann-robot Description: 不使用路径拼接，转而使用rtGetSocSpec获取参数 See merge request: cann/pypto!1495	5 个月前
CONTRIBUTION.md	refactor(all): Remove trailing whitespace Co-authored-by: tsungl4<lidongsheng4@huawei.com> # message auto-generated for no-merge-commit merge: !2188 merge pre-commit into master refactor(all): Remove trailing whitespace Created-by: tsungl4 Commit-by: tsungl4 Merged-by: cann-robot Description: Introduce pre-commit tools, and remove trailing white space with default plugin Related Issue: #1017 See merge request: cann/pypto!2188	5 个月前
LICENSE	Initial commit	8 个月前
MANIFEST.in	refactor(all): Remove trailing whitespace Co-authored-by: tsungl4<lidongsheng4@huawei.com> # message auto-generated for no-merge-commit merge: !2188 merge pre-commit into master refactor(all): Remove trailing whitespace Created-by: tsungl4 Commit-by: tsungl4 Merged-by: cann-robot Description: Introduce pre-commit tools, and remove trailing white space with default plugin Related Issue: #1017 See merge request: cann/pypto!2188	5 个月前
OAT.xml	feat(license): Modify license info Co-authored-by: yyyfff<yefan29@huawei.com> # message auto-generated for no-merge-commit merge: !827 merge docs into master feat(license): Modify license info Created-by: yyyfff Commit-by: yyyfff Merged-by: cann-robot Description: Modify incorrect descriptions in the license. Related Issue: [#276](https://gitcode.com/cann/pypto/issues/276) See merge request: cann/pypto!827	7 个月前
README.md	fix(docs): Fix some formatting problems of markdown files Co-authored-by: lyz0328<liyanzhen@huawei.com> # message auto-generated for no-merge-commit merge: !819 merge master into master fix(docs): Fix some formatting problems of markdown files Created-by: lyz0328 Commit-by: lyz0328 Merged-by: cann-robot Description: fix(docs): Fix some formatting problems of markdown files See merge request: cann/pypto!819	7 个月前
SECURITY.md	refactor(all): Remove trailing whitespace Co-authored-by: tsungl4<lidongsheng4@huawei.com> # message auto-generated for no-merge-commit merge: !2188 merge pre-commit into master refactor(all): Remove trailing whitespace Created-by: tsungl4 Commit-by: tsungl4 Merged-by: cann-robot Description: Introduce pre-commit tools, and remove trailing white space with default plugin Related Issue: #1017 See merge request: cann/pypto!2188	5 个月前
Third_Party_Open_Source_Softerware_Notice	refactor(all): Remove trailing whitespace Co-authored-by: tsungl4<lidongsheng4@huawei.com> # message auto-generated for no-merge-commit merge: !2188 merge pre-commit into master refactor(all): Remove trailing whitespace Created-by: tsungl4 Commit-by: tsungl4 Merged-by: cann-robot Description: Introduce pre-commit tools, and remove trailing white space with default plugin Related Issue: #1017 See merge request: cann/pypto!2188	5 个月前
Third_Party_Open_Source_Software_List.yaml	fix(interpreter): Fix tile_fwk_calculator compiler error in g++ 13.3.0 Co-authored-by: DCGDDD<yangxu14@huawei.com> # message auto-generated for no-merge-commit merge: !1453 merge interpreter into master fix(interpreter): Fix tile_fwk_calculator compiler error in g++ 13.3.0 Created-by: DCGDDD Commit-by: DCGDDD Merged-by: cann-robot Description: Fix tile_fwk_calculator compiler error in g++ 13.3.0 See merge request: cann/pypto!1453	5 个月前
build_ci.py	feat(build): Modify version num and fix hccl stest run bug Co-authored-by: DCGDDD<yangxu14@huawei.com> # message auto-generated for no-merge-commit merge: !1905 merge master into master feat(build): Modify version num and fix hccl stest run bug Created-by: DCGDDD Commit-by: DCGDDD Merged-by: cann-robot Description: feat(build): Modify version num and fix hccl stest run bug See merge request: cann/pypto!1905	5 个月前
classify_rule.yaml	feat(build): Update classify_rule.yaml Co-authored-by: li-shengxian3<lishengxian3@hisilicon.com> # message auto-generated for no-merge-commit merge: !1900 merge master into master feat(build): Update classify_rule.yaml Created-by: li-shengxian3 Commit-by: li-shengxian3 Merged-by: cann-robot Description: PR 应该避免没有描述信息, 描述信息的最重要的作用是描述修改意图，应该清晰明了. 例如: 标题中包含了 `fix` 标签, 如果没有描述信息，就需要Review人员猜测PR具体修复了哪些内容，或者怀疑修改的必要性. 如果PR和特定的Issue相关，可以单独包含一行 `Related Issue:` 放到描述信息最后. 下面是一个典型的PR描述信息: `The origin issue template brings too many noise, it's not suitable for git message. eg: comments are not removed, labels are redundant as the PR tile already contains the tag. The guide gives a clear suggestion on how to write the PR body. Related Issue: #1234,#5678` 更多描述信息见：[Commit Message 规范](https://gitcode.com/cann/pypto/blob/master/docs/contribute/pull-request.md#commit-message) See merge request: cann/pypto!1900	5 个月前
conftest.py	feat(distributed): Case for distributed python st Co-authored-by: luozhonglin222<luozhonglin1@huawei.com> # message auto-generated for no-merge-commit merge: !1477 merge master into master feat(distributed): Case for distributed python st Created-by: luozhonglin222 Commit-by: luozhonglin222 Merged-by: cann-robot Description: `1.支持通信python用例看护，当前只支持单卡python ST用例，多卡ST用例需要适配` See merge request: cann/pypto!1477	5 个月前
flash_attention_score.py	Update flash attention training path and docs	4 个月前
flash_attention_score_impl.py	Update flash attention training path and docs	4 个月前
pyproject.toml	feat(build): Modify version num and fix hccl stest run bug Co-authored-by: DCGDDD<yangxu14@huawei.com> # message auto-generated for no-merge-commit merge: !1905 merge master into master feat(build): Modify version num and fix hccl stest run bug Created-by: DCGDDD Commit-by: DCGDDD Merged-by: cann-robot Description: feat(build): Modify version num and fix hccl stest run bug See merge request: cann/pypto!1905	5 个月前
pytest.ini	refactor(all): Remove trailing whitespace Co-authored-by: tsungl4<lidongsheng4@huawei.com> # message auto-generated for no-merge-commit merge: !2188 merge pre-commit into master refactor(all): Remove trailing whitespace Created-by: tsungl4 Commit-by: tsungl4 Merged-by: cann-robot Description: Introduce pre-commit tools, and remove trailing white space with default plugin Related Issue: #1017 See merge request: cann/pypto!2188	5 个月前
setup.py	feat(interpreter): Support cacl.so compile online Co-authored-by: DCGDDD<yangxu14@huawei.com> # message auto-generated for no-merge-commit merge: !1398 merge interpreter into master feat(interpreter): Support cacl.so compile online Created-by: DCGDDD Commit-by: DCGDDD Merged-by: cann-robot Description: 1. Remove BUILD_OPEN_PROJECT option in CMake configuration 2. Package header files and source files required by calc binary into whl package Related Issue: https://gitcode.com/cann/pypto/pull/1315 See merge request: cann/pypto!1398	6 个月前

PyPTO

🔥最新动态

2025/12：PyPTO项目首次上线。

🚀概述

PyPTO（发音：pai p-t-o）是一款面向AI加速器的高性能编程框架，旨在简化复杂融合算子乃至整个模型网络的开发流程，同时保持高性能计算能力。该框架采用创新的PTO（Parallel Tensor/Tile Operation）编程范式，以基于Tile的编程模型为核心设计理念，通过多层次的中间表示（IR）系统，将用户通过API构建的AI模型应用从高层次的Tensor图逐步编译成硬件指令，最终生成可在目标平台上高效执行的可执行代码。

核心特性

基于 Tile 的编程模型：所有计算都基于Tile（硬件感知的数据块）进行，充分利用硬件并行计算能力和内存层次结构
多层级计算图转换：通过编译Pass将Tensor Graph转换为Tile Graph、Block Graph和Execution Graph，每一步包括一系列Pass优化流程
自动化代码生成：编译结果通过CodeGen生成底层PTO虚拟指令代码，再通过编译器将虚拟指令代码编译成目标平台的可执行代码
MPMD 执行调度：可执行代码被加载到设备侧，通过MPMD（Multiple Program Multiple Data）的方式调度到设备上的处理器核
完整的工具链支持：全流程的编译中间产物和运行时性能数据可通过IDE集成的工具链可视化识别性能瓶颈，开发者也可以通过工具链控制编译和调度行为
Python 友好 API：提供直观的Tensor级别抽象，贴近算法开发者的思维模式，支持动态Shape和符号化编程
分层抽象设计：对不同开发者暴露不同抽象层次，算法开发者使用Tensor层次，性能专家使用Tile层次，系统开发者使用Block层次

目标用户

算法开发者：主要使用Tensor层次编程，快速实现和验证算法，专注于算法逻辑
性能优化专家：可使用Tile或Block层次，进行深度性能调优，以实现极致性能
系统开发者：可在Tensor/Tile/Block和PTO虚拟指令集层次上进行三方框架对接或集成，以及工具链开发

⚡️最佳实践样例

PyPTO提供了丰富的示例代码，涵盖从基础操作到复杂模型实现的多个层级。一些最佳实践样例参考:

大模型实现样例

DeepSeekV3.2 SFA -稀疏Flash Attention量化实现
DeepSeekV3.2 MLA-PROLOG -MLA Indexer Prolog量化实现
GLM V4.5 Attention -GLM注意力机制实现
GLM V4.5 ExpertsSelector -GLM专家选择器实现

学习路径

在 examples目录下，我们规划了多个层级的样例:

beginner/：基础操作示例，帮助初学者快速上手PyPTO编程
intermediate/：中级示例，包括自定义操作、神经网络模块等
advanced/：高级示例，包括复杂模式和多函数组合

在 models/目录下，我们提供了部分大模型实现样例，供快速移植和部署

这些示例可以帮助开发者学习如何编写PyPTO算子，从简单的Tensor操作到复杂的模型网络实现。

⚡️快速入门

若您希望快速体验PyPTO的使用和开发过程，请访问如下文档获取简易教程。

环境部署：介绍项目基础环境的搭建，包括软件包和第三方依赖的获取和安装。
编译安装：环境部署后，介绍如何快速获取或编译PyPTO软件包并安装。
样例运行：安装PyPTO软件包后，介绍如何快速实现样例运行。

📖文档资源

若您希望深入体验项目功能并修改源码，请访问如下文档获取详细教程。

文档中心：当前发布版本的详细文档，包括编程指南、API参考，贡献指南等
示例代码：丰富的示例代码，从基础到高级应用

🔍目录结构

关键目录如下:

├── docs/                       # 文档资源
│   ├── api/                    # API参考文档
│   ├── contribute/             # 贡献指南文档
│   └── tutorials/              # PyPTO编程指南
│
├── examples/                   # 示例代码
│   ├── 01_beginner/            # 初级示例
│   ├── 02_intermediate/        # 中级示例
│   └── 03_advanced/            # 高级示例
│
├── models/                     # 模型实现示例
│
├── python/                     # Python源码
│   ├── pypto/                  # Python包源码根目录
│   ├── src/                    # pybind11源码根目录
│   └── tests/                  # Python测试用例源码（UTest, STest）
│
├── framework/                  # C++源码根目录
│   ├── include/                # C++对外头文件
│   ├── src/                    # C++源码
│   │   ├── codegen/            # 代码生成模块
│   │   ├── passes/             # 编译Pass模块
│   │   └── ...
│   └── tests/                  # C++测试用例源码
│
├── tools/                      # 工具脚本
│
├── cmake/                      # 构建所需的CMake公共配置及脚本
├── build_ci.py                 # CI执行构建、执行UTest、执行STest辅助脚本
├── CMakeLists.txt              # 顶层CMakeLists.txt，定义所有对外公开编译开关
├── pyproject.toml              # Python编译工具配置文件
├── LICENSE                     # 许可证文件
└── setup.py                    # Python编译工具脚本文件(setuptools)