0
代码
代码
Issues
Pull Requests
讨论
Wiki
分析
0
ascend-robotascend-robotfix link validity
dd6fe347创建于 4月9日历史提交
文件最后提交记录最后更新时间
images
!7379 add 03.高阶特性.md Merge pull request !7379 from lijian/torchair_doc 8 个月前
01.在线推理.md
!7379 add 03.高阶特性.md Merge pull request !7379 from lijian/torchair_doc 8 个月前
02.ONNX的导出.md
!7379 add 03.高阶特性.md Merge pull request !7379 from lijian/torchair_doc 8 个月前
03.ONNX转OM.md
!7379 add 03.高阶特性.md Merge pull request !7379 from lijian/torchair_doc 8 个月前
04.离线推理.md
文档整改，gitee->gitcode Co-authored-by: Lighters_c<zyh13227@163.com> # message auto-generated for no-merge-commit merge: !7469 merge ffffix into master 文档整改，gitee->gitcode Created-by: addsubmuldiv Commit-by: Lighters_c Merged-by: ascend-robot Description: ## Motivation Please describe the motivation of this PR and the goal you want to achieve through this PR. ## Modification Please briefly describe what modification is made in this PR. ## Self-test (Optional) If modifications to this PR may cause/fix function/accuracy/performance DTSs/issues, a self-inspection record needs to be attached. ## BC-breaking (Optional) If there are compatibility issues, such as dependencies on cann/torch_npu versions, they need to be explained in the PR. ## Checklist **Before PR**: - [ ] The new code needs to comply with the Clean Code specification. - [ ] The PR content is self-checked, and the expression can be clear and the writing standardized **After PR**: - [ ] CLA has been signed and all committers have signed the CLA in this PR. - [ ] The ci-pipeline is passed, Code Check is passed. See merge request: Ascend/ModelZoo-PyTorch!74695 个月前
05.01.ResNet50 使用静态 AIPP 的案例.md
文档整改，gitee->gitcode Co-authored-by: Lighters_c<zyh13227@163.com> # message auto-generated for no-merge-commit merge: !7469 merge ffffix into master 文档整改，gitee->gitcode Created-by: addsubmuldiv Commit-by: Lighters_c Merged-by: ascend-robot Description: ## Motivation Please describe the motivation of this PR and the goal you want to achieve through this PR. ## Modification Please briefly describe what modification is made in this PR. ## Self-test (Optional) If modifications to this PR may cause/fix function/accuracy/performance DTSs/issues, a self-inspection record needs to be attached. ## BC-breaking (Optional) If there are compatibility issues, such as dependencies on cann/torch_npu versions, they need to be explained in the PR. ## Checklist **Before PR**: - [ ] The new code needs to comply with the Clean Code specification. - [ ] The PR content is self-checked, and the expression can be clear and the writing standardized **After PR**: - [ ] CLA has been signed and all committers have signed the CLA in this PR. - [ ] The ci-pipeline is passed, Code Check is passed. See merge request: Ascend/ModelZoo-PyTorch!74695 个月前
05.02.GLIP、CLIP 性能优化案例.md
文档整改，gitee->gitcode Co-authored-by: Lighters_c<zyh13227@163.com> # message auto-generated for no-merge-commit merge: !7469 merge ffffix into master 文档整改，gitee->gitcode Created-by: addsubmuldiv Commit-by: Lighters_c Merged-by: ascend-robot Description: ## Motivation Please describe the motivation of this PR and the goal you want to achieve through this PR. ## Modification Please briefly describe what modification is made in this PR. ## Self-test (Optional) If modifications to this PR may cause/fix function/accuracy/performance DTSs/issues, a self-inspection record needs to be attached. ## BC-breaking (Optional) If there are compatibility issues, such as dependencies on cann/torch_npu versions, they need to be explained in the PR. ## Checklist **Before PR**: - [ ] The new code needs to comply with the Clean Code specification. - [ ] The PR content is self-checked, and the expression can be clear and the writing standardized **After PR**: - [ ] CLA has been signed and all committers have signed the CLA in this PR. - [ ] The ci-pipeline is passed, Code Check is passed. See merge request: Ascend/ModelZoo-PyTorch!74695 个月前
05.性能优化.md
fix link validity Co-authored-by: frozenleaves<914814442@qq.com> # message auto-generated for no-merge-commit merge: !7517 merge master into master fix link validity Created-by: frozenn Commit-by: frozenleaves Merged-by: ascend-robot Description: ## Motivation Please describe the motivation of this PR and the goal you want to achieve through this PR. ## Modification Please briefly describe what modification is made in this PR. ## Self-test (Optional) If modifications to this PR may cause/fix function/accuracy/performance DTSs/issues, a self-inspection record needs to be attached. ## BC-breaking (Optional) If there are compatibility issues, such as dependencies on cann/torch_npu versions, they need to be explained in the PR. ## Checklist **Before PR**: - [ ] The new code needs to comply with the Clean Code specification. - [ ] The PR content is self-checked, and the expression can be clear and the writing standardized **After PR**: - [ ] CLA has been signed and all committers have signed the CLA in this PR. - [ ] The ci-pipeline is passed, Code Check is passed. See merge request: Ascend/ModelZoo-PyTorch!75171 个月前
README.md
!7379 add 03.高阶特性.md Merge pull request !7379 from lijian/torchair_doc 8 个月前
README.md

在线推理是指依赖深度学习框架执行推理的场景，一般用于模型训练与验证，例如调用PyTorch模型的forward接口进行推理。

在应用场景中部署模型时，一般会对模型进行离线优化，将模型转换为与硬件亲和的格式，此时模型已经脱离厚重的框架且得到优化，可以快捷地部署到推理硬件上进行推理，即为离线推理。

因离线推理硬件、推理后端的不同，模型的转换与优化过程也无法统一。此教程旨在介绍如何将PyTroch模型转为ONNX模型，ONNX模型如何转为OM模型， 如何在昇腾NPU上进行推理。其他框架可能会涉及，但不作重点讲解。

ONNX离线推理流程：

  1. 在线推理：打通在线模型的推理过程，区分数据预处理、模型推理、数据后处理，为后续适配离线推理做准备
  2. ONNX的导出：使用常见框架的ONNX导出方法，得到ONNX模型
  3. ONNX转OM：使用ATC工具将ONNX转为OM模型
  4. 离线模型推理：适配OM模型进行离线推理
  5. 性能优化：常用的性能优化方案