0
代码
代码
Issues
Pull Requests
讨论
Wiki
分析
0
ascend-robotascend-robot[inductor] exclude op in indirect_mem and lowering_override from FALLBACK_LIST
9c6d228a创建于 2月14日历史提交
文件最后提交记录最后更新时间
__init__.py
add FALLBACK_LIST and aten_op_tool, not integrated yet Co-authored-by: jimmycao9929<caohaijun3@huawei.com> # message auto-generated for no-merge-commit merge: !30032 merge v2.7.1-0126 into v2.7.1 [inductor] use FALLBACK_LIST rather than GENERATE_LIST Created-by: jimmycao9929 Commit-by: jimmycao9929 Merged-by: ascend-robot Description: **What type of PR is this?** > /kind feature **What does this PR do / why do we need it**: Currently, GENERATE_LIST is adopted to lowering, which is kind of white_list. This mechanism shows a number of problems. Especially, we can not figure out clearly how many aten/prims are fallbacked by us more than native pytorch. Thus, instead of that, we plan to use FALLBACK_LIST. Then we can add op item to this list if some problems (e.g., compile, precision, performance, etc.) with it; and remove it after problems are fixed. **Which issue(s) this PR fixes**: Fixes # **Special notes for your reviewers**: Currently, we only use it for A5 and control with environment switch. After verified carefully, we will remove the env switch. See merge request: Ascend/pytorch!300323 个月前
aten_op_tool.py
add FALLBACK_LIST and aten_op_tool, not integrated yet Co-authored-by: jimmycao9929<caohaijun3@huawei.com> # message auto-generated for no-merge-commit merge: !30032 merge v2.7.1-0126 into v2.7.1 [inductor] use FALLBACK_LIST rather than GENERATE_LIST Created-by: jimmycao9929 Commit-by: jimmycao9929 Merged-by: ascend-robot Description: **What type of PR is this?** > /kind feature **What does this PR do / why do we need it**: Currently, GENERATE_LIST is adopted to lowering, which is kind of white_list. This mechanism shows a number of problems. Especially, we can not figure out clearly how many aten/prims are fallbacked by us more than native pytorch. Thus, instead of that, we plan to use FALLBACK_LIST. Then we can add op item to this list if some problems (e.g., compile, precision, performance, etc.) with it; and remove it after problems are fixed. **Which issue(s) this PR fixes**: Fixes # **Special notes for your reviewers**: Currently, we only use it for A5 and control with environment switch. After verified carefully, we will remove the env switch. See merge request: Ascend/pytorch!300323 个月前
fallback_list_tool.py
[inductor] exclude op in indirect_mem and lowering_override from FALLBACK_LIST Co-authored-by: jimmycao9929<caohaijun3@huawei.com> # message auto-generated for no-merge-commit merge: !30800 merge v2.7.1-0211 into v2.7.1 [inductor] exclude op in indirect_mem and lowering_override from FALLBACK_LIST Created-by: jimmycao9929 Commit-by: jimmycao9929 Merged-by: ascend-robot Description: # 【合入来源】 - [x] 重构优化 # 【修改方案】 1. 从FALLBACK_LIST中把 LOWERING_OVERLOAD_OP 和 INDIRECT_MEM_OVERLOAD_LIST中的op排除掉 2. 默认打开ENABLE_FALLBACK_LIST开关，A5上使用FALLBACK_LIST # 【资料变更】 不涉及 # 【接口变更】 不涉及 # 【功能验证】 已经在多个模型(mmoe/dlrm/onerec/mind)上验证通过 # 【CheckList】 - [ ] 代码注释完备，正确记录错误日志 - [ ] 代码实现进行了返回值、空指针等校验 - [ ] PR标题正确使用类型标签，如：feat、fix、refactor、docs、test等 - [x] PR持续集成流水线（CI）执行通过，代码检查无异常 See merge request: Ascend/pytorch!308003 个月前