0
代码
代码
Issues
Pull Requests
讨论
Wiki
分析
0
ascend-robotascend-robot[FEAT] [Inductor] Add support for sequence length bucketing in dynamic shapes
d9e163f3创建于 1月5日历史提交
文件最后提交记录最后更新时间
model_package_loader.h
【Inductor】add aot inductor for v2.7.1 Co-authored-by: Zichun Ye<zichun.ye@huawei.com> # message auto-generated for no-merge-commit merge: merge aoti_v27 into v2.7.1 【Inductor】add aot inductor for v2.7.1 Created-by: zichun_ye Commit-by: Zichun Ye Merged-by: ascend-robot Description: <!-- Thanks for sending a pull request! --> **What type of PR is this?** > Uncomment only one /kind <> line, hit enter to put that in a new line, and remove leading whitespaces from that line: > > /kind bug > /kind task /kind feature **What does this PR do / why do we need it**: add aot inductor for v2.7.1 update logic to generate cpp wrapper for v2.7.1 add the whole cpp utils functions for aot inductor fix some bugs **Which issue(s) this PR fixes**: <!-- *Automatically closes linked issue when PR is merged. Usage: Fixes #<issue number>, or Fixes (paste link of issue). --> Fixes # **Special notes for your reviewers**: See merge request: Ascend/pytorch!248538 个月前
pybind.h
【Inductor】add aot inductor for v2.7.1 Co-authored-by: Zichun Ye<zichun.ye@huawei.com> # message auto-generated for no-merge-commit merge: merge aoti_v27 into v2.7.1 【Inductor】add aot inductor for v2.7.1 Created-by: zichun_ye Commit-by: Zichun Ye Merged-by: ascend-robot Description: <!-- Thanks for sending a pull request! --> **What type of PR is this?** > Uncomment only one /kind <> line, hit enter to put that in a new line, and remove leading whitespaces from that line: > > /kind bug > /kind task /kind feature **What does this PR do / why do we need it**: add aot inductor for v2.7.1 update logic to generate cpp wrapper for v2.7.1 add the whole cpp utils functions for aot inductor fix some bugs **Which issue(s) this PR fixes**: <!-- *Automatically closes linked issue when PR is merged. Usage: Fixes #<issue number>, or Fixes (paste link of issue). --> Fixes # **Special notes for your reviewers**: See merge request: Ascend/pytorch!248538 个月前
shape_handling.cpp
[FEAT] [Inductor] Add support for sequence length bucketing in dynamic shapes Co-authored-by: luqichao<luqichao1@huawei.com> # message auto-generated for no-merge-commit merge: !28555 merge v2.7.1_shape_2dim into v2.7.1 [FEAT] [Inductor] Add support for sequence length bucketing in dynamic shapes Created-by: luqichao Commit-by: luqichao Merged-by: ascend-robot Description: 修改后全量配置参考： ``` self.shape_options = { "enable_shape_handling": True, "shape_handling_configs":[ { "type": "BATCHSIZE", # 处理的维度类型(Required) "dimensions": 0, # 该维度在tensor中的下标(BATCHSIZE默认为0)(Optional) "indices": [0, 1], # 需要处理的tensor下标(默认为所有tensor)(Optional) "value": 0.0, # padding时填充的值, 默认为0.0(Optional) "gears": [], # 自定义档位信息(Optional) "min_size": 1, # 该维度的最小大小(档位), 默认为1(Optional) "max_size": 1024, # 该维度的最大大小(档位), 默认为1024(Optional) "policy": "TIMES", # 依据min_size, max_size自动生成gears的策略, 默认为TIMES, 表示生成范围内2的整数幂档位(Optional) }, { "type": "SEQLEN", # 处理的维度类型(Required) "dimensions": [1, 1], # 该维度在tensor中的下标, 与indices一一对应, 也可以接收dimension表示所有tensor使用相同的dimension index, 优先接收dimension(SEQLEN默认为1)(Optional) "indices": [0, 1], # 需要处理的tensor下标(默认为所有tensor)(Optional) "value": 0.0, # padding时填充的值, 默认为0.0(Optional) "gears": [], # 自定义档位信息(Optional) "min_size": 1, # 该维度的最小大小(档位), 默认为1(Optional) "max_size": 1024, # 该维度的最大大小(档位), 默认为1024(Optional) "policy": "TIMES", # 依据min_size, max_size自动生成gears的策略, 默认为TIMES, 表示生成范围内2的整数幂档位(Optional) } ], "shape_handling_dict": { "trans_pre_fn": transform_pre_fn, "trans_post_fn": transform_post_fn, "re_pre_fn": recover_pre_fn, "re_post_fn": recover_post_fn, } } ``` configs可以不提供，默认只对batchsize做分档 See merge request: Ascend/pytorch!285554 个月前
shape_handling.h
[Inductor] shape handling basic functionality Co-authored-by: luqichao<luqichao1@huawei.com> # message auto-generated for no-merge-commit merge: merge shape_handling_2.7.1 into v2.7.1 [Inductor] shape handling basic functionality Created-by: luqichao Commit-by: luqichao Merged-by: ascend-robot Description: <!-- Thanks for sending a pull request! --> **What type of PR is this?** > Uncomment only one /kind <> line, hit enter to put that in a new line, and remove leading whitespaces from that line: > > /kind bug > /kind task > /kind feature **What does this PR do / why do we need it**: **Which issue(s) this PR fixes**: <!-- *Automatically closes linked issue when PR is merged. Usage: Fixes #<issue number>, or Fixes (paste link of issue). --> Fixes # **Special notes for your reviewers**: See merge request: Ascend/pytorch!250747 个月前