| Add offline pad_data Co-authored-by: wuweiqiang24<wuweiqiang11@huawei.com> # message auto-generated for no-merge-commit merge: !2938 merge revise_preprocess_data into master Add offline pad_data Created-by: wuweiqiang24 Commit-by: wuweiqiang24 Merged-by: ascend-robot Description: 增加离线预处理pack数据集功能,可提前将数据padding到2\*CP倍,在线使用CP功能时可节约padding部分耗时 * 精度与非离线padding版本存在一定差异  * Llama2-7b,单机16k,GBS=8场景下,性能提升4.8%  See merge request: Ascend/MindSpeed!2938 | 11 个月前 |