| [pytorch][feature]PLM-1.8B pretrain/sft
Co-authored-by: EVA1<jingsiyu1@huawei.com>
# message auto-generated for no-merge-commit merge:
!3637 merge master into master
[pytorch][feature]PLM-1.8B pretrain/sft
Created-by: EVA1
Commit-by: EVA1
Merged-by: ascend-robot
Description: 1.PLM-1.8B 模型支持:数据集格式转换、权重转换、微调、预训练;
2.精度已对齐,sft相对误差小于千分之一。
See merge request: Ascend/MindSpeed-LLM!3637 | 6 个月前 |