master

ascend-robotstyle(pytorch): SCA compliance rectification

57172671创建于 3月28日历史提交

文件	最后提交记录	最后更新时间
__init__.py	[pytorch][features]fsdp2 dataloader Co-authored-by: guihaowen666<guihaowen@huawei.com> # message auto-generated for no-merge-commit merge: !4041 merge br_master_fsdp2_dataloader_dev into master [pytorch][features]fsdp2 dataloader Created-by: guihaowen666 Commit-by: guihaowen666 Merged-by: ascend-robot Description: New dataloader support in fsdp2 backend 1 . The Converter is used to align tags in the dataset. 2. The template is used to align and encode data. 3. The processor is configured to process data into an input of the model. See merge request: Ascend/MindSpeed-LLM!4041	4 个月前
pretrain_processor.py	style(pytorch): SCA compliance rectification Co-authored-by: zhyebin01<zhangyebin@h-partners.com> # message auto-generated for no-merge-commit merge: !4355 merge master into master style(pytorch): SCA compliance rectification Created-by: zhyebin01 Commit-by: zhyebin01 Merged-by: ascend-robot Description: ## What this PR does / why we need it? SCA compliance rectification ## Does this PR introduce any user-facing change? no ## How was this patch tested? pipeline test passed See merge request: Ascend/MindSpeed-LLM!4355	2 个月前
processor_utils.py	style(pytorch): SCA compliance rectification Co-authored-by: zhyebin01<zhangyebin@h-partners.com> # message auto-generated for no-merge-commit merge: !4355 merge master into master style(pytorch): SCA compliance rectification Created-by: zhyebin01 Commit-by: zhyebin01 Merged-by: ascend-robot Description: ## What this PR does / why we need it? SCA compliance rectification ## Does this PR introduce any user-facing change? no ## How was this patch tested? pipeline test passed See merge request: Ascend/MindSpeed-LLM!4355	2 个月前
sft_processor.py	style(pytorch): SCA compliance rectification Co-authored-by: zhyebin01<zhangyebin@h-partners.com> # message auto-generated for no-merge-commit merge: !4355 merge master into master style(pytorch): SCA compliance rectification Created-by: zhyebin01 Commit-by: zhyebin01 Merged-by: ascend-robot Description: ## What this PR does / why we need it? SCA compliance rectification ## Does this PR introduce any user-facing change? no ## How was this patch tested? pipeline test passed See merge request: Ascend/MindSpeed-LLM!4355	2 个月前