master

ascend-robotfix: fix the bug when qlora does not enable the overlap feature

b650b891创建于 3月21日历史提交

文件	最后提交记录	最后更新时间
moe	fix: fix the bug when qlora does not enable the overlap feature Co-authored-by: yanzhixiao<yanzhixiao@h-partners.com> # message auto-generated for no-merge-commit merge: !4315 merge fix-qlora into master fix: fix the bug when qlora does not enable the overlap feature Created-by: yanzhixiao23 Commit-by: yanzhixiao Merged-by: ascend-robot Description: ## What this PR does / why we need it? Fix the bug where QLoRA weights cannot be dequantized when overlap is disabled. ## Does this PR introduce any user-facing change? NA, Only bugfix ## How was this patch tested? Bug fixed. See merge request: Ascend/MindSpeed-LLM!4315	2 个月前
__init__.py	!1958 整改仓库文件结构 Merge pull request !1958 from DONGHAORAN/master	1 年前
cc_lora_forward.py	!3252 [pytorch][bugfix]Fix LoRA finetune bug Merge pull request !3252 from sunjunjie/master	8 个月前
cc_lora_mlp_forward.py	!2040 CCLoRA优化：完善CCLoRA并实现MLP LoRA融合 Merge pull request !2040 from 付烁/master	1 年前
lora_moe.py	!2561 gemm for lora Merge pull request !2561 from HaoWuMark/master_lora_gemm	1 年前
qlora.py	!2712 [pytorch][feature]upgrading Megatron to r0.12.1 Merge pull request !2712 from yanzhixiao/llm-0.12.0-0526	11 个月前
utils.py	!2329 lora权重分离保存 Merge pull request !2329 from qu_yueze/master	1 年前