Merged
【课程社区共建】新增大语言模型微调实战课程框架 #69
【课程社区共建】新增大语言模型微调实战课程框架 #69
Merged
pescnAdd on May 12
pescn
May 12

描述

本课程面向高校在校学生,结合 SwanLab 团队正在开展的线下启航营实践内容,围绕 Qwen3 系列模型在昇腾 NPU 上的训练与加速展开。

本 PR 包括大语言模型微调实战课程中第一章:Qwen3 基座模型指令微调(SFT)的内容

类型标签

其他说明

第二章课程数据集部分还在做合规和脱敏,因此临时处于占位符状态

likedislike
Pull Request has been successfully merged by CANN-robot.
(Thank you for pescn's contribution.)
CANN-robotCANN-robotCollaborators
May 12 Added label: stat/needs-squash
CANN-robot
CANN-robotCollaborators
May 12 Comments:

Thanks for your pull-request.
The full list of commands accepted by me can be found at here
You can get sig-info at here


PR Approval Progress

Congratulations! All modules have met the lgtm and approve requirements.

Module Approval Details

module lgtm status approve status
repo-cann/cann-learning-hub 田晓亮, fuyangchenghu (2/2) 田晓亮, fuyangchenghu (2/1)

💡 Tip:

  • Committer can comment /approve or /lgtm
  • Commenting /approve implies both code review (lgtm) and intent to merge (approve)

CLA Signature Pass

pescn, thanks for your pull request. All authors of the commits have signed the CLA. 👍

likedislike
CANN-robotCANN-robotCollaborators
May 12 Added label: cann-cla/no
Ppescn
May 12 Change title to "【课程社区共建】新增大语言模型微调实战课程框架", originally titled "【课程社区共建】新增大语言模型微调实战课程框架与第一章".
pescn
May 12 Comments:

/check-cla

likedislike
CANN-robotCANN-robotCollaborators
May 12 Removed label: cann-cla/no
CANN-robotCANN-robotCollaborators
May 12 Added label: cann-cla/yes
TianXLCollaborators
May 14 Comments:

/lgtm
/approve

likedislike
CANN-robotCANN-robotCollaborators
May 14 Added label: approved
Ppescn
May 14 Pushed 1 commits:55ce3271-fix: 修复部分文案问题
CANN-robotCANN-robotCollaborators
May 14 Removed label: approved
CANN-robot
CANN-robotCollaborators
May 14 Comments:

Notice

New code changes of the pull request are detected and remove these labels approved. 😳

likedislike
wanzutao
wanzutaoCollaborators
May 14 Comments:

1.pip依赖安装增加指定国内pip源,当前依赖安装速度很慢。
2.在线环境测试pip依赖安装完需要重启Kernel才会生效,优先可以看看有无解决方案,没有的话可以写到步骤里说明下。
3.文本测试中输出不太合规,需要调整下输入文本
image.png
4.使用了swanlab的代码块执行后不会自动跳转下一个代码块,需要手动跳转下一个代码块执行。可以看看能不能解决,不行的话最好到那一步说明下,尤其是训练那个步骤耗时很长,连续点执行会重复执行

likedislike
大毛
大毛Collaborators
May 14 Comments:

/lgtm
/approve

likedislike
CANN-robotCANN-robotCollaborators
May 14 Added label: approved
Ppescn
May 14 Pushed 1 commits:94fe512b-fix: 修复 Notebook 中 reviewer 反馈的问题
CANN-robotCANN-robotCollaborators
May 14 Removed label: approved
CANN-robotCANN-robotCollaborators
May 14 Added label: approved
CANN-robot
CANN-robotCollaborators
May 14 Comments:

Notice

New code changes of the pull request are detected and remove these labels approved. 😳

likedislike
pescn
May 14 Comments:

1.pip依赖安装增加指定国内pip源,当前依赖安装速度很慢。
2.在线环境测试pip依赖安装完需要重启Kernel才会生效,优先可以看看有无解决方案,没有的话可以写到步骤里说明下。
3.文本测试中输出不太合规,需要调整下输入文本
image.png
4.使用了swanlab的代码块执行后不会自动跳转下一个代码块,需要手动跳转下一个代码块执行。可以看看能不能解决,不行的话最好到那一步说明下,尤其是训练那个步骤耗时很长,连续点执行会重复执行

@zutao

关于您反馈的问题1和3已经确认并修复:

问题 2 我们目前测试不需要重启也是可以跑的,因为前面最开始就通过 %pip 安装了这些包,然后才是调用这些包,在 Jupyter 中实现的行为是正常的
问题 4 是因为在运行 swanlab 的代码块这个会弹出一个输入框要求学生输入密钥,但在 CANNLab 上会出现在窗口在页面上方而非 Cell 下方的 Output 中,这里确实容易看漏,因此这里我们在这一步的文档中提示了学生看上方,同时在课程授课过程中,是由老师带着大家看的

likedislike
fuyangchenghuCollaboratorsMay 16Start code review2
contrib/tutorials/llm_finetune_course/01_Qwen3_Instruction_SFT/notebook.ipynb
Outdated
@@ -0,0 +1,0 @@
1+{
fuyangchenghuMay 16Comments:

notebook需要按照01.01_XXXX.ipynb命名,后台数据库会对_进行分隔,分别统计数据,其他notebook相同

likedislike
pescn
May 16 Comments:

已完成调整

fuyangchenghuCollaborators
May 16 Comments:

PDF建议新建目录存放

likedislike
Ppescn
May 16 Pushed 1 commits:d8c892b3-目录结构调整与课程体系调整
CANN-robotCANN-robotCollaborators
May 16 Removed label: approved
CANN-robot
CANN-robotCollaborators
May 16 Comments:

Notice

New code changes of the pull request are detected and remove these labels approved. 😳

likedislike
Ppescn
May 16 Pushed 1 commits:b9241cbb-fix: 移除错误的 Qwen3 LoRA 微调课程指向
pescn
May 16 Comments:

/check-cla

likedislike
fuyangchenghuCollaborators
May 16 Comments:

/lgtm

likedislike
fuyangchenghuCollaborators
May 16 Comments:

/approve

likedislike
CANN-robotCANN-robotCollaborators
May 16 Added label: approved
TianXLCollaborators
May 16 Comments:

/lgtm
/approve

likedislike
CANN-robotCANN-robotCollaborators
May 16 Added label: lgtm
CANN-robot
CANN-robotCollaborators
May 16 Comments:

Review Guide

This pull-request passes review.
Committers who wrote a comment of /approve are: 田晓亮, fuyangchenghu.
Reviewers who wrote a comment of /lgtm are: fuyangchenghu, 田晓亮.

likedislike
CANN-robot
CANN-robotCollaborators
May 16 Comments:

The MR can not be merged, because of CodeReview discussion not resolved

If you want to solve this problem, you can click here to do it in the FAQs.

likedislike
FfuyangchenghuCollaborators
May 16 Resolved final issue
CANN-robot
CANN-robotCollaborators
May 16 Comments:

Review Guide

This pull-request passes review.
Committers who wrote a comment of /approve are: 田晓亮, fuyangchenghu.
Reviewers who wrote a comment of /lgtm are: fuyangchenghu, 田晓亮.

likedislike
CANN-robotCANN-robotCollaborators
May 16 Merged pull request