master

ascend-robotfeat(diffusers): support remote repo config autoload

5cf36c7a创建于 12 天前历史提交

文件	最后提交记录	最后更新时间
__init__.py	【同步】【非开发代码】代码从 develop 同步到 master Co-authored-by: yydyzr<liuyuncong1@huawei.com> Co-authored-by: gcw_61YBRfIt<chuzhenxing@huawei.com> Co-authored-by: 孔炳翔<1120200577@qq.com> Co-authored-by: zhengxinqian<qianzhengxin@huawei.com> Co-authored-by: hw_whx<wanghexiang7@huawei.com> Co-authored-by: jgong5<steven.gong@gmail.com> Co-authored-by: hw_whx<2952154980@qq.com> # message auto-generated for no-merge-commit merge: !330 merge master into master 【同步】【非开发代码】代码从 develop 同步到 master Created-by: AvadaKedavrua Commit-by: liujiawang;ascend-robot;AvadaKedavrua;lutean;Horacehxw;eveyin1;minghang_c;zwt__;tt0cool;elrond-g;jia_ya_nan;zhenyu_zhang;ChenHuiwen;wangshen001;Hudingyi;wendellX;Secluded_Ocean;jhon-117;yaohan404;jiangruitao;zhenghaojie;stormchasingg;panyj1993;cmh1056291129;yuyinkai1;sunguozhong;genius52;liu_jiaxu;HongMaoShuiGuai;zhengxinqian;weixin_43368449;jsez-li-bin;jgong5;wqh17101;w00609794;yydyzr;JieZhang679;sppedforcy;gcw_61YBRfIt;Jiong Gong;hw_whx;gongjiong;孔炳翔 Merged-by: ascend-robot Description: 代码从 develop 同步到 master，后续基于 master 演进，并支持打包 See merge request: Ascend/msmodeling!330	17 天前
conftest.py	【同步】【非开发代码】代码从 develop 同步到 master Co-authored-by: yydyzr<liuyuncong1@huawei.com> Co-authored-by: gcw_61YBRfIt<chuzhenxing@huawei.com> Co-authored-by: 孔炳翔<1120200577@qq.com> Co-authored-by: zhengxinqian<qianzhengxin@huawei.com> Co-authored-by: hw_whx<wanghexiang7@huawei.com> Co-authored-by: jgong5<steven.gong@gmail.com> Co-authored-by: hw_whx<2952154980@qq.com> # message auto-generated for no-merge-commit merge: !330 merge master into master 【同步】【非开发代码】代码从 develop 同步到 master Created-by: AvadaKedavrua Commit-by: liujiawang;ascend-robot;AvadaKedavrua;lutean;Horacehxw;eveyin1;minghang_c;zwt__;tt0cool;elrond-g;jia_ya_nan;zhenyu_zhang;ChenHuiwen;wangshen001;Hudingyi;wendellX;Secluded_Ocean;jhon-117;yaohan404;jiangruitao;zhenghaojie;stormchasingg;panyj1993;cmh1056291129;yuyinkai1;sunguozhong;genius52;liu_jiaxu;HongMaoShuiGuai;zhengxinqian;weixin_43368449;jsez-li-bin;jgong5;wqh17101;w00609794;yydyzr;JieZhang679;sppedforcy;gcw_61YBRfIt;Jiong Gong;hw_whx;gongjiong;孔炳翔 Merged-by: ascend-robot Description: 代码从 develop 同步到 master，后续基于 master 演进，并支持打包 See merge request: Ascend/msmodeling!330	17 天前
test___init__.py	【同步】【非开发代码】代码从 develop 同步到 master Co-authored-by: yydyzr<liuyuncong1@huawei.com> Co-authored-by: gcw_61YBRfIt<chuzhenxing@huawei.com> Co-authored-by: 孔炳翔<1120200577@qq.com> Co-authored-by: zhengxinqian<qianzhengxin@huawei.com> Co-authored-by: hw_whx<wanghexiang7@huawei.com> Co-authored-by: jgong5<steven.gong@gmail.com> Co-authored-by: hw_whx<2952154980@qq.com> # message auto-generated for no-merge-commit merge: !330 merge master into master 【同步】【非开发代码】代码从 develop 同步到 master Created-by: AvadaKedavrua Commit-by: liujiawang;ascend-robot;AvadaKedavrua;lutean;Horacehxw;eveyin1;minghang_c;zwt__;tt0cool;elrond-g;jia_ya_nan;zhenyu_zhang;ChenHuiwen;wangshen001;Hudingyi;wendellX;Secluded_Ocean;jhon-117;yaohan404;jiangruitao;zhenghaojie;stormchasingg;panyj1993;cmh1056291129;yuyinkai1;sunguozhong;genius52;liu_jiaxu;HongMaoShuiGuai;zhengxinqian;weixin_43368449;jsez-li-bin;jgong5;wqh17101;w00609794;yydyzr;JieZhang679;sppedforcy;gcw_61YBRfIt;Jiong Gong;hw_whx;gongjiong;孔炳翔 Merged-by: ascend-robot Description: 代码从 develop 同步到 master，后续基于 master 演进，并支持打包 See merge request: Ascend/msmodeling!330	17 天前
test_api.py	【同步】【非开发代码】代码从 develop 同步到 master Co-authored-by: yydyzr<liuyuncong1@huawei.com> Co-authored-by: gcw_61YBRfIt<chuzhenxing@huawei.com> Co-authored-by: 孔炳翔<1120200577@qq.com> Co-authored-by: zhengxinqian<qianzhengxin@huawei.com> Co-authored-by: hw_whx<wanghexiang7@huawei.com> Co-authored-by: jgong5<steven.gong@gmail.com> Co-authored-by: hw_whx<2952154980@qq.com> # message auto-generated for no-merge-commit merge: !330 merge master into master 【同步】【非开发代码】代码从 develop 同步到 master Created-by: AvadaKedavrua Commit-by: liujiawang;ascend-robot;AvadaKedavrua;lutean;Horacehxw;eveyin1;minghang_c;zwt__;tt0cool;elrond-g;jia_ya_nan;zhenyu_zhang;ChenHuiwen;wangshen001;Hudingyi;wendellX;Secluded_Ocean;jhon-117;yaohan404;jiangruitao;zhenghaojie;stormchasingg;panyj1993;cmh1056291129;yuyinkai1;sunguozhong;genius52;liu_jiaxu;HongMaoShuiGuai;zhengxinqian;weixin_43368449;jsez-li-bin;jgong5;wqh17101;w00609794;yydyzr;JieZhang679;sppedforcy;gcw_61YBRfIt;Jiong Gong;hw_whx;gongjiong;孔炳翔 Merged-by: ascend-robot Description: 代码从 develop 同步到 master，后续基于 master 演进，并支持打包 See merge request: Ascend/msmodeling!330	17 天前
test_app.py	feat(diffusers): support remote repo config autoload - add shared config-only Hugging Face and ModelScope snapshot helpers - resolve remote Diffusers repo ids and explicit snapshot subfolders before loading configs - expose video remote-source in CLI and Web UI - update RFC and offline regression coverage Signed-off-by: minghang_c <chiminghang@h-partners.com> Co-authored-by: minghang_c<chiminghang@h-partners.com> # message auto-generated for no-merge-commit merge: !356 merge diffusers-hf-autoload-master-impl into master feat(diffusers): support remote repo config autoload Created-by: minghang_c Commit-by: minghang_c Merged-by: ascend-robot Description: Thanks for your contribution; we appreciate it a lot. The following instructions will make your pull request healthier and help you get feedback more easily. If you do not understand some items, don't worry, just make the pull request and seek help from maintainers. 感谢您的贡献，我们非常重视。以下说明将使您的拉取请求更健康，更易于获得反馈。如果您不理解某些项目，请不要担心，只需提交拉取请求并从维护人员那里寻求帮助即可。 **PR Type / PR类型** - [x] Feature（功能新增） - [ ] Bugfix（Bug 修复） - [x] Docs（文档更新） - [ ] CI/CD（持续集成/持续部署） - [ ] Refactor（代码重构） - [ ] Perf（性能优化） - [x] Test-Cases（测试用例更新） - [ ] Other（其他） ## 🔍 Motivation / 变更动机 video_generate 原先只支持本地 Diffusers 模型目录，使用公开 Hugging Face / ModelScope Diffusers repo 时需要用户手动下载并整理配置目录。 本 PR 增加 Diffusers 远端 repo id 自动加载能力，使 video_generate 可以直接传入远端 repo id，并且只下载 config 文件，不下载权重文件。同时补充 ModelScope remote source、aggregate repo 子目录寻址和 Web UI 支持，使体验与 text_generate 的 remote source 设计保持一致。 ------ ## 📝 Modification / 修改内容 - 新增共享 Hub helper： - Hugging Face config-only snapshot 下载 - ModelScope config-only snapshot 下载 - ModelScope 参数兼容 allow_patterns / allow_file_pattern - snapshot 下载期间隐藏进度输出和噪音日志 - 新增 Diffusers model resolver： - 本地目录保持原行为，不访问网络 - 非本地输入按 remote_source 解析 Hugging Face / ModelScope repo id - 支持 <namespace>/<repo>/<subfolder> 格式，例如：tencent/HunyuanVideo-1.5/transformer/720p_i2v_distilled_sparse - Diffusers builder 接入 resolver，并将解析后的本地路径交给现有 load_config_from_file - video_generate 两个 CLI 入口新增： - --remote-source {huggingface,modelscope} - 更新 model_id help 文案 - Web UI video_generate 表单新增 remote-source 下拉框，并纳入 task params/hash - 更新 RFC：覆盖 Hugging Face、ModelScope、子目录寻址、日志行为与测试策略 - 新增/更新离线回归测试，覆盖 Hub helper、resolver、builder、CLI help、Web UI command builder/callback/frontend workflow ------ ## 📐 Associated Test Results / 关联测试结果 Focused regression: bash .venv/bin/python -m pytest \ tests/regression/tensor_cast/test_model_hub.py \ tests/regression/tensor_cast/test_diffusers_model_resolver.py \ tests/regression/tensor_cast/test_diffusers_remote_builder.py \ tests/regression/tensor_cast/test_auto_model_config_loader.py::test_modelscope_snapshot_config_only_uses_allowlist \ tests/regression/cli/test_video_generate_remote_source.py \ tests/regression/web_ui/test_command_builder.py \ tests/regression/web_ui/test_callbacks.py \ tests/regression/web_ui/test_frontend_workflows.py -q Result: text 598 passed, 67 warnings Whitespace check: bash git diff --check Result: no output. ------ ## 🌟 Use cases (Optional) / 使用案例（可选） Hugging Face 默认来源： bash python -m cli.inference.video_generate Wan-AI/Wan2.2-T2V-A14B-Diffusers \ --device TEST_DEVICE \ --batch-size 1 \ --seq-len 128 \ --frame-num 81 \ --sample-step 1 ModelScope 来源： bash python -m cli.inference.video_generate Wan-AI/Wan2.2-T2V-A14B-Diffusers \ --remote-source modelscope \ --device TEST_DEVICE \ --batch-size 1 \ --seq-len 128 \ --frame-num 81 \ --sample-step 1 Aggregate repo 子目录： bash python -m cli.inference.video_generate tencent/HunyuanVideo-1.5/transformer/720p_i2v_distilled_sparse \ --device TEST_DEVICE \ --batch-size 1 \ --seq-len 128 \ --frame-num 121 \ --sample-step 1 ------ ## ✅ Checklist / 检查列表 **Before PR**: - [ ] Bug fixes are fully covered by unit tests, the case that causes the bug should be added in the unit tests. / 修复的 Bug 已完全由单元测试覆盖，导致 Bug 的情况应在单元测试中添加。 - [x] The modification is covered by complete unit tests. If not, please add more unit tests to ensure the correctness. / 此拉取请求中的修改已完全由单元测试覆盖。如果不是，请添加更多单元测试以确保正确性。 - [x] All relevant documentation (API docs, docstrings, example tutorials) has been updated to reflect these changes. / 所有相关文档（API 文档、文档字符串、示例教程）已更新以反映这些更改。 - [x] Please ensure code files contain no Chinese comments. / 请保证代码文件中不含中文注释。 ------ 🤖 Generated with [Claude Code](https://claude.com/claude-code) See merge request: Ascend/msmodeling!356	12 天前
test_callbacks.py	feat(diffusers): support remote repo config autoload - add shared config-only Hugging Face and ModelScope snapshot helpers - resolve remote Diffusers repo ids and explicit snapshot subfolders before loading configs - expose video remote-source in CLI and Web UI - update RFC and offline regression coverage Signed-off-by: minghang_c <chiminghang@h-partners.com> Co-authored-by: minghang_c<chiminghang@h-partners.com> # message auto-generated for no-merge-commit merge: !356 merge diffusers-hf-autoload-master-impl into master feat(diffusers): support remote repo config autoload Created-by: minghang_c Commit-by: minghang_c Merged-by: ascend-robot Description: Thanks for your contribution; we appreciate it a lot. The following instructions will make your pull request healthier and help you get feedback more easily. If you do not understand some items, don't worry, just make the pull request and seek help from maintainers. 感谢您的贡献，我们非常重视。以下说明将使您的拉取请求更健康，更易于获得反馈。如果您不理解某些项目，请不要担心，只需提交拉取请求并从维护人员那里寻求帮助即可。 **PR Type / PR类型** - [x] Feature（功能新增） - [ ] Bugfix（Bug 修复） - [x] Docs（文档更新） - [ ] CI/CD（持续集成/持续部署） - [ ] Refactor（代码重构） - [ ] Perf（性能优化） - [x] Test-Cases（测试用例更新） - [ ] Other（其他） ## 🔍 Motivation / 变更动机 video_generate 原先只支持本地 Diffusers 模型目录，使用公开 Hugging Face / ModelScope Diffusers repo 时需要用户手动下载并整理配置目录。 本 PR 增加 Diffusers 远端 repo id 自动加载能力，使 video_generate 可以直接传入远端 repo id，并且只下载 config 文件，不下载权重文件。同时补充 ModelScope remote source、aggregate repo 子目录寻址和 Web UI 支持，使体验与 text_generate 的 remote source 设计保持一致。 ------ ## 📝 Modification / 修改内容 - 新增共享 Hub helper： - Hugging Face config-only snapshot 下载 - ModelScope config-only snapshot 下载 - ModelScope 参数兼容 allow_patterns / allow_file_pattern - snapshot 下载期间隐藏进度输出和噪音日志 - 新增 Diffusers model resolver： - 本地目录保持原行为，不访问网络 - 非本地输入按 remote_source 解析 Hugging Face / ModelScope repo id - 支持 <namespace>/<repo>/<subfolder> 格式，例如：tencent/HunyuanVideo-1.5/transformer/720p_i2v_distilled_sparse - Diffusers builder 接入 resolver，并将解析后的本地路径交给现有 load_config_from_file - video_generate 两个 CLI 入口新增： - --remote-source {huggingface,modelscope} - 更新 model_id help 文案 - Web UI video_generate 表单新增 remote-source 下拉框，并纳入 task params/hash - 更新 RFC：覆盖 Hugging Face、ModelScope、子目录寻址、日志行为与测试策略 - 新增/更新离线回归测试，覆盖 Hub helper、resolver、builder、CLI help、Web UI command builder/callback/frontend workflow ------ ## 📐 Associated Test Results / 关联测试结果 Focused regression: bash .venv/bin/python -m pytest \ tests/regression/tensor_cast/test_model_hub.py \ tests/regression/tensor_cast/test_diffusers_model_resolver.py \ tests/regression/tensor_cast/test_diffusers_remote_builder.py \ tests/regression/tensor_cast/test_auto_model_config_loader.py::test_modelscope_snapshot_config_only_uses_allowlist \ tests/regression/cli/test_video_generate_remote_source.py \ tests/regression/web_ui/test_command_builder.py \ tests/regression/web_ui/test_callbacks.py \ tests/regression/web_ui/test_frontend_workflows.py -q Result: text 598 passed, 67 warnings Whitespace check: bash git diff --check Result: no output. ------ ## 🌟 Use cases (Optional) / 使用案例（可选） Hugging Face 默认来源： bash python -m cli.inference.video_generate Wan-AI/Wan2.2-T2V-A14B-Diffusers \ --device TEST_DEVICE \ --batch-size 1 \ --seq-len 128 \ --frame-num 81 \ --sample-step 1 ModelScope 来源： bash python -m cli.inference.video_generate Wan-AI/Wan2.2-T2V-A14B-Diffusers \ --remote-source modelscope \ --device TEST_DEVICE \ --batch-size 1 \ --seq-len 128 \ --frame-num 81 \ --sample-step 1 Aggregate repo 子目录： bash python -m cli.inference.video_generate tencent/HunyuanVideo-1.5/transformer/720p_i2v_distilled_sparse \ --device TEST_DEVICE \ --batch-size 1 \ --seq-len 128 \ --frame-num 121 \ --sample-step 1 ------ ## ✅ Checklist / 检查列表 **Before PR**: - [ ] Bug fixes are fully covered by unit tests, the case that causes the bug should be added in the unit tests. / 修复的 Bug 已完全由单元测试覆盖，导致 Bug 的情况应在单元测试中添加。 - [x] The modification is covered by complete unit tests. If not, please add more unit tests to ensure the correctness. / 此拉取请求中的修改已完全由单元测试覆盖。如果不是，请添加更多单元测试以确保正确性。 - [x] All relevant documentation (API docs, docstrings, example tutorials) has been updated to reflect these changes. / 所有相关文档（API 文档、文档字符串、示例教程）已更新以反映这些更改。 - [x] Please ensure code files contain no Chinese comments. / 请保证代码文件中不含中文注释。 ------ 🤖 Generated with [Claude Code](https://claude.com/claude-code) See merge request: Ascend/msmodeling!356	12 天前
test_charts.py	【同步】【非开发代码】代码从 develop 同步到 master Co-authored-by: yydyzr<liuyuncong1@huawei.com> Co-authored-by: gcw_61YBRfIt<chuzhenxing@huawei.com> Co-authored-by: 孔炳翔<1120200577@qq.com> Co-authored-by: zhengxinqian<qianzhengxin@huawei.com> Co-authored-by: hw_whx<wanghexiang7@huawei.com> Co-authored-by: jgong5<steven.gong@gmail.com> Co-authored-by: hw_whx<2952154980@qq.com> # message auto-generated for no-merge-commit merge: !330 merge master into master 【同步】【非开发代码】代码从 develop 同步到 master Created-by: AvadaKedavrua Commit-by: liujiawang;ascend-robot;AvadaKedavrua;lutean;Horacehxw;eveyin1;minghang_c;zwt__;tt0cool;elrond-g;jia_ya_nan;zhenyu_zhang;ChenHuiwen;wangshen001;Hudingyi;wendellX;Secluded_Ocean;jhon-117;yaohan404;jiangruitao;zhenghaojie;stormchasingg;panyj1993;cmh1056291129;yuyinkai1;sunguozhong;genius52;liu_jiaxu;HongMaoShuiGuai;zhengxinqian;weixin_43368449;jsez-li-bin;jgong5;wqh17101;w00609794;yydyzr;JieZhang679;sppedforcy;gcw_61YBRfIt;Jiong Gong;hw_whx;gongjiong;孔炳翔 Merged-by: ascend-robot Description: 代码从 develop 同步到 master，后续基于 master 演进，并支持打包 See merge request: Ascend/msmodeling!330	17 天前
test_command_builder.py	feat(diffusers): support remote repo config autoload - add shared config-only Hugging Face and ModelScope snapshot helpers - resolve remote Diffusers repo ids and explicit snapshot subfolders before loading configs - expose video remote-source in CLI and Web UI - update RFC and offline regression coverage Signed-off-by: minghang_c <chiminghang@h-partners.com> Co-authored-by: minghang_c<chiminghang@h-partners.com> # message auto-generated for no-merge-commit merge: !356 merge diffusers-hf-autoload-master-impl into master feat(diffusers): support remote repo config autoload Created-by: minghang_c Commit-by: minghang_c Merged-by: ascend-robot Description: Thanks for your contribution; we appreciate it a lot. The following instructions will make your pull request healthier and help you get feedback more easily. If you do not understand some items, don't worry, just make the pull request and seek help from maintainers. 感谢您的贡献，我们非常重视。以下说明将使您的拉取请求更健康，更易于获得反馈。如果您不理解某些项目，请不要担心，只需提交拉取请求并从维护人员那里寻求帮助即可。 **PR Type / PR类型** - [x] Feature（功能新增） - [ ] Bugfix（Bug 修复） - [x] Docs（文档更新） - [ ] CI/CD（持续集成/持续部署） - [ ] Refactor（代码重构） - [ ] Perf（性能优化） - [x] Test-Cases（测试用例更新） - [ ] Other（其他） ## 🔍 Motivation / 变更动机 video_generate 原先只支持本地 Diffusers 模型目录，使用公开 Hugging Face / ModelScope Diffusers repo 时需要用户手动下载并整理配置目录。 本 PR 增加 Diffusers 远端 repo id 自动加载能力，使 video_generate 可以直接传入远端 repo id，并且只下载 config 文件，不下载权重文件。同时补充 ModelScope remote source、aggregate repo 子目录寻址和 Web UI 支持，使体验与 text_generate 的 remote source 设计保持一致。 ------ ## 📝 Modification / 修改内容 - 新增共享 Hub helper： - Hugging Face config-only snapshot 下载 - ModelScope config-only snapshot 下载 - ModelScope 参数兼容 allow_patterns / allow_file_pattern - snapshot 下载期间隐藏进度输出和噪音日志 - 新增 Diffusers model resolver： - 本地目录保持原行为，不访问网络 - 非本地输入按 remote_source 解析 Hugging Face / ModelScope repo id - 支持 <namespace>/<repo>/<subfolder> 格式，例如：tencent/HunyuanVideo-1.5/transformer/720p_i2v_distilled_sparse - Diffusers builder 接入 resolver，并将解析后的本地路径交给现有 load_config_from_file - video_generate 两个 CLI 入口新增： - --remote-source {huggingface,modelscope} - 更新 model_id help 文案 - Web UI video_generate 表单新增 remote-source 下拉框，并纳入 task params/hash - 更新 RFC：覆盖 Hugging Face、ModelScope、子目录寻址、日志行为与测试策略 - 新增/更新离线回归测试，覆盖 Hub helper、resolver、builder、CLI help、Web UI command builder/callback/frontend workflow ------ ## 📐 Associated Test Results / 关联测试结果 Focused regression: bash .venv/bin/python -m pytest \ tests/regression/tensor_cast/test_model_hub.py \ tests/regression/tensor_cast/test_diffusers_model_resolver.py \ tests/regression/tensor_cast/test_diffusers_remote_builder.py \ tests/regression/tensor_cast/test_auto_model_config_loader.py::test_modelscope_snapshot_config_only_uses_allowlist \ tests/regression/cli/test_video_generate_remote_source.py \ tests/regression/web_ui/test_command_builder.py \ tests/regression/web_ui/test_callbacks.py \ tests/regression/web_ui/test_frontend_workflows.py -q Result: text 598 passed, 67 warnings Whitespace check: bash git diff --check Result: no output. ------ ## 🌟 Use cases (Optional) / 使用案例（可选） Hugging Face 默认来源： bash python -m cli.inference.video_generate Wan-AI/Wan2.2-T2V-A14B-Diffusers \ --device TEST_DEVICE \ --batch-size 1 \ --seq-len 128 \ --frame-num 81 \ --sample-step 1 ModelScope 来源： bash python -m cli.inference.video_generate Wan-AI/Wan2.2-T2V-A14B-Diffusers \ --remote-source modelscope \ --device TEST_DEVICE \ --batch-size 1 \ --seq-len 128 \ --frame-num 81 \ --sample-step 1 Aggregate repo 子目录： bash python -m cli.inference.video_generate tencent/HunyuanVideo-1.5/transformer/720p_i2v_distilled_sparse \ --device TEST_DEVICE \ --batch-size 1 \ --seq-len 128 \ --frame-num 121 \ --sample-step 1 ------ ## ✅ Checklist / 检查列表 **Before PR**: - [ ] Bug fixes are fully covered by unit tests, the case that causes the bug should be added in the unit tests. / 修复的 Bug 已完全由单元测试覆盖，导致 Bug 的情况应在单元测试中添加。 - [x] The modification is covered by complete unit tests. If not, please add more unit tests to ensure the correctness. / 此拉取请求中的修改已完全由单元测试覆盖。如果不是，请添加更多单元测试以确保正确性。 - [x] All relevant documentation (API docs, docstrings, example tutorials) has been updated to reflect these changes. / 所有相关文档（API 文档、文档字符串、示例教程）已更新以反映这些更改。 - [x] Please ensure code files contain no Chinese comments. / 请保证代码文件中不含中文注释。 ------ 🤖 Generated with [Claude Code](https://claude.com/claude-code) See merge request: Ascend/msmodeling!356	12 天前
test_components.py	【同步】【非开发代码】代码从 develop 同步到 master Co-authored-by: yydyzr<liuyuncong1@huawei.com> Co-authored-by: gcw_61YBRfIt<chuzhenxing@huawei.com> Co-authored-by: 孔炳翔<1120200577@qq.com> Co-authored-by: zhengxinqian<qianzhengxin@huawei.com> Co-authored-by: hw_whx<wanghexiang7@huawei.com> Co-authored-by: jgong5<steven.gong@gmail.com> Co-authored-by: hw_whx<2952154980@qq.com> # message auto-generated for no-merge-commit merge: !330 merge master into master 【同步】【非开发代码】代码从 develop 同步到 master Created-by: AvadaKedavrua Commit-by: liujiawang;ascend-robot;AvadaKedavrua;lutean;Horacehxw;eveyin1;minghang_c;zwt__;tt0cool;elrond-g;jia_ya_nan;zhenyu_zhang;ChenHuiwen;wangshen001;Hudingyi;wendellX;Secluded_Ocean;jhon-117;yaohan404;jiangruitao;zhenghaojie;stormchasingg;panyj1993;cmh1056291129;yuyinkai1;sunguozhong;genius52;liu_jiaxu;HongMaoShuiGuai;zhengxinqian;weixin_43368449;jsez-li-bin;jgong5;wqh17101;w00609794;yydyzr;JieZhang679;sppedforcy;gcw_61YBRfIt;Jiong Gong;hw_whx;gongjiong;孔炳翔 Merged-by: ascend-robot Description: 代码从 develop 同步到 master，后续基于 master 演进，并支持打包 See merge request: Ascend/msmodeling!330	17 天前
test_frontend_workflows.py	feat(diffusers): support remote repo config autoload - add shared config-only Hugging Face and ModelScope snapshot helpers - resolve remote Diffusers repo ids and explicit snapshot subfolders before loading configs - expose video remote-source in CLI and Web UI - update RFC and offline regression coverage Signed-off-by: minghang_c <chiminghang@h-partners.com> Co-authored-by: minghang_c<chiminghang@h-partners.com> # message auto-generated for no-merge-commit merge: !356 merge diffusers-hf-autoload-master-impl into master feat(diffusers): support remote repo config autoload Created-by: minghang_c Commit-by: minghang_c Merged-by: ascend-robot Description: Thanks for your contribution; we appreciate it a lot. The following instructions will make your pull request healthier and help you get feedback more easily. If you do not understand some items, don't worry, just make the pull request and seek help from maintainers. 感谢您的贡献，我们非常重视。以下说明将使您的拉取请求更健康，更易于获得反馈。如果您不理解某些项目，请不要担心，只需提交拉取请求并从维护人员那里寻求帮助即可。 **PR Type / PR类型** - [x] Feature（功能新增） - [ ] Bugfix（Bug 修复） - [x] Docs（文档更新） - [ ] CI/CD（持续集成/持续部署） - [ ] Refactor（代码重构） - [ ] Perf（性能优化） - [x] Test-Cases（测试用例更新） - [ ] Other（其他） ## 🔍 Motivation / 变更动机 video_generate 原先只支持本地 Diffusers 模型目录，使用公开 Hugging Face / ModelScope Diffusers repo 时需要用户手动下载并整理配置目录。 本 PR 增加 Diffusers 远端 repo id 自动加载能力，使 video_generate 可以直接传入远端 repo id，并且只下载 config 文件，不下载权重文件。同时补充 ModelScope remote source、aggregate repo 子目录寻址和 Web UI 支持，使体验与 text_generate 的 remote source 设计保持一致。 ------ ## 📝 Modification / 修改内容 - 新增共享 Hub helper： - Hugging Face config-only snapshot 下载 - ModelScope config-only snapshot 下载 - ModelScope 参数兼容 allow_patterns / allow_file_pattern - snapshot 下载期间隐藏进度输出和噪音日志 - 新增 Diffusers model resolver： - 本地目录保持原行为，不访问网络 - 非本地输入按 remote_source 解析 Hugging Face / ModelScope repo id - 支持 <namespace>/<repo>/<subfolder> 格式，例如：tencent/HunyuanVideo-1.5/transformer/720p_i2v_distilled_sparse - Diffusers builder 接入 resolver，并将解析后的本地路径交给现有 load_config_from_file - video_generate 两个 CLI 入口新增： - --remote-source {huggingface,modelscope} - 更新 model_id help 文案 - Web UI video_generate 表单新增 remote-source 下拉框，并纳入 task params/hash - 更新 RFC：覆盖 Hugging Face、ModelScope、子目录寻址、日志行为与测试策略 - 新增/更新离线回归测试，覆盖 Hub helper、resolver、builder、CLI help、Web UI command builder/callback/frontend workflow ------ ## 📐 Associated Test Results / 关联测试结果 Focused regression: bash .venv/bin/python -m pytest \ tests/regression/tensor_cast/test_model_hub.py \ tests/regression/tensor_cast/test_diffusers_model_resolver.py \ tests/regression/tensor_cast/test_diffusers_remote_builder.py \ tests/regression/tensor_cast/test_auto_model_config_loader.py::test_modelscope_snapshot_config_only_uses_allowlist \ tests/regression/cli/test_video_generate_remote_source.py \ tests/regression/web_ui/test_command_builder.py \ tests/regression/web_ui/test_callbacks.py \ tests/regression/web_ui/test_frontend_workflows.py -q Result: text 598 passed, 67 warnings Whitespace check: bash git diff --check Result: no output. ------ ## 🌟 Use cases (Optional) / 使用案例（可选） Hugging Face 默认来源： bash python -m cli.inference.video_generate Wan-AI/Wan2.2-T2V-A14B-Diffusers \ --device TEST_DEVICE \ --batch-size 1 \ --seq-len 128 \ --frame-num 81 \ --sample-step 1 ModelScope 来源： bash python -m cli.inference.video_generate Wan-AI/Wan2.2-T2V-A14B-Diffusers \ --remote-source modelscope \ --device TEST_DEVICE \ --batch-size 1 \ --seq-len 128 \ --frame-num 81 \ --sample-step 1 Aggregate repo 子目录： bash python -m cli.inference.video_generate tencent/HunyuanVideo-1.5/transformer/720p_i2v_distilled_sparse \ --device TEST_DEVICE \ --batch-size 1 \ --seq-len 128 \ --frame-num 121 \ --sample-step 1 ------ ## ✅ Checklist / 检查列表 **Before PR**: - [ ] Bug fixes are fully covered by unit tests, the case that causes the bug should be added in the unit tests. / 修复的 Bug 已完全由单元测试覆盖，导致 Bug 的情况应在单元测试中添加。 - [x] The modification is covered by complete unit tests. If not, please add more unit tests to ensure the correctness. / 此拉取请求中的修改已完全由单元测试覆盖。如果不是，请添加更多单元测试以确保正确性。 - [x] All relevant documentation (API docs, docstrings, example tutorials) has been updated to reflect these changes. / 所有相关文档（API 文档、文档字符串、示例教程）已更新以反映这些更改。 - [x] Please ensure code files contain no Chinese comments. / 请保证代码文件中不含中文注释。 ------ 🤖 Generated with [Claude Code](https://claude.com/claude-code) See merge request: Ascend/msmodeling!356	12 天前
test_parsers.py	修复pd ratio日志解析问题；修复表格筛选功能故障；ipv6支持 Co-authored-by: zwt<zhuweite@huawei.com> # message auto-generated for no-merge-commit merge: !346 merge master into master 修复pd ratio日志解析问题；修复表格筛选功能故障；ipv6支持 Created-by: zwt__ Commit-by: zwt Merged-by: ascend-robot Description: **PR Type / PR类型** - [ ] Feature（功能新增） - [x] Bugfix（Bug 修复） - [ ] Docs（文档更新） - [ ] CI/CD（持续集成/持续部署） - [ ] Refactor（代码重构） - [ ] Perf（性能优化） - [x] Test-Cases（测试用例更新） - [ ] Other（其他） ## 🔍 Motivation / 变更动机 本次 PR 包含两个主要改进： 1. **新增 IPv6 网络支持**：使 Web UI 能够在仅支持 IPv6 的环境中正常运行 - 解决 Gradio 框架对 IPv6 地址处理的兼容性问题 - 实现智能网络检测，自动适配 IPv4/IPv6 环境 - 支持双栈网络环境 2. **修复 Web UI 显示和解析缺陷**： - 修复 Pareto Frontier 图表显示问题 - 修复 Operator Time Analysis 筛选功能失效 - 修复 PD Ratio 模式日志解析错误 ------ ## 📝 Modification / 修改内容 ### IPv6 网络支持 1. **智能网络检测 (get_bind_address)** - 优先检测 IPv4 可用性，回退到 IPv6 - 自动选择合适的绑定地址 ### Bug 修复 1. **Pareto Frontier 图表逻辑优化** - 修改 _optimizer_pareto_chart 函数的候选点标记逻辑 - 将所有候选初始标记为"Candidate Configurations"，然后只将 rank 1（最优配置）标记为"Pareto Frontier" - 避免了之前逻辑中每个 Pareto 前沿点重复出现在两个 series 中的问题 2. **Operator Time Analysis 筛选参数解析修复** - 修复 update_op_table_from_breakdown 函数的参数解析逻辑 - 重新设计了参数解析逻辑，通过检查第3个参数的类型判断模式 - 在 simple 模式中正确从 3rd/4th/5th 参数中提取 top_n、columns、sort_by 3. **PD Ratio 模式日志解析修复** - 修改 _parse_optimizer_row 函数以处理 PD Aggregated 模式下 parallel 字段包含 | 分隔符的情况 - 实现了从后向前的工作逻辑：从末尾提取 batch_size，向前查找 num_devices，中间所有单元格构成 parallel 字段 ------ ## 📐 Associated Test Results / 关联测试结果   ------ ## ✅ Checklist / 检查列表 **Before PR**: - [x] Bug fixes are fully covered by unit tests, the case that causes the bug should be added in the unit tests. / 修复的 Bug 已完全由单元测试覆盖，导致 Bug 的情况应在单元测试中添加。 - [x] The modification is covered by complete unit tests. If not, please add more unit tests to ensure the correctness. / 此拉取请求中的修改已完全由单元测试覆盖。如果不是，请添加更多单元测试以确保正确性。 - [ ] All relevant documentation (API docs, docstrings, example tutorials) has been updated to reflect these changes. / 所有相关文档（API 文档、文档字符串、示例教程）已更新以反映这些更改。 - [x] Please ensure code files contain no Chinese comments. / 请保证代码文件中不含中文注释。 ------ See merge request: Ascend/msmodeling!346	13 天前
test_result_store.py	修复pd ratio日志解析问题；修复表格筛选功能故障；ipv6支持 Co-authored-by: zwt<zhuweite@huawei.com> # message auto-generated for no-merge-commit merge: !346 merge master into master 修复pd ratio日志解析问题；修复表格筛选功能故障；ipv6支持 Created-by: zwt__ Commit-by: zwt Merged-by: ascend-robot Description: **PR Type / PR类型** - [ ] Feature（功能新增） - [x] Bugfix（Bug 修复） - [ ] Docs（文档更新） - [ ] CI/CD（持续集成/持续部署） - [ ] Refactor（代码重构） - [ ] Perf（性能优化） - [x] Test-Cases（测试用例更新） - [ ] Other（其他） ## 🔍 Motivation / 变更动机 本次 PR 包含两个主要改进： 1. **新增 IPv6 网络支持**：使 Web UI 能够在仅支持 IPv6 的环境中正常运行 - 解决 Gradio 框架对 IPv6 地址处理的兼容性问题 - 实现智能网络检测，自动适配 IPv4/IPv6 环境 - 支持双栈网络环境 2. **修复 Web UI 显示和解析缺陷**： - 修复 Pareto Frontier 图表显示问题 - 修复 Operator Time Analysis 筛选功能失效 - 修复 PD Ratio 模式日志解析错误 ------ ## 📝 Modification / 修改内容 ### IPv6 网络支持 1. **智能网络检测 (get_bind_address)** - 优先检测 IPv4 可用性，回退到 IPv6 - 自动选择合适的绑定地址 ### Bug 修复 1. **Pareto Frontier 图表逻辑优化** - 修改 _optimizer_pareto_chart 函数的候选点标记逻辑 - 将所有候选初始标记为"Candidate Configurations"，然后只将 rank 1（最优配置）标记为"Pareto Frontier" - 避免了之前逻辑中每个 Pareto 前沿点重复出现在两个 series 中的问题 2. **Operator Time Analysis 筛选参数解析修复** - 修复 update_op_table_from_breakdown 函数的参数解析逻辑 - 重新设计了参数解析逻辑，通过检查第3个参数的类型判断模式 - 在 simple 模式中正确从 3rd/4th/5th 参数中提取 top_n、columns、sort_by 3. **PD Ratio 模式日志解析修复** - 修改 _parse_optimizer_row 函数以处理 PD Aggregated 模式下 parallel 字段包含 | 分隔符的情况 - 实现了从后向前的工作逻辑：从末尾提取 batch_size，向前查找 num_devices，中间所有单元格构成 parallel 字段 ------ ## 📐 Associated Test Results / 关联测试结果   ------ ## ✅ Checklist / 检查列表 **Before PR**: - [x] Bug fixes are fully covered by unit tests, the case that causes the bug should be added in the unit tests. / 修复的 Bug 已完全由单元测试覆盖，导致 Bug 的情况应在单元测试中添加。 - [x] The modification is covered by complete unit tests. If not, please add more unit tests to ensure the correctness. / 此拉取请求中的修改已完全由单元测试覆盖。如果不是，请添加更多单元测试以确保正确性。 - [ ] All relevant documentation (API docs, docstrings, example tutorials) has been updated to reflect these changes. / 所有相关文档（API 文档、文档字符串、示例教程）已更新以反映这些更改。 - [x] Please ensure code files contain no Chinese comments. / 请保证代码文件中不含中文注释。 ------ See merge request: Ascend/msmodeling!346	13 天前
test_runner.py	【同步】【非开发代码】代码从 develop 同步到 master Co-authored-by: yydyzr<liuyuncong1@huawei.com> Co-authored-by: gcw_61YBRfIt<chuzhenxing@huawei.com> Co-authored-by: 孔炳翔<1120200577@qq.com> Co-authored-by: zhengxinqian<qianzhengxin@huawei.com> Co-authored-by: hw_whx<wanghexiang7@huawei.com> Co-authored-by: jgong5<steven.gong@gmail.com> Co-authored-by: hw_whx<2952154980@qq.com> # message auto-generated for no-merge-commit merge: !330 merge master into master 【同步】【非开发代码】代码从 develop 同步到 master Created-by: AvadaKedavrua Commit-by: liujiawang;ascend-robot;AvadaKedavrua;lutean;Horacehxw;eveyin1;minghang_c;zwt__;tt0cool;elrond-g;jia_ya_nan;zhenyu_zhang;ChenHuiwen;wangshen001;Hudingyi;wendellX;Secluded_Ocean;jhon-117;yaohan404;jiangruitao;zhenghaojie;stormchasingg;panyj1993;cmh1056291129;yuyinkai1;sunguozhong;genius52;liu_jiaxu;HongMaoShuiGuai;zhengxinqian;weixin_43368449;jsez-li-bin;jgong5;wqh17101;w00609794;yydyzr;JieZhang679;sppedforcy;gcw_61YBRfIt;Jiong Gong;hw_whx;gongjiong;孔炳翔 Merged-by: ascend-robot Description: 代码从 develop 同步到 master，后续基于 master 演进，并支持打包 See merge request: Ascend/msmodeling!330	17 天前
test_schemas.py	【同步】【非开发代码】代码从 develop 同步到 master Co-authored-by: yydyzr<liuyuncong1@huawei.com> Co-authored-by: gcw_61YBRfIt<chuzhenxing@huawei.com> Co-authored-by: 孔炳翔<1120200577@qq.com> Co-authored-by: zhengxinqian<qianzhengxin@huawei.com> Co-authored-by: hw_whx<wanghexiang7@huawei.com> Co-authored-by: jgong5<steven.gong@gmail.com> Co-authored-by: hw_whx<2952154980@qq.com> # message auto-generated for no-merge-commit merge: !330 merge master into master 【同步】【非开发代码】代码从 develop 同步到 master Created-by: AvadaKedavrua Commit-by: liujiawang;ascend-robot;AvadaKedavrua;lutean;Horacehxw;eveyin1;minghang_c;zwt__;tt0cool;elrond-g;jia_ya_nan;zhenyu_zhang;ChenHuiwen;wangshen001;Hudingyi;wendellX;Secluded_Ocean;jhon-117;yaohan404;jiangruitao;zhenghaojie;stormchasingg;panyj1993;cmh1056291129;yuyinkai1;sunguozhong;genius52;liu_jiaxu;HongMaoShuiGuai;zhengxinqian;weixin_43368449;jsez-li-bin;jgong5;wqh17101;w00609794;yydyzr;JieZhang679;sppedforcy;gcw_61YBRfIt;Jiong Gong;hw_whx;gongjiong;孔炳翔 Merged-by: ascend-robot Description: 代码从 develop 同步到 master，后续基于 master 演进，并支持打包 See merge request: Ascend/msmodeling!330	17 天前
test_utils.py	【同步】【非开发代码】代码从 develop 同步到 master Co-authored-by: yydyzr<liuyuncong1@huawei.com> Co-authored-by: gcw_61YBRfIt<chuzhenxing@huawei.com> Co-authored-by: 孔炳翔<1120200577@qq.com> Co-authored-by: zhengxinqian<qianzhengxin@huawei.com> Co-authored-by: hw_whx<wanghexiang7@huawei.com> Co-authored-by: jgong5<steven.gong@gmail.com> Co-authored-by: hw_whx<2952154980@qq.com> # message auto-generated for no-merge-commit merge: !330 merge master into master 【同步】【非开发代码】代码从 develop 同步到 master Created-by: AvadaKedavrua Commit-by: liujiawang;ascend-robot;AvadaKedavrua;lutean;Horacehxw;eveyin1;minghang_c;zwt__;tt0cool;elrond-g;jia_ya_nan;zhenyu_zhang;ChenHuiwen;wangshen001;Hudingyi;wendellX;Secluded_Ocean;jhon-117;yaohan404;jiangruitao;zhenghaojie;stormchasingg;panyj1993;cmh1056291129;yuyinkai1;sunguozhong;genius52;liu_jiaxu;HongMaoShuiGuai;zhengxinqian;weixin_43368449;jsez-li-bin;jgong5;wqh17101;w00609794;yydyzr;JieZhang679;sppedforcy;gcw_61YBRfIt;Jiong Gong;hw_whx;gongjiong;孔炳翔 Merged-by: ascend-robot Description: 代码从 develop 同步到 master，后续基于 master 演进，并支持打包 See merge request: Ascend/msmodeling!330	17 天前
test_web_ui_start.py	修复pd ratio日志解析问题；修复表格筛选功能故障；ipv6支持 Co-authored-by: zwt<zhuweite@huawei.com> # message auto-generated for no-merge-commit merge: !346 merge master into master 修复pd ratio日志解析问题；修复表格筛选功能故障；ipv6支持 Created-by: zwt__ Commit-by: zwt Merged-by: ascend-robot Description: **PR Type / PR类型** - [ ] Feature（功能新增） - [x] Bugfix（Bug 修复） - [ ] Docs（文档更新） - [ ] CI/CD（持续集成/持续部署） - [ ] Refactor（代码重构） - [ ] Perf（性能优化） - [x] Test-Cases（测试用例更新） - [ ] Other（其他） ## 🔍 Motivation / 变更动机 本次 PR 包含两个主要改进： 1. **新增 IPv6 网络支持**：使 Web UI 能够在仅支持 IPv6 的环境中正常运行 - 解决 Gradio 框架对 IPv6 地址处理的兼容性问题 - 实现智能网络检测，自动适配 IPv4/IPv6 环境 - 支持双栈网络环境 2. **修复 Web UI 显示和解析缺陷**： - 修复 Pareto Frontier 图表显示问题 - 修复 Operator Time Analysis 筛选功能失效 - 修复 PD Ratio 模式日志解析错误 ------ ## 📝 Modification / 修改内容 ### IPv6 网络支持 1. **智能网络检测 (get_bind_address)** - 优先检测 IPv4 可用性，回退到 IPv6 - 自动选择合适的绑定地址 ### Bug 修复 1. **Pareto Frontier 图表逻辑优化** - 修改 _optimizer_pareto_chart 函数的候选点标记逻辑 - 将所有候选初始标记为"Candidate Configurations"，然后只将 rank 1（最优配置）标记为"Pareto Frontier" - 避免了之前逻辑中每个 Pareto 前沿点重复出现在两个 series 中的问题 2. **Operator Time Analysis 筛选参数解析修复** - 修复 update_op_table_from_breakdown 函数的参数解析逻辑 - 重新设计了参数解析逻辑，通过检查第3个参数的类型判断模式 - 在 simple 模式中正确从 3rd/4th/5th 参数中提取 top_n、columns、sort_by 3. **PD Ratio 模式日志解析修复** - 修改 _parse_optimizer_row 函数以处理 PD Aggregated 模式下 parallel 字段包含 | 分隔符的情况 - 实现了从后向前的工作逻辑：从末尾提取 batch_size，向前查找 num_devices，中间所有单元格构成 parallel 字段 ------ ## 📐 Associated Test Results / 关联测试结果   ------ ## ✅ Checklist / 检查列表 **Before PR**: - [x] Bug fixes are fully covered by unit tests, the case that causes the bug should be added in the unit tests. / 修复的 Bug 已完全由单元测试覆盖，导致 Bug 的情况应在单元测试中添加。 - [x] The modification is covered by complete unit tests. If not, please add more unit tests to ensure the correctness. / 此拉取请求中的修改已完全由单元测试覆盖。如果不是，请添加更多单元测试以确保正确性。 - [ ] All relevant documentation (API docs, docstrings, example tutorials) has been updated to reflect these changes. / 所有相关文档（API 文档、文档字符串、示例教程）已更新以反映这些更改。 - [x] Please ensure code files contain no Chinese comments. / 请保证代码文件中不含中文注释。 ------ See merge request: Ascend/msmodeling!346	13 天前