| 文件 | 最后提交记录 | 最后更新时间 |
|---|---|---|
refactor: 迁移 StanfordBench 到 bench_lab/stanford_bench，移除 thirdparty 目录 Co-authored-by: Developer user<suyueming@huawei.com> # message auto-generated for no-merge-commit merge: !124 merge master into master refactor: 迁移 StanfordBench 到 bench_lab/stanford_bench，移除 thirdparty 目录 Created-by: su-yueming Commit-by: Developer user Merged-by: cann-robot Description: ## 变更描述 / Description 1. baseline 数据迁移 - 将 tasks/ 和 bench_lab/ 下所有 cases.yaml 中的 baseline_perf_us/t_hw_us 字段剥离，数据集中存储到各评测集 metadata/910b2.json - 删除 data/stanford_baseline.json，StanfordBench baseline 改由 bench_lab/stanford_bench/metadata/910b2.json 加载 - 新增 scripts/migrate_baseline_to_data.py 迁移工具脚本 2. src 代码变更 - __init__.py: 版本号改为动态读取（_version.py → VERSION 文件） - perf_strategy.py: KernelDetailsStrategy 以 kernel_details.csv 为唯一权威源， 不再 fallback 到 trace_view；TraceViewStrategy 标注待收编 - cann_loader.py: 集成 BaselineStore，baseline 优先从 JSON 查询 - stanford_loader.py: baseline 改由 BaselineStore 加载，移除 _load_baseline - report 模块: 微调 HTML/MD 报告和 setup_info 输出 3. 新增文件 - tasks/metadata/910b2.json + VERSION - bench_lab/*/metadata/910b2.json (cv_agent_bench, kernel_bench, pypto_cann_bench, stanford_bench) - pyproject.toml, VERSION (根目录), _version.py, test_version_consistency.py - docs/design/micro_benchmark_selection.md, module_panorama.md - docs/guide/version_policy.md 4. tests 更新 - test_benchmark_pipeline: 适配 baseline 迁移 - test_cases_yaml_csv_consistency: 新增 metadata JSON 与 cases.yaml 一致性校验 - test_version_consistency: 版本号一致性测试 1. 新增 PLATFORM_ALIAS 和 resolve_hardware() - 在 baseline_resolver.py 中添加产品型号→逻辑名映射表 - 支持精确匹配（Ascend910_9362 → 910b2）和前缀匹配（Ascend310P* → 310p） - 最长前缀优先，避免短 key 误匹配 - BaselineStore/BaselineResolver/__init__ 统一调用 resolve_hardware - has_baseline_for/resolve_baseline_us 内部自动解析硬件名 - 导出 resolve_hardware 和 PLATFORM_ALIAS 至 utils/__init__.py 2. 将 examples/eval_task → examples/tasks - 按 tasks/ 结构重构：add → level2/add, sqrt → level1/sqrt - 新增 metadata/910b2.json（fixture baseline，值均为 0.0 placeholder） - 新增 metadata/VERSION - 新增 cases.csv（与生产 tasks 格式一致） - 重写 README.md（目录结构、路径引用） - 更新 docs/guide/quick_start.md 和根 README.md 的路径引用 - 删除旧 examples/eval_task/ 目录 - 移动 scripts/download_benchmarks.sh → bench_lab/stanford_bench/download.sh， 下载目标从 thirdparty/KernelBench 改为 bench_lab/stanford_bench/KernelBench 将 direct_launch_example 从仅支持 910B 扩展为支持多种 SOC， 与 aclnn_launch_example 的多 SOC 能力对齐。 <!-- 本 PR 做了什么，为什么需要 / What does this PR do and why --> [#31](https://gitcode.com/cann/cann-bench/issues/31) ## 改动类型 / Change Type - [ ] Bug 修复 / Bug Fix - [ ] 新功能 / New Feature - [ ] 性能优化 / Performance - [x] 代码重构 / Refactoring - [ ] 文档更新 / Documentation - [ ] 测试相关 / Test - [ ] 其它 / Other ## 关联 Issue / Related Issues <!-- Closes #000 可自动关闭 / Closes #000 to auto-close --> - Closes # - References # ## 测试信息 / Testing <!-- 简要测试说明或关键结果 / Brief test description or key results --> - [ ] 单元测试通过 / UT passed - [ ] 集成测试通过 / ST passed - [ ] 人工验证通过 / Manual verified ## 检查清单 / Checklist - [ ] 代码符合规范 / Code follows style guide - [ ] 测试添加并通过 / Tests added and passed - [ ] 文档已更新 / Docs updated if needed - [ ] 无硬编码敏感信息 / No secrets hardcoded - [ ] 提交信息符合规范 / Commit message follows convention See merge request: cann/cann-bench!124 | 1 个月前 | |
refactor: 迁移 StanfordBench 到 bench_lab/stanford_bench，移除 thirdparty 目录 Co-authored-by: Developer user<suyueming@huawei.com> # message auto-generated for no-merge-commit merge: !124 merge master into master refactor: 迁移 StanfordBench 到 bench_lab/stanford_bench，移除 thirdparty 目录 Created-by: su-yueming Commit-by: Developer user Merged-by: cann-robot Description: ## 变更描述 / Description 1. baseline 数据迁移 - 将 tasks/ 和 bench_lab/ 下所有 cases.yaml 中的 baseline_perf_us/t_hw_us 字段剥离，数据集中存储到各评测集 metadata/910b2.json - 删除 data/stanford_baseline.json，StanfordBench baseline 改由 bench_lab/stanford_bench/metadata/910b2.json 加载 - 新增 scripts/migrate_baseline_to_data.py 迁移工具脚本 2. src 代码变更 - __init__.py: 版本号改为动态读取（_version.py → VERSION 文件） - perf_strategy.py: KernelDetailsStrategy 以 kernel_details.csv 为唯一权威源， 不再 fallback 到 trace_view；TraceViewStrategy 标注待收编 - cann_loader.py: 集成 BaselineStore，baseline 优先从 JSON 查询 - stanford_loader.py: baseline 改由 BaselineStore 加载，移除 _load_baseline - report 模块: 微调 HTML/MD 报告和 setup_info 输出 3. 新增文件 - tasks/metadata/910b2.json + VERSION - bench_lab/*/metadata/910b2.json (cv_agent_bench, kernel_bench, pypto_cann_bench, stanford_bench) - pyproject.toml, VERSION (根目录), _version.py, test_version_consistency.py - docs/design/micro_benchmark_selection.md, module_panorama.md - docs/guide/version_policy.md 4. tests 更新 - test_benchmark_pipeline: 适配 baseline 迁移 - test_cases_yaml_csv_consistency: 新增 metadata JSON 与 cases.yaml 一致性校验 - test_version_consistency: 版本号一致性测试 1. 新增 PLATFORM_ALIAS 和 resolve_hardware() - 在 baseline_resolver.py 中添加产品型号→逻辑名映射表 - 支持精确匹配（Ascend910_9362 → 910b2）和前缀匹配（Ascend310P* → 310p） - 最长前缀优先，避免短 key 误匹配 - BaselineStore/BaselineResolver/__init__ 统一调用 resolve_hardware - has_baseline_for/resolve_baseline_us 内部自动解析硬件名 - 导出 resolve_hardware 和 PLATFORM_ALIAS 至 utils/__init__.py 2. 将 examples/eval_task → examples/tasks - 按 tasks/ 结构重构：add → level2/add, sqrt → level1/sqrt - 新增 metadata/910b2.json（fixture baseline，值均为 0.0 placeholder） - 新增 metadata/VERSION - 新增 cases.csv（与生产 tasks 格式一致） - 重写 README.md（目录结构、路径引用） - 更新 docs/guide/quick_start.md 和根 README.md 的路径引用 - 删除旧 examples/eval_task/ 目录 - 移动 scripts/download_benchmarks.sh → bench_lab/stanford_bench/download.sh， 下载目标从 thirdparty/KernelBench 改为 bench_lab/stanford_bench/KernelBench 将 direct_launch_example 从仅支持 910B 扩展为支持多种 SOC， 与 aclnn_launch_example 的多 SOC 能力对齐。 <!-- 本 PR 做了什么，为什么需要 / What does this PR do and why --> [#31](https://gitcode.com/cann/cann-bench/issues/31) ## 改动类型 / Change Type - [ ] Bug 修复 / Bug Fix - [ ] 新功能 / New Feature - [ ] 性能优化 / Performance - [x] 代码重构 / Refactoring - [ ] 文档更新 / Documentation - [ ] 测试相关 / Test - [ ] 其它 / Other ## 关联 Issue / Related Issues <!-- Closes #000 可自动关闭 / Closes #000 to auto-close --> - Closes # - References # ## 测试信息 / Testing <!-- 简要测试说明或关键结果 / Brief test description or key results --> - [ ] 单元测试通过 / UT passed - [ ] 集成测试通过 / ST passed - [ ] 人工验证通过 / Manual verified ## 检查清单 / Checklist - [ ] 代码符合规范 / Code follows style guide - [ ] 测试添加并通过 / Tests added and passed - [ ] 文档已更新 / Docs updated if needed - [ ] 无硬编码敏感信息 / No secrets hardcoded - [ ] 提交信息符合规范 / Commit message follows convention See merge request: cann/cann-bench!124 | 1 个月前 | |
fix(tasks): align operator prototypes across desc.md, proto.yaml, and golden.py Co-authored-by: Developer user<suyueming@huawei.com> # message auto-generated for no-merge-commit merge: !101 merge master into master fix(tasks): align operator prototypes across desc.md, proto.yaml, and golden.py Created-by: su-yueming Commit-by: Developer user Merged-by: cann-robot Description: ## 变更描述 / Description <!-- 本 PR 做了什么，为什么需要 / What does this PR do and why --> Fix 24 inconsistencies across 19 operators: - Missing default values in prototypes (exp, masked_scale, rms_norm, softmax, gru, lstm) - Parameter name mismatches (roi_align, cross_entropy_loss) - Incorrect parameter ordering (gru, lstm) - Inconsistent function names (mla_prolog) - Missing critical code (depthwise_conv_2d weight unsqueeze) - Type inconsistencies (grouped_matmul return type, grouped_matmul_swiglu_quant group_list) - Unused parameters (quant_matmul group_sizes) - Code body divergences (mish, apply_rotary_pos_emb, engram_gate_fusion) ## 改动类型 / Change Type [#14](https://gitcode.com/cann/cann-bench/issues/14) [#15](https://gitcode.com/cann/cann-bench/issues/15) - [x] Bug 修复 / Bug Fix - [ ] 新功能 / New Feature - [ ] 性能优化 / Performance - [ ] 代码重构 / Refactoring - [ ] 文档更新 / Documentation - [ ] 测试相关 / Test - [ ] 其它 / Other ## 关联 Issue / Related Issues <!-- Closes #000 可自动关闭 / Closes #000 to auto-close --> - Closes # - References # ## 测试信息 / Testing <!-- 简要测试说明或关键结果 / Brief test description or key results --> - [ ] 单元测试通过 / UT passed - [ ] 集成测试通过 / ST passed - [ ] 人工验证通过 / Manual verified ## 检查清单 / Checklist - [ ] 代码符合规范 / Code follows style guide - [ ] 测试添加并通过 / Tests added and passed - [ ] 文档已更新 / Docs updated if needed - [ ] 无硬编码敏感信息 / No secrets hardcoded - [ ] 提交信息符合规范 / Commit message follows convention See merge request: cann/cann-bench!101 | 1 个月前 | |
refactor: rename kernel_bench/ → tasks/; level1-4 yaml parsing fixes; baseline_perf_us fills; kernel_eval evolution; docs/scripts sync Co-authored-by: gxj1123<gao.xuejian1@huawei.com> # message auto-generated for no-merge-commit merge: !62 merge refactor/kernel-bench-to-tasks into master refactor: rename kernel_bench/ → tasks/; level1-4 yaml parsing fixes; baseline_perf_us fills; kernel_eval evolution; docs/scripts sync Created-by: gxj1123 Commit-by: gxj1123 Merged-by: cann-robot Description: **308 files, +2679 / -1562.** The big move is renaming ** kernel_bench/ → tasks/** to reflect that the tree holds evaluation tasks (operator tasks for now, with room for model tasks alongside later). git tracks the move as R100 renames for 204 unchanged files; the remaining 64 files inside the renamed tree pick up content updates as listed below. ### Highlights - **level1 YAML parsing** — bare .inf / .nan tokens, none / null strings, and scientific notation now parse correctly across exp / foreach_addcdiv_scalar / foreach_norm / gelu / masked_scale / mish / sigmoid / swi_glu. Older PyYAML versions silently treated some of these as strings, poisoning downstream dtype handling. - **level2** — extend the YAML-parsing fix to remaining cases; group_norm / maximum / gcd case_16 — proto/cases consistency + desc broadcast rules + input_fail repair. - **level3** — large content sweep: - moe_finalize_routing — baseline_perf_us applied, ref + shape/range fixes after the code-review pass - transpose — cases refreshed to Attention BSHD ↔ BHSD patterns; 20/20 baselines benched - depthwise_conv_2d — spec corrected to the depthwise academic definition (depthwise = conv2d with groups=Cin, weight [Cin,1,kH,kW]) - dequant_swiglu_quant / dynamic_quant / moe_gating_top_k_softmax / grid_sampler_3d — smaller golden/case adjustments - **level4** — attention bench tightening + grouped_matmul_swiglu_quant spec follow-ups. - **src/kernel_eval** — evolution pass: process_pool flow refinements, precision spec touch-ups, cli/config polish, accuracy_eval bug fixes. tests/unit grows with new pytest cases (test_path_resolver, test_summarize_results); run_simple.py refreshed. - **docs** — new design notes (kernel_eval_architecture, cases_yaml_spec); evaluator_design / multi_card_parallel_analysis / perf_collection refreshed; guide/contributing + quick_start reworded; README scoring formula wording. - **scripts** — run_test.sh / run_evaluation.sh / run_ut.sh + README brought in line with the multi-card pool flow and the renamed task tree. - **examples** — aclnn_launch_example + direct_launch_example content refreshed. - **.gitignore** — covers new artifact paths produced by the harness. ### Note on the rename The new tasks/ name keeps the same levelN/<op>/ layout under it, so any code or CI that references kernel_bench/... needs a path update. The evaluator CLI / configs in src/kernel_eval have been updated accordingly. See merge request: cann/cann-bench!62 | 2 个月前 | |
refactor: rename kernel_bench/ → tasks/; level1-4 yaml parsing fixes; baseline_perf_us fills; kernel_eval evolution; docs/scripts sync Co-authored-by: gxj1123<gao.xuejian1@huawei.com> # message auto-generated for no-merge-commit merge: !62 merge refactor/kernel-bench-to-tasks into master refactor: rename kernel_bench/ → tasks/; level1-4 yaml parsing fixes; baseline_perf_us fills; kernel_eval evolution; docs/scripts sync Created-by: gxj1123 Commit-by: gxj1123 Merged-by: cann-robot Description: **308 files, +2679 / -1562.** The big move is renaming ** kernel_bench/ → tasks/** to reflect that the tree holds evaluation tasks (operator tasks for now, with room for model tasks alongside later). git tracks the move as R100 renames for 204 unchanged files; the remaining 64 files inside the renamed tree pick up content updates as listed below. ### Highlights - **level1 YAML parsing** — bare .inf / .nan tokens, none / null strings, and scientific notation now parse correctly across exp / foreach_addcdiv_scalar / foreach_norm / gelu / masked_scale / mish / sigmoid / swi_glu. Older PyYAML versions silently treated some of these as strings, poisoning downstream dtype handling. - **level2** — extend the YAML-parsing fix to remaining cases; group_norm / maximum / gcd case_16 — proto/cases consistency + desc broadcast rules + input_fail repair. - **level3** — large content sweep: - moe_finalize_routing — baseline_perf_us applied, ref + shape/range fixes after the code-review pass - transpose — cases refreshed to Attention BSHD ↔ BHSD patterns; 20/20 baselines benched - depthwise_conv_2d — spec corrected to the depthwise academic definition (depthwise = conv2d with groups=Cin, weight [Cin,1,kH,kW]) - dequant_swiglu_quant / dynamic_quant / moe_gating_top_k_softmax / grid_sampler_3d — smaller golden/case adjustments - **level4** — attention bench tightening + grouped_matmul_swiglu_quant spec follow-ups. - **src/kernel_eval** — evolution pass: process_pool flow refinements, precision spec touch-ups, cli/config polish, accuracy_eval bug fixes. tests/unit grows with new pytest cases (test_path_resolver, test_summarize_results); run_simple.py refreshed. - **docs** — new design notes (kernel_eval_architecture, cases_yaml_spec); evaluator_design / multi_card_parallel_analysis / perf_collection refreshed; guide/contributing + quick_start reworded; README scoring formula wording. - **scripts** — run_test.sh / run_evaluation.sh / run_ut.sh + README brought in line with the multi-card pool flow and the renamed task tree. - **examples** — aclnn_launch_example + direct_launch_example content refreshed. - **.gitignore** — covers new artifact paths produced by the harness. ### Note on the rename The new tasks/ name keeps the same levelN/<op>/ layout under it, so any code or CI that references kernel_bench/... needs a path update. The evaluator CLI / configs in src/kernel_eval have been updated accordingly. See merge request: cann/cann-bench!62 | 2 个月前 |
| 文件 | 最后提交记录 | 最后更新时间 |
|---|---|---|
| 1 个月前 | ||
| 1 个月前 | ||
| 1 个月前 | ||
| 2 个月前 | ||
| 2 个月前 |