Star22
29
代码
代码
Issues2
Pull Requests7
项目讨论
Wiki
分析
Star22
29
已开启
update workloads of GELU #93
帧徳仕霓鸭创建于 8月3日
update workloads of GELU #93
已开启
帧徳仕霓鸭创建于 8月3日
从shiniya/ascendc-kernelgen-datamaster1合入到Ascend/ascendc-kernelgen-datamaster
共 1 个文件变更+50-50
Mnpu-kernelbench/data/kernel_generator/level1/GELU/workload.jsonl+50-50
@@ -1,50 +1,50 @@
1-{"uuid":"GELU-001","axes":null,"inputs":{"x":{"type":"random","shape":[128],"dtype":"float32"},"approximate":{"type":"scalar","value":"none"}}}1+{"uuid": "GELU-001", "axes": null, "inputs": {"x": {"type": "random", "shape": [128], "dtype": "float32"}, "approximate": {"type": "scalar", "value": "none"}}}
2-{"uuid":"GELU-002","axes":null,"inputs":{"x":{"type":"random","shape":[256],"dtype":"float32"},"approximate":{"type":"scalar","value":"tanh"}}}2+{"uuid": "GELU-002", "axes": null, "inputs": {"x": {"type": "random", "shape": [1024], "dtype": "float32"}, "approximate": {"type": "scalar", "value": "tanh"}}}
3-{"uuid":"GELU-003","axes":null,"inputs":{"x":{"type":"random","shape":[512],"dtype":"float32"},"approximate":{"type":"scalar","value":"none"}}}3+{"uuid": "GELU-003", "axes": null, "inputs": {"x": {"type": "random", "shape": [512, 512], "dtype": "float16"}, "approximate": {"type": "scalar", "value": "none"}}}
4-{"uuid":"GELU-004","axes":null,"inputs":{"x":{"type":"random","shape":[1024],"dtype":"float32"},"approximate":{"type":"scalar","value":"tanh"}}}4+{"uuid": "GELU-004", "axes": null, "inputs": {"x": {"type": "random", "shape": [1024, 1024], "dtype": "float16"}, "approximate": {"type": "scalar", "value": "tanh"}}}
5-{"uuid":"GELU-005","axes":null,"inputs":{"x":{"type":"random","shape":[2048],"dtype":"float32"},"approximate":{"type":"scalar","value":"none"}}}5+{"uuid": "GELU-005", "axes": null, "inputs": {"x": {"type": "random", "shape": [100, 100], "dtype": "bfloat16"}, "approximate": {"type": "scalar", "value": "none"}}}
6-{"uuid":"GELU-006","axes":null,"inputs":{"x":{"type":"random","shape":[4096],"dtype":"float32"},"approximate":{"type":"scalar","value":"tanh"}}}6+{"uuid": "GELU-006", "axes": null, "inputs": {"x": {"type": "random", "shape": [4096, 4096], "dtype": "float16"}, "approximate": {"type": "scalar", "value": "none"}}}
7-{"uuid":"GELU-007","axes":null,"inputs":{"x":{"type":"random","shape":[128,128],"dtype":"float16"},"approximate":{"type":"scalar","value":"none"}}}7+{"uuid": "GELU-007", "axes": null, "inputs": {"x": {"type": "random", "shape": [8192, 2048], "dtype": "float16"}, "approximate": {"type": "scalar", "value": "tanh"}}}
8-{"uuid":"GELU-008","axes":null,"inputs":{"x":{"type":"random","shape":[256,256],"dtype":"float16"},"approximate":{"type":"scalar","value":"tanh"}}}8+{"uuid": "GELU-008", "axes": null, "inputs": {"x": {"type": "random", "shape": [256, 256, 192], "dtype": "float16"}, "approximate": {"type": "scalar", "value": "none"}}}
9-{"uuid":"GELU-009","axes":null,"inputs":{"x":{"type":"random","shape":[512,512],"dtype":"float16"},"approximate":{"type":"scalar","value":"none"}}}9+{"uuid": "GELU-009", "axes": null, "inputs": {"x": {"type": "random", "shape": [16384, 2048], "dtype": "float16"}, "approximate": {"type": "scalar", "value": "tanh"}}}
10-{"uuid":"GELU-010","axes":null,"inputs":{"x":{"type":"random","shape":[1024,1024],"dtype":"float16"},"approximate":{"type":"scalar","value":"tanh"}}}10+{"uuid": "GELU-010", "axes": null, "inputs": {"x": {"type": "random", "shape": [4096, 2048], "dtype": "float32"}, "approximate": {"type": "scalar", "value": "none"}}}
11-{"uuid":"GELU-011","axes":null,"inputs":{"x":{"type":"random","shape":[64,64],"dtype":"bfloat16"},"approximate":{"type":"scalar","value":"none"}}}11+{"uuid": "GELU-011", "axes": null, "inputs": {"x": {"type": "random", "shape": [8192, 1024], "dtype": "float32"}, "approximate": {"type": "scalar", "value": "tanh"}}}
12-{"uuid":"GELU-012","axes":null,"inputs":{"x":{"type":"random","shape":[32,32],"dtype":"bfloat16"},"approximate":{"type":"scalar","value":"tanh"}}}12+{"uuid": "GELU-012", "axes": null, "inputs": {"x": {"type": "random", "shape": [6144, 2048], "dtype": "float32"}, "approximate": {"type": "scalar", "value": "none"}}}
13-{"uuid":"GELU-013","axes":null,"inputs":{"x":{"type":"random","shape":[128,256],"dtype":"float32"},"approximate":{"type":"scalar","value":"none"}}}13+{"uuid": "GELU-013", "axes": null, "inputs": {"x": {"type": "random", "shape": [12288, 2048], "dtype": "float32"}, "approximate": {"type": "scalar", "value": "tanh"}}}
14-{"uuid":"GELU-014","axes":null,"inputs":{"x":{"type":"random","shape":[256,512],"dtype":"float32"},"approximate":{"type":"scalar","value":"tanh"}}}14+{"uuid": "GELU-014", "axes": null, "inputs": {"x": {"type": "random", "shape": [8192, 4096], "dtype": "bfloat16"}, "approximate": {"type": "scalar", "value": "none"}}}
15-{"uuid":"GELU-015","axes":null,"inputs":{"x":{"type":"random","shape":[512,1024],"dtype":"float32"},"approximate":{"type":"scalar","value":"none"}}}15+{"uuid": "GELU-015", "axes": null, "inputs": {"x": {"type": "random", "shape": [12288, 3072], "dtype": "bfloat16"}, "approximate": {"type": "scalar", "value": "tanh"}}}
16-{"uuid":"GELU-016","axes":null,"inputs":{"x":{"type":"random","shape":[1024,2048],"dtype":"float32"},"approximate":{"type":"scalar","value":"tanh"}}}16+{"uuid": "GELU-016", "axes": null, "inputs": {"x": {"type": "random", "shape": [16384, 8192], "dtype": "float16"}, "approximate": {"type": "scalar", "value": "none"}}}
17-{"uuid":"GELU-017","axes":null,"inputs":{"x":{"type":"random","shape":[64,64,64],"dtype":"float16"},"approximate":{"type":"scalar","value":"tanh"}}}17+{"uuid": "GELU-017", "axes": null, "inputs": {"x": {"type": "random", "shape": [24576, 4096], "dtype": "float16"}, "approximate": {"type": "scalar", "value": "tanh"}}}
18-{"uuid":"GELU-018","axes":null,"inputs":{"x":{"type":"random","shape":[32,32,32],"dtype":"float16"},"approximate":{"type":"scalar","value":"none"}}}18+{"uuid": "GELU-018", "axes": null, "inputs": {"x": {"type": "random", "shape": [32768, 3072], "dtype": "float16"}, "approximate": {"type": "scalar", "value": "none"}}}
19-{"uuid":"GELU-019","axes":null,"inputs":{"x":{"type":"random","shape":[16,16,16],"dtype":"float16"},"approximate":{"type":"scalar","value":"tanh"}}}19+{"uuid": "GELU-019", "axes": null, "inputs": {"x": {"type": "random", "shape": [16384, 6144], "dtype": "float16"}, "approximate": {"type": "scalar", "value": "tanh"}}}
20-{"uuid":"GELU-020","axes":null,"inputs":{"x":{"type":"random","shape":[128,64,32],"dtype":"bfloat16"},"approximate":{"type":"scalar","value":"none"}}}20+{"uuid": "GELU-020", "axes": null, "inputs": {"x": {"type": "random", "shape": [512, 256, 800], "dtype": "float16"}, "approximate": {"type": "scalar", "value": "none"}}}
21-{"uuid":"GELU-021","axes":null,"inputs":{"x":{"type":"random","shape":[64,32,16],"dtype":"bfloat16"},"approximate":{"type":"scalar","value":"tanh"}}}21+{"uuid": "GELU-021", "axes": null, "inputs": {"x": {"type": "random", "shape": [11264, 6144], "dtype": "float32"}, "approximate": {"type": "scalar", "value": "tanh"}}}
22-{"uuid":"GELU-022","axes":null,"inputs":{"x":{"type":"random","shape":[16,16,16,16],"dtype":"float32"},"approximate":{"type":"scalar","value":"tanh"}}}22+{"uuid": "GELU-022", "axes": null, "inputs": {"x": {"type": "random", "shape": [16384, 4096], "dtype": "float32"}, "approximate": {"type": "scalar", "value": "none"}}}
23-{"uuid":"GELU-023","axes":null,"inputs":{"x":{"type":"random","shape":[8,8,8,8],"dtype":"float32"},"approximate":{"type":"scalar","value":"none"}}}23+{"uuid": "GELU-023", "axes": null, "inputs": {"x": {"type": "random", "shape": [24576, 2048], "dtype": "float32"}, "approximate": {"type": "scalar", "value": "tanh"}}}
24-{"uuid":"GELU-024","axes":null,"inputs":{"x":{"type":"random","shape":[1,16,64,64],"dtype":"float32"},"approximate":{"type":"scalar","value":"none"}}}24+{"uuid": "GELU-024", "axes": null, "inputs": {"x": {"type": "random", "shape": [8192, 8192], "dtype": "float32"}, "approximate": {"type": "scalar", "value": "none"}}}
25-{"uuid":"GELU-025","axes":null,"inputs":{"x":{"type":"random","shape":[1,3,224,224],"dtype":"float32"},"approximate":{"type":"scalar","value":"tanh"}}}25+{"uuid": "GELU-025", "axes": null, "inputs": {"x": {"type": "random", "shape": [10240, 6144], "dtype": "float32"}, "approximate": {"type": "scalar", "value": "tanh"}}}
26-{"uuid":"GELU-026","axes":null,"inputs":{"x":{"type":"random","shape":[1,64,56,56],"dtype":"float32"},"approximate":{"type":"scalar","value":"none"}}}26+{"uuid": "GELU-026", "axes": null, "inputs": {"x": {"type": "random", "shape": [16384, 8192], "dtype": "bfloat16"}, "approximate": {"type": "scalar", "value": "none"}}}
27-{"uuid":"GELU-027","axes":null,"inputs":{"x":{"type":"random","shape":[2,64,56,56],"dtype":"float32"},"approximate":{"type":"scalar","value":"tanh"}}}27+{"uuid": "GELU-027", "axes": null, "inputs": {"x": {"type": "random", "shape": [24576, 4096], "dtype": "bfloat16"}, "approximate": {"type": "scalar", "value": "tanh"}}}
28-{"uuid":"GELU-028","axes":null,"inputs":{"x":{"type":"random","shape":[4,64,56,56],"dtype":"float16"},"approximate":{"type":"scalar","value":"none"}}}28+{"uuid": "GELU-028", "axes": null, "inputs": {"x": {"type": "random", "shape": [16384, 6144], "dtype": "bfloat16"}, "approximate": {"type": "scalar", "value": "none"}}}
29-{"uuid":"GELU-029","axes":null,"inputs":{"x":{"type":"random","shape":[1,128,28,28],"dtype":"float16"},"approximate":{"type":"scalar","value":"tanh"}}}29+{"uuid": "GELU-029", "axes": null, "inputs": {"x": {"type": "random", "shape": [12288, 8192], "dtype": "bfloat16"}, "approximate": {"type": "scalar", "value": "tanh"}}}
30-{"uuid":"GELU-030","axes":null,"inputs":{"x":{"type":"random","shape":[1,256,14,14],"dtype":"bfloat16"},"approximate":{"type":"scalar","value":"none"}}}30+{"uuid": "GELU-030", "axes": null, "inputs": {"x": {"type": "random", "shape": [20480, 5120], "dtype": "bfloat16"}, "approximate": {"type": "scalar", "value": "none"}}}
31-{"uuid":"GELU-031","axes":null,"inputs":{"x":{"type":"random","shape":[1,512,7,7],"dtype":"bfloat16"},"approximate":{"type":"scalar","value":"tanh"}}}31+{"uuid": "GELU-031", "axes": null, "inputs": {"x": {"type": "random", "shape": [28672, 4096], "dtype": "float16"}, "approximate": {"type": "scalar", "value": "tanh"}}}
32-{"uuid":"GELU-032","axes":null,"inputs":{"x":{"type":"random","shape":[4096,18432],"dtype":"float32"},"approximate":{"type":"scalar","value":"none"}}}32+{"uuid": "GELU-032", "axes": null, "inputs": {"x": {"type": "random", "shape": [16, 512, 512, 18], "dtype": "float16"}, "approximate": {"type": "scalar", "value": "none"}}}
33-{"uuid":"GELU-033","axes":null,"inputs":{"x":{"type":"random","shape":[4096,24576],"dtype":"bfloat16"},"approximate":{"type":"scalar","value":"tanh"}}}33+{"uuid": "GELU-033", "axes": null, "inputs": {"x": {"type": "random", "shape": [18432, 6144], "dtype": "float16"}, "approximate": {"type": "scalar", "value": "tanh"}}}
34-{"uuid":"GELU-034","axes":null,"inputs":{"x":{"type":"random","shape":[8192,16384],"dtype":"float16"},"approximate":{"type":"scalar","value":"none"}}}34+{"uuid": "GELU-034", "axes": null, "inputs": {"x": {"type": "random", "shape": [9216, 6144], "dtype": "float32"}, "approximate": {"type": "scalar", "value": "tanh"}}}
35-{"uuid":"GELU-035","axes":null,"inputs":{"x":{"type":"random","shape":[2048,13824],"dtype":"float32"},"approximate":{"type":"scalar","value":"tanh"}}}35+{"uuid": "GELU-035", "axes": null, "inputs": {"x": {"type": "random", "shape": [13312, 5120], "dtype": "float32"}, "approximate": {"type": "scalar", "value": "none"}}}
36-{"uuid":"GELU-036","axes":null,"inputs":{"x":{"type":"random","shape":[100],"dtype":"float32"},"approximate":{"type":"scalar","value":"none"}}}36+{"uuid": "GELU-036", "axes": null, "inputs": {"x": {"type": "random", "shape": [16384, 12288], "dtype": "float16"}, "approximate": {"type": "scalar", "value": "none"}}}
37-{"uuid":"GELU-037","axes":null,"inputs":{"x":{"type":"random","shape":[18432],"dtype":"float32"},"approximate":{"type":"scalar","value":"tanh"}}}37+{"uuid": "GELU-037", "axes": null, "inputs": {"x": {"type": "random", "shape": [32768, 6144], "dtype": "float16"}, "approximate": {"type": "scalar", "value": "tanh"}}}
38-{"uuid":"GELU-038","axes":null,"inputs":{"x":{"type":"random","shape":[100,2007],"dtype":"float16"},"approximate":{"type":"scalar","value":"none"}}}38+{"uuid": "GELU-038", "axes": null, "inputs": {"x": {"type": "random", "shape": [24576, 8192], "dtype": "float16"}, "approximate": {"type": "scalar", "value": "none"}}}
39-{"uuid":"GELU-039","axes":null,"inputs":{"x":{"type":"random","shape":[17,301],"dtype":"float16"},"approximate":{"type":"scalar","value":"tanh"}}}39+{"uuid": "GELU-039", "axes": null, "inputs": {"x": {"type": "random", "shape": [32768, 8192], "dtype": "float16"}, "approximate": {"type": "scalar", "value": "tanh"}}}
40-{"uuid":"GELU-040","axes":null,"inputs":{"x":{"type":"random","shape":[13,2117],"dtype":"bfloat16"},"approximate":{"type":"scalar","value":"none"}}}40+{"uuid": "GELU-040", "axes": null, "inputs": {"x": {"type": "random", "shape": [16384, 16384], "dtype": "float16"}, "approximate": {"type": "scalar", "value": "none"}}}
41-{"uuid":"GELU-041","axes":null,"inputs":{"x":{"type":"random","shape":[7,15,23],"dtype":"float32"},"approximate":{"type":"scalar","value":"tanh"}}}41+{"uuid": "GELU-041", "axes": null, "inputs": {"x": {"type": "random", "shape": [16384, 12288], "dtype": "float32"}, "approximate": {"type": "scalar", "value": "tanh"}}}
42-{"uuid":"GELU-042","axes":null,"inputs":{"x":{"type":"random","shape":[11,19,29],"dtype":"float32"},"approximate":{"type":"scalar","value":"none"}}}42+{"uuid": "GELU-042", "axes": null, "inputs": {"x": {"type": "random", "shape": [24576, 8192], "dtype": "float32"}, "approximate": {"type": "scalar", "value": "none"}}}
43-{"uuid":"GELU-043","axes":null,"inputs":{"x":{"type":"random","shape":[3,5,7,11],"dtype":"float16"},"approximate":{"type":"scalar","value":"tanh"}}}43+{"uuid": "GELU-043", "axes": null, "inputs": {"x": {"type": "random", "shape": [32768, 4096], "dtype": "float32"}, "approximate": {"type": "scalar", "value": "tanh"}}}
44-{"uuid":"GELU-044","axes":null,"inputs":{"x":{"type":"random","shape":[1,7,13,17],"dtype":"float16"},"approximate":{"type":"scalar","value":"none"}}}44+{"uuid": "GELU-044", "axes": null, "inputs": {"x": {"type": "random", "shape": [16384, 16384], "dtype": "bfloat16"}, "approximate": {"type": "scalar", "value": "none"}}}
45-{"uuid":"GELU-045","axes":null,"inputs":{"x":{"type":"random","shape":[1,5,111,111],"dtype":"bfloat16"},"approximate":{"type":"scalar","value":"tanh"}}}45+{"uuid": "GELU-045", "axes": null, "inputs": {"x": {"type": "random", "shape": [24576, 8192], "dtype": "bfloat16"}, "approximate": {"type": "scalar", "value": "tanh"}}}
46-{"uuid":"GELU-046","axes":null,"inputs":{"x":{"type":"random","shape":[2,33,55,77],"dtype":"bfloat16"},"approximate":{"type":"scalar","value":"none"}}}46+{"uuid": "GELU-046", "axes": null, "inputs": {"x": {"type": "random", "shape": [32768, 6144], "dtype": "bfloat16"}, "approximate": {"type": "scalar", "value": "none"}}}
47-{"uuid":"GELU-047","axes":null,"inputs":{"x":{"type":"random","shape":[1,13,65,65],"dtype":"float32"},"approximate":{"type":"scalar","value":"tanh"}}}47+{"uuid": "GELU-047", "axes": null, "inputs": {"x": {"type": "random", "shape": [16384, 12288], "dtype": "bfloat16"}, "approximate": {"type": "scalar", "value": "tanh"}}}
48-{"uuid":"GELU-048","axes":null,"inputs":{"x":{"type":"random","shape":[1,11,113,113],"dtype":"float32"},"approximate":{"type":"scalar","value":"none"}}}48+{"uuid": "GELU-048", "axes": null, "inputs": {"x": {"type": "random", "shape": [32768, 8192], "dtype": "bfloat16"}, "approximate": {"type": "scalar", "value": "none"}}}
49-{"uuid":"GELU-049","axes":null,"inputs":{"x":{"type":"random","shape":[123,6144],"dtype":"float16"},"approximate":{"type":"scalar","value":"tanh"}}}49+{"uuid": "GELU-049", "axes": null, "inputs": {"x": {"type": "random", "shape": [4096, 4096, 16], "dtype": "float16"}, "approximate": {"type": "scalar", "value": "tanh"}}}
50-{"uuid":"GELU-050","axes":null,"inputs":{"x":{"type":"random","shape":[789,12288],"dtype":"float16"},"approximate":{"type":"scalar","value":"none"}}}50+{"uuid": "GELU-050", "axes": null, "inputs": {"x": {"type": "random", "shape": [8, 2048, 2048, 8], "dtype": "float32"}, "approximate": {"type": "scalar", "value": "none"}}}
atomgit-bot
atomgit-botatomgit-bot8月4日

🟡 Medium Priority

changed line → affected behavior/contract → failure mode → suggested fix

变更内容：该 diff 将所有 50 条 GELU workload 的 shape、dtype、approximate 参数全部替换为全新值，但 UUID（GELU-001 ~ GELU-050）保持不变。

影响的契约：Workload 模型中 uuid 字段文档明确标注为 "Unique identifier for this workload configuration"。UUID 是实现 workload 身份稳定性的核心契约。

失效模式：--resume 恢复逻辑（cli/main.py 第 259-263 行 _filter_workloads）使用 (definition_name, solution_name, uuid) 三元组作为已完成 workload 的身份键。当用户先运行一次 benchmark 后，再更新 workload.jsonl 并使用 --resume 重新运行时，系统会将旧 benchmark 结果（基于旧 shape/dtype/approximate）错误地匹配到新 workload 上，导致：

  1. 新 workload 被跳过不执行；
  2. 报告中展示的是旧 workload 的性能数据（错误的 latency/speedup）；
  3. profile 目录 {uuid}_ref / {uuid}_sol 可能被旧数据覆盖或混淆。

触发条件：用户在同一 session 中或输出文件保留时，先运行旧 workload、更新 workload.jsonl、再 --resume 运行。

建议：将所有 UUID 更新为与旧序列不重叠的新编号（如 GELU-051 ~ GELU-100），或在 PR 中明确标注为 breaking change 并要求用户清理 --resume 输出。如果 workload 参数发生任何变化，UUID 必须同步变化以维护其作为唯一标识符的契约。

likedislike
不准确？