Closed
补全 LayerNorm/LayerNormV3 golden 并对齐空归一化输出语义 #8336
rkAdd on 16 days agoClosed at 16 days ago
16 days ago Added label: requirement
16 days ago Assign wangpengbo26 as responsible person
16 days ago Close issue
16 days ago changed custom state from 待办的 to 已完成
15 days ago Added label: resolved
一、背景信息
LayerNorm(V1)与 LayerNormV3 缺少
tests/assets/golden.py,对应 Kernel/GEIR 用例无法加载参考实现。现有 AddLayerNorm / InplaceAddLayerNorm golden 也存在覆盖缺口:AddLayerNorm 仅按最后一维归一化、固定返回 x 输出、dtype 规则仅参考 x1;InplaceAddLayerNorm 在空归一化维度将 mean 填为 NaN,且additional_output=false时丢掉可选输出槽位。二、价值/作用
三、设计方案
norm/layer_norm/tests/assets/golden.py与norm/layer_norm_v3/tests/assets/golden.py,注册__golden__/__spec__,FP64 计算、统计量 dtype 跟随 gamma,epsilon 分别取 1e-12 / 1e-5;gamma.shape决定,按 x1/x2 dtype 提升选择累积与输出 dtype,空归一化维度输出 y 空/mean=0/rstd=NaN,additional_output=false返回 None 槽位;additional_output=false返回四元组并补 None;third_partytorch 对照用于自校验。关联 PR:https://gitcode.com/cann/ops-nn/pull/13856