Thanks for sending an requirement! Please fill in the following template to help quickly solve your problem.
ClippedSwiglu算子新增clamp_mode属性,用于控制clamp和silu计算的顺序,满足部分模型需要将clamp操作后移的需求
内部团队
Thanks for sending an requirement! Please fill in the following template to help quickly solve your problem.
Backgroud(背景信息)
ClippedSwiglu算子新增clamp_mode属性,用于控制clamp和silu计算的顺序,满足部分模型需要将clamp操作后移的需求
Origin(信息来源)
内部团队
Benefit / Necessity (价值/作用)
Design(设计方案)