Thanks for sending an requirement! Please fill in the following template to help quickly solve your problem.
通过在各层 Params / Kernel 接口中新增 scalesGM 参数实现int8量化输出,适配算子对应场景
海思昇腾解决方案
确保int8输出场景tensor api模板支持
Thanks for sending an requirement! Please fill in the following template to help quickly solve your problem.
Backgroud(背景信息)
通过在各层 Params / Kernel 接口中新增 scalesGM 参数实现int8量化输出,适配算子对应场景
Origin(信息来源)
海思昇腾解决方案
Benefit / Necessity (价值/作用)
确保int8输出场景tensor api模板支持
Design(设计方案)