Thanks for sending an requirement! Please fill in the following template to help quickly solve your problem.
fused_causal_conv1d A5性能优化
对比A3的大batch场景,性能劣化。
将x和y的ub分开,convstate计算分成In和Out两块ub,数据先搬到In中再拷贝给Out,In进行卷积,out搬出,去除前后的依赖,使得vf流水和mte3流水并行。
Thanks for sending an requirement! Please fill in the following template to help quickly solve your problem.
Backgroud(背景信息)
fused_causal_conv1d A5性能优化
Benefit / Necessity (价值/作用)
对比A3的大batch场景,性能劣化。
Design(设计方案)
将x和y的ub分开,convstate计算分成In和Out两块ub,数据先搬到In中再拷贝给Out,In进行卷积,out搬出,去除前后的依赖,使得vf流水和mte3流水并行。