Thanks for sending an issue! Please fill in the following template to help quickly solve your problem.
norm_rope_concat和norm_rope_concat_grad中的uint_32可能溢出
A2/A3
norm_rope_concat和norm_rope_concat_grad中的uint_32再数据量大的时候可能溢出
使用uint64规避可能溢出风险
无
/assign @huyihang1117
Thanks for sending an issue! Please fill in the following template to help quickly solve your problem.
Describe the current behavior / 问题描述 (Mandatory / 必填)
norm_rope_concat和norm_rope_concat_grad中的uint_32可能溢出
Environment / 环境信息 (Mandatory / 必填)
A2/A3
Steps to reproduce the issue / 重现步骤 (Mandatory / 必填)
norm_rope_concat和norm_rope_concat_grad中的uint_32再数据量大的时候可能溢出
Describe the expected behavior / 预期结果 (Mandatory / 必填)
使用uint64规避可能溢出风险
Related log / screenshot / 日志 / 截图 (Mandatory / 必填)
无
Special notes for this issue/备注 (Optional / 选填)