您好,这个问题可能是因为您CANN包版本比较旧导致,请替换最新版本的CANN
8.2Rc1可以吗,需要更新驱动吗?


可以的,重新source一下
qwen3系列问题请先自检cann包版本
1、请根据(内部客户)https://cmc-szv.clouddragon.huawei.com/cmcversion/index/releaseView?deltaId=12969651207537920&isSelect=Software这个链接 下载最新版本的cann
(外部客户T18 MindIE镜像或社区镜像/CANN包 https://www.hiascend.com/developer/download/community/result?module=cann)
2、source set_env.sh
3、cd msit/msmodelslim 重新 bash install.sh


可以的,重新source一下
qwen3系列问题请先自检cann包版本
1、请根据(内部客户)https://cmc-szv.clouddragon.huawei.com/cmcversion/index/releaseView?deltaId=12969651207537920&isSelect=Software这个链接 下载最新版本的cann
(外部客户T18 MindIE镜像或社区镜像/CANN包 https://www.hiascend.com/developer/download/community/result?module=cann)
2、source set_env.sh
3、cd msit/msmodelslim 重新 bash install.sh
目前更新成 CANN 8.2RC1,MindIE 2.1RC1,Decode速度从11.5token/s到16.7token/s。这个量化的期望加速应该是2倍以上?


以及更新后原本的print_log信息都消失了,并且大量警告,应该如何才能让log信息输出?
The old environment variable ATB_LOG_TO_STDOUT will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_TO_STDOUT as soon as possible.
The old environment variable ATB_LOG_LEVEL will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_LEVEL as soon as possible.
The old environment variable MINDIE_LLM_LOG_LEVEL will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_LEVEL as soon as possible.
The old environment variable MINDIE_LLM_PYTHON_LOG_TO_STDOUT will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_TO_STDOUT as soon as possible.
The old environment variable MINDIE_LLM_LOG_TO_STDOUT will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_TO_STDOUT as soon as possible.
The old environment variable MINDIE_LLM_PYTHON_LOG_PATH will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_PATH as soon as possible.
The old environment variable ATB_LOG_TO_FILE will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_TO_FILE as soon as possible


尊敬的用户,您好!由于工单长时间未收到您的响应,现暂为关闭。感谢您对 msModelSlim 开源生态的贡献!后续如有疑问,欢迎随时重新提问。


Thanks for sending an issue! Please fill in the following template to help quickly solve your problem.
Describe the current behavior / 问题描述 (Mandatory / 必填)
RT,在310p上量化Qwen2.5-7b-Instruct时出现报错:
TypeError: fake_quantize_save() got an unexpected keyword argument 'max_bound'
Environment / 环境信息 (Mandatory / 必填)
310P 在mindie容器内操作
CANN 8.0.0,MindIE 1.0.0 和 ATB-Models 1.0.0
Steps to reproduce the issue / 重现步骤 (Mandatory / 必填)
bash examples/models/qwen/convert_quant_weight.sh -src /models/Qwen2.5-7B-Instruct -dst /models/Qwen2.5-7B-W8A8 -type qwen_w8a8Describe the expected behavior / 预期结果 (Mandatory / 必填)
正确量化
Related log / screenshot / 日志 / 截图 (Mandatory / 必填)
Special notes for this issue/备注 (Optional / 选填)