[Bug]: claude code 发的function call有json解析问题-MindIE-LLM-AtomGit

已关闭

[Bug]: claude code 发的function call有json解析问题 #332

gcw_V70cs4TN创建于 3月24日关闭于 3月27日

gcw_V70cs4TN

3月24日创建

在提交新问题之前，请确保您已经在社区中搜索过相关问题，并使用了社区中提供的资源/工具后，仍未找到满意的解决方式。

⚠️ 安全信息提醒：请仔细检查提供的文本内容，确保其不包含敏感数据信息，包括但不限于：

API 令牌或密钥
密码或身份验证凭证
私有网址或接口地址
个人或机密数据
...

在分享配置信息或代码示例时，请将敏感信息脱敏处理，或使用 <TOKEN> 等占位符替代原有内容。

环境信息


- 操作系统 openEuler 24.03 (LTS)
- 昇腾硬件信息 310P3
- CANN软件版本 cann 8.5.0
- 安装的对应软件版本

MindIE-LLM Version : 3.0.0.beta.1
Platform : aarch64
branch : v3.0.0.beta.1
commit id : 5e896196ce2c1ed3f14cec0a622de2072c3c75b4

🐛 问题描述

https://gitcode.com/Ascend/ModelZoo-PyTorch/blob/master/MindIE/LLM/Qwen3/Qwen3-Coder-30B-A3B/README.MD
根据该指导起服务
之后起litellm，配置模型
配置 claude code 的base url 和 sk ，发送请求
无法进行正常请求
报错如下：

[2026-03-23 16:54:21.212364] [22609] [localhost] [10.90.184.174:41734] [server] [Request mindie server, method=POST, uri is /v1/chat/completions] [success]
[2026-03-23 16:54:21.212381] [22609] [30589] [server] [INFO] [http_server.cpp:134] [endpoint] Receive request from 10.90.184.174:41734 ,method=POST, uri is /v1/chat/completions
[2026-03-23 16:54:21.214779] [22609] [30589] [server] [INFO] [infer_instances.cpp:655] [infer_instance] Start HandleLora
[2026-03-23 16:54:21.217053] [22609] [30589] [server] [ERROR] [safe_io.cpp:86] [MIE04E02040E] [endpoint] Failed to parse json: depth is 11, object is 16
[2026-03-23 16:54:21.217062] [22609] [30589] [server] [ERROR] [safe_io.cpp:86] [MIE04E02040E] [endpoint] Failed to parse json: depth is 12, object is 16
[2026-03-23 16:54:21.217069] [22609] [30589] [server] [ERROR] [safe_io.cpp:86] [MIE04E02040E] [endpoint] Failed to parse json: depth is 12, object is 16
[2026-03-23 16:54:21.217081] [22609] [30589] [server] [ERROR] [safe_io.cpp:86] [MIE04E02040E] [endpoint] Failed to parse json: depth is 12, object is 16
[2026-03-23 16:54:21.217086] [22609] [30589] [server] [ERROR] [safe_io.cpp:86] [MIE04E02040E] [endpoint] Failed to parse json: depth is 11, object is 16
[2026-03-23 16:54:21,221] [29241] [281468699845760] [tokenizer] [WARN] [tokenizer.py-368] : [Tokenizer]	>>> Exception:Expecting value: line 1 column 57346 (char 57345)
[2026-03-23 16:54:21.222071] [22609] [30589] [server] [ERROR] [single_req_vllm_openai_infer_interface.cpp:728] [MIE04E020407] [endpoint] Messages token length must be in (0, 1048576], but got 0. This could be caused by invalid input format or empty content.
[2026-03-23 16:54:21.222114] [22609] [30589] [server] [ERROR] [single_req_infer_interface_base.cpp:375] [MIE04E020407] [endpoint] Messages token length must be in (0, 1048576], but got 0. This could be caused by invalid input format or empty content.. The requestId is endpoint_common_100
[2026-03-23 16:54:21.222264] [22609] [localhost] [10.44.198.222:8199] [server] [Response mindie server, method=POST, uri is /v1/chat/completions] [status code: 422]
[2026-03-23 16:54:21.222280] [22609] [30589] [server] [INFO] [http_server.cpp:151] [endpoint] Http receive response from 10.44.198.222:8199, status code is 422, body len 170
[2026-03-23 16:54:21.232595] [22609] [localhost] [10.90.184.174:41748] [server] [Request mindie server, method=POST, uri is /v1/chat/completions] [success]
[2026-03-23 16:54:21.232604] [22609] [30591] [server] [INFO] [http_server.cpp:134] [endpoint] Receive request from 10.90.184.174:41748 ,method=POST, uri is /v1/chat/completions
[2026-03-23 16:54:21.234927] [22609] [30591] [server] [INFO] [infer_instances.cpp:655] [infer_instance] Start HandleLora
[2026-03-23 16:54:21.237170] [22609] [30591] [server] [ERROR] [safe_io.cpp:86] [MIE04E02040E] [endpoint] Failed to parse json: depth is 11, object is 16
[2026-03-23 16:54:21.237187] [22609] [30591] [server] [ERROR] [safe_io.cpp:86] [MIE04E02040E] [endpoint] Failed to parse json: depth is 12, object is 16
[2026-03-23 16:54:21.237190] [22609] [30591] [server] [ERROR] [safe_io.cpp:86] [MIE04E02040E] [endpoint] Failed to parse json: depth is 12, object is 16
[2026-03-23 16:54:21.237194] [22609] [30591] [server] [ERROR] [safe_io.cpp:86] [MIE04E02040E] [endpoint] Failed to parse json: depth is 12, object is 16
[2026-03-23 16:54:21.237198] [22609] [30591] [server] [ERROR] [safe_io.cpp:86] [MIE04E02040E] [endpoint] Failed to parse json: depth is 11, object is 16
[2026-03-23 16:54:21,241] [29243] [281468699845760] [tokenizer] [WARN] [tokenizer.py-368] : [Tokenizer]	>>> Exception:Expecting value: line 1 column 57346 (char 57345)
[2026-03-23 16:54:21.242185] [22609] [30591] [server] [ERROR] [single_req_vllm_openai_infer_interface.cpp:728] [MIE04E020407] [endpoint] Messages token length must be in (0, 1048576], but got 0. This could be caused by invalid input format or empty content.
[2026-03-23 16:54:21.242236] [22609] [30591] [server] [ERROR] [single_req_infer_interface_base.cpp:375] [MIE04E020407] [endpoint] Messages token length must be in (0, 1048576], but got 0. This could be caused by invalid input format or empty content.. The requestId is endpoint_common_101
[2026-03-23 16:54:21.242389] [22609] [localhost] [10.44.198.222:8199] [server] [Response mindie server, method=POST, uri is /v1/chat/completions] [status code: 422]
[2026-03-23 16:54:21.242396] [22609] [30591] [server] [INFO] [http_server.cpp:151] [endpoint] Http receive response from 10.44.198.222:8199, status code is 422, body len 170
[2026-03-23 16:54:21.976875] [22609] [localhost] [10.90.184.174:41758] [server] [Request mindie server, method=POST, uri is /v1/chat/completions] [success]
[2026-03-23 16:54:21.976914] [22609] [30593] [server] [INFO] [http_server.cpp:134] [endpoint] Receive request from 10.90.184.174:41758 ,method=POST, uri is /v1/chat/completions
[2026-03-23 16:54:21.979484] [22609] [30593] [server] [INFO] [infer_instances.cpp:655] [infer_instance] Start HandleLora
[2026-03-23 16:54:21.982311] [22609] [30593] [server] [ERROR] [safe_io.cpp:86] [MIE04E02040E] [endpoint] Failed to parse json: depth is 11, object is 16
[2026-03-23 16:54:21.982386] [22609] [30593] [server] [ERROR] [safe_io.cpp:86] [MIE04E02040E] [endpoint] Failed to parse json: depth is 12, object is 16
[2026-03-23 16:54:21.982411] [22609] [30593] [server] [ERROR] [safe_io.cpp:86] [MIE04E02040E] [endpoint] Failed to parse json: depth is 12, object is 16
[2026-03-23 16:54:21.982414] [22609] [30593] [server] [ERROR] [safe_io.cpp:86] [MIE04E02040E] [endpoint] Failed to parse json: depth is 12, object is 16
[2026-03-23 16:54:21.982452] [22609] [30593] [server] [ERROR] [safe_io.cpp:86] [MIE04E02040E] [endpoint] Failed to parse json: depth is 11, object is 16
[2026-03-23 16:54:21,988] [29245] [281468699845760] [tokenizer] [WARN] [tokenizer.py-368] : [Tokenizer]	>>> Exception:Expecting value: line 1 column 57346 (char 57345)
[2026-03-23 16:54:21.988659] [22609] [30593] [server] [ERROR] [single_req_vllm_openai_infer_interface.cpp:728] [MIE04E020407] [endpoint] Messages token length must be in (0, 1048576], but got 0. This could be caused by invalid input format or empty content.
[2026-03-23 16:54:21.988739] [22609] [30593] [server] [ERROR] [single_req_infer_interface_base.cpp:375] [MIE04E020407] [endpoint] Messages token length must be in (0, 1048576], but got 0. This could be caused by invalid input format or empty content.. The requestId is endpoint_common_102
[2026-03-23 16:54:21.989008] [22609] [localhost] [10.44.198.222:8199] [server] [Response mindie server, method=POST, uri is /v1/chat/completions] [status code: 422]
[2026-03-23 16:54:21.989032] [22609] [30593] [server] [INFO] [http_server.cpp:151] [endpoint] Http receive response from 10.44.198.222:8199, status code is 422, body len 170
[2026-03-23 16:54:21.999695] [22609] [localhost] [10.90.184.174:41770] [server] [Request mindie server, method=POST, uri is /v1/chat/completions] [success]
[2026-03-23 16:54:21.999725] [22609] [30595] [server] [INFO] [http_server.cpp:134] [endpoint] Receive request from 10.90.184.174:41770 ,method=POST, uri is /v1/chat/completions
[2026-03-23 16:54:22.002214] [22609] [30595] [server] [INFO] [infer_instances.cpp:655] [infer_instance] Start HandleLora
[2026-03-23 16:54:22.004991] [22609] [30595] [server] [ERROR] [safe_io.cpp:86] [MIE04E02040E] [endpoint] Failed to parse json: depth is 11, object is 16
[2026-03-23 16:54:22.005018] [22609] [30595] [server] [ERROR] [safe_io.cpp:86] [MIE04E02040E] [endpoint] Failed to parse json: depth is 12, object is 16
[2026-03-23 16:54:22.005052] [22609] [30595] [server] [ERROR] [safe_io.cpp:86] [MIE04E02040E] [endpoint] Failed to parse json: depth is 12, object is 16
[2026-03-23 16:54:22.005055] [22609] [30595] [server] [ERROR] [safe_io.cpp:86] [MIE04E02040E] [endpoint] Failed to parse json: depth is 12, object is 16
[2026-03-23 16:54:22.005060] [22609] [30595] [server] [ERROR] [safe_io.cpp:86] [MIE04E02040E] [endpoint] Failed to parse json: depth is 11, object is 16
[2026-03-23 16:54:22,010] [29247] [281468699845760] [tokenizer] [WARN] [tokenizer.py-368] : [Tokenizer]	>>> Exception:Expecting value: line 1 column 57346 (char 57345)
[2026-03-23 16:54:22.010446] [22609] [30595] [server] [ERROR] [single_req_vllm_openai_infer_interface.cpp:728] [MIE04E020407] [endpoint] Messages token length must be in (0, 1048576], but got 0. This could be caused by invalid input format or empty content.
[2026-03-23 16:54:22.010525] [22609] [30595] [server] [ERROR] [single_req_infer_interface_base.cpp:375] [MIE04E020407] [endpoint] Messages token length must be in (0, 1048576], but got 0. This could be caused by invalid input format or empty content.. The requestId is endpoint_common_103

抓包请求返回如下

^¬Q«EÒå@@À}
,ÆÞ
Z¸® ÁÈó(;éëPS×{"error":"Messages token length must be in (0, 1048576], but got 0. This could be caused by invalid input format or empty content.","error_type":"Input Validation Error"}

欢迎加入社区，感谢您对社区的贡献 🎉!