使用p2p池化模式，controller控制中心，Threads页报错-LMCache-Ascend-AtomGit

已关闭

使用p2p池化模式，controller控制中心，Threads页报错 #8

江叶根创建于 9月10日关闭于 9月22日

江叶根成员

9月10日创建

【缺陷描述】：请补充详细的缺陷问题现象描述

使用p2p池化模式，controller控制中心，Threads页报错

一、缺陷信息

Thread: <_MainThread(MainThread, started 281472933787328)>
Stack trace:
File "/usr/local/python3.11.14/bin/lmcache_controller", line 6, in
sys.exit(main())
File "/usr/local/python3.11.14/lib/python3.11/site-packages/lmcache/v1/api_server/main.py", line 528, in main
uvicorn.run(app, host=config.controller_host, port=config.controller_port)
File "/usr/local/python3.11.14/lib/python3.11/site-packages/uvicorn/main.py", line 606, in run
server.run()
File "/usr/local/python3.11.14/lib/python3.11/site-packages/uvicorn/server.py", line 75, in run
return asyncio_run(self.serve(sockets=sockets), loop_factory=self.config.get_loop_factory())
File "/usr/local/python3.11.14/lib/python3.11/site-packages/uvicorn/_compat.py", line 30, in asyncio_run
return runner.run(main)
File "/usr/local/python3.11.14/lib/python3.11/asyncio/runners.py", line 118, in run
return self._loop.run_until_complete(task)
File "/usr/local/python3.11.14/lib/python3.11/site-packages/uvicorn/protocols/http/httptools_impl.py", line 416, in run_asgi
result = await app( # type: ignore[func-returns-value]
File "/usr/local/python3.11.14/lib/python3.11/site-packages/uvicorn/middleware/proxy_headers.py", line 60, in call
return await self.app(scope, receive, send)
File "/usr/local/python3.11.14/lib/python3.11/site-packages/fastapi/applications.py", line 1139, in call
await super().call(scope, receive, send)
File "/usr/local/python3.11.14/lib/python3.11/site-packages/starlette/applications.py", line 107, in call
await self.middleware_stack(scope, receive, send)
File "/usr/local/python3.11.14/lib/python3.11/site-packages/starlette/middleware/errors.py", line 164, in call
await self.app(scope, receive, _send)
File "/usr/local/python3.11.14/lib/python3.11/site-packages/starlette/middleware/exceptions.py", line 63, in call
await wrap_app_handling_exceptions(self.app, conn)(scope, receive, send)
File "/usr/local/python3.11.14/lib/python3.11/site-packages/starlette/_exception_handler.py", line 42, in wrapped_app
await app(scope, receive, sender)
File "/usr/local/python3.11.14/lib/python3.11/site-packages/fastapi/middleware/asyncexitstack.py", line 18, in call
await self.app(scope, receive, send)
File "/usr/local/python3.11.14/lib/python3.11/site-packages/starlette/routing.py", line 716, in call
await self.middleware_stack(scope, receive, send)
File "/usr/local/python3.11.14/lib/python3.11/site-packages/starlette/routing.py", line 736, in app
await route.handle(scope, receive, send)
File "/usr/local/python3.11.14/lib/python3.11/site-packages/starlette/routing.py", line 290, in handle
await self.app(scope, receive, send)
File "/usr/local/python3.11.14/lib/python3.11/site-packages/fastapi/routing.py", line 119, in app
await wrap_app_handling_exceptions(app, request)(scope, receive, send)
File "/usr/local/python3.11.14/lib/python3.11/site-packages/starlette/_exception_handler.py", line 42, in wrapped_app
await app(scope, receive, sender)
File "/usr/local/python3.11.14/lib/python3.11/site-packages/fastapi/routing.py", line 105, in app
response = await f(request)
File "/usr/local/python3.11.14/lib/python3.11/site-packages/fastapi/routing.py", line 385, in app
raw_response = await run_endpoint_function(
File "/usr/local/python3.11.14/lib/python3.11/site-packages/fastapi/routing.py", line 284, in run_endpoint_function
return await dependant.call(**values)
File "/usr/local/python3.11.14/lib/python3.11/site-packages/lmcache/v1/internal_api_server/common/thread_api.py", line 48, in get_threads
stack_trace = traceback.format_stack(stack_frames)

=== Thread Summary ===
Total threads: 1

【缺陷所属的os版本】

openEuler 26.09 (DevStation)

【内核版本】

【缺陷所属软件及版本号】

LMCache-Ascend-0.4.4-1.oe2403next.aarch64

【环境信息】

LMCache-Ascend-0.4.4-1.oe2403next.aarch64

【问题复现步骤】

启动带有vllm+lmcache的docker
进入docker环境
启动lmcache_controller
拉起P2P池化的服务
等待大模型启动成功
查看controller控制中心是否正常

【实际结果】

Threads页报错

【期望结果】

各数据正常显示

【其他相关附件信息】

【缺陷详情及分析指导参考链接】

二、缺陷分析结构反馈
影响性分析说明：

缺陷严重等级:(Critical/High/Moderate/Low)

缺陷根因说明:

受影响版本排查(受影响/不受影响):
openEuler-20.03-LTS-SP4
openEuler-22.03-LTS-SP4
openEuler-24.03-LTS-SP1
openEuler-24.03-LTS-SP3
openEuler-24.03-LTS-SP4

修复是否涉及abi变化(是/否):
openEuler-20.03-LTS-SP4
openEuler-22.03-LTS-SP4
openEuler-24.03-LTS-SP1
openEuler-24.03-LTS-SP3
openEuler-24.03-LTS-SP4

openeuler-ci-bot成员

9月10日将 chloroethylene 设为负责人

openeuler-ci-bot成员

9月10日修改了issue 的描述

openeuler-ci-bot成员

9月10日将 puier、juntianlinux、duyiwei7w、sinever、luanjianhai 设为负责人

openeuler-ci-bot成员

9月10日评论：

以下的要求不是强制性的, 未按模板评论时对issue无任何影响
issue处理注意事项:
1. 当前issue受影响的分支提交pr时, 须在pr描述中填写当前issue编号进行关联, 否则无法关闭当前issue;
2. 模板内容需要填写完整, 无论是受影响或者不受影响都需要填写完整内容,未引入的分支不需要填写, 否则无法关闭当前issue;
3. 以下为模板中需要填写完整的内容, 请复制到评论区回复, 注: 内容的标题名称(影响性分析说明, 缺陷严重等级, 受影响版本排查(受影响/不受影响), 修复是否涉及abi变化(是/否))不能省略,省略后defect-manager将无法正常解析填写内容.
评论区可能使用到的指令说明:

指令	指令说明	使用权限
/check-issue	触发defect-manager校验	不限
/reason xxx	/reason +挂起或取消条件	不限

影响性分析说明:

缺陷严重等级:(Critical/High/Moderate/Low)

缺陷根因说明:

受影响版本排查(受影响/不受影响):

openEuler-20.03-LTS-SP4:
openEuler-22.03-LTS-SP4:
openEuler-24.03-LTS-SP1:
openEuler-24.03-LTS-SP3:
openEuler-24.03-LTS-SP4:

abi变化(是/否):

openEuler-20.03-LTS-SP4:
openEuler-22.03-LTS-SP4:
openEuler-24.03-LTS-SP1:
openEuler-24.03-LTS-SP3:
openEuler-24.03-LTS-SP4:

缺陷issue处理具体操作请参考:
https://atomgit.com/openeuler/cve-manager/blob/master/cve-vulner-manager/doc/md/defect-manager-manual.md
pr关联issue具体操作请参考:
https://docs.atomgit.com/docs/help/home/org_project/pullrequests/pr-related-issue

openeuler-ci-bot成员

9月10日添加了label：sig/sig-Long

openeuler-ci-bot成员

9月10日添加了label：DEFECT/UNFIXED

openeuler-ci-bot成员

9月10日评论：

Welcome To openEuler Community

Hey @puier , thanks for your contribution to the community.

Bot Usage Manual

I'm the Bot here serving you. You can find the instructions on how to interact with me at Here . That means you can comment below every pull request or issue to trigger Bot Commands. You can self-configure the PR merge rules for this repository. For more details, please refer to Here.