master

cann-robot【feat】feat multi block_size in cache management

48a59dc0创建于 3 天前历史提交

文件	最后提交记录	最后更新时间
kv_transfer	【feat】feat multi block_size in cache management	3 天前
scheduler	【feat】feat multi block_size in cache management	3 天前
__init__.py	refactor: 支持online多batch推理	1 个月前
bootstrap.py	【feat】feat multi block_size in cache management	3 天前
constants.py	refactor: 支持online多batch推理	1 个月前
dp_dispatcher.py	refactor: 支持online多batch推理	1 个月前
online_inference.py	[docs] add framwork checklist	26 天前
requirements.txt	[refactor]修改online依赖CPU通信域初始化流程	1 个月前
router.py	refactor: 支持online多batch推理	1 个月前
server.py	[feat] mooncake + hixl, import, support models lazy import	27 天前