master

ascend-robot【infer-operator】router example retrieved from vllm-ascend

84646ffe创建于 3月17日历史提交

文件	最后提交记录	最后更新时间
load_balance_proxy_layerwise_server_example.py	【infer-operator】router example retrieved from vllm-ascend Co-authored-by: hujianrong<hujianrong5@huawei.com> Co-authored-by: xushuhuan<xushuhuan1@huawei.com>	3 个月前
pull_engine.py	【infer-operator】一键部署推理服务-引擎与router启动部分 Co-authored-by: hujianrong<hujianrong5@huawei.com> Co-authored-by: xushuhuan<xushuhuan1@huawei.com>	3 个月前
run_router.py	【infer-operator】一键部署推理服务-引擎与router启动部分 Co-authored-by: hujianrong<hujianrong5@huawei.com> Co-authored-by: xushuhuan<xushuhuan1@huawei.com>	3 个月前
start.py	【infer-operator】一键部署推理服务-引擎与router启动部分 Co-authored-by: hujianrong<hujianrong5@huawei.com> Co-authored-by: xushuhuan<xushuhuan1@huawei.com>	3 个月前
user_config_loader.py	【infer-operator】一键部署推理服务-引擎与router启动部分 Co-authored-by: hujianrong<hujianrong5@huawei.com> Co-authored-by: xushuhuan<xushuhuan1@huawei.com>	3 个月前
utils.py	【infer-operator】一键部署推理服务-引擎与router启动部分 Co-authored-by: hujianrong<hujianrong5@huawei.com> Co-authored-by: xushuhuan<xushuhuan1@huawei.com>	3 个月前