| 文件 | 最后提交记录 | 最后更新时间 |
|---|---|---|
[Feat] Add initial CRD support for production stack (#415) * add CRD support for production stack Signed-off-by: royyhuang <roy.y.huang@gmail.com> * move opertor to a secondary dir instead of in root dir Signed-off-by: royyhuang <roy.y.huang@gmail.com> * rename api group from serving.vllm.ai to production-stack.vllm.ai Signed-off-by: royyhuang <roy.y.huang@gmail.com> * enable lmcache cpu offloading Signed-off-by: royyhuang <roy.y.huang@gmail.com> * enable lmcache remote cache server offloading Signed-off-by: royyhuang <roy.y.huang@gmail.com> * fix service discorvery issue by adding readiness probe to vllm pod Signed-off-by: royyhuang <roy.y.huang@gmail.com> * fix readiness probe Signed-off-by: royyhuang <roy.y.huang@gmail.com> --------- Signed-off-by: royyhuang <roy.y.huang@gmail.com> | 1 年前 | |
[Feat] Add initial CRD support for production stack (#415) * add CRD support for production stack Signed-off-by: royyhuang <roy.y.huang@gmail.com> * move opertor to a secondary dir instead of in root dir Signed-off-by: royyhuang <roy.y.huang@gmail.com> * rename api group from serving.vllm.ai to production-stack.vllm.ai Signed-off-by: royyhuang <roy.y.huang@gmail.com> * enable lmcache cpu offloading Signed-off-by: royyhuang <roy.y.huang@gmail.com> * enable lmcache remote cache server offloading Signed-off-by: royyhuang <roy.y.huang@gmail.com> * fix service discorvery issue by adding readiness probe to vllm pod Signed-off-by: royyhuang <roy.y.huang@gmail.com> * fix readiness probe Signed-off-by: royyhuang <roy.y.huang@gmail.com> --------- Signed-off-by: royyhuang <roy.y.huang@gmail.com> | 1 年前 |