| [Feat] Add initial CRD support for production stack (#415) * add CRD support for production stack Signed-off-by: royyhuang <roy.y.huang@gmail.com> * move opertor to a secondary dir instead of in root dir Signed-off-by: royyhuang <roy.y.huang@gmail.com> * rename api group from serving.vllm.ai to production-stack.vllm.ai Signed-off-by: royyhuang <roy.y.huang@gmail.com> * enable lmcache cpu offloading Signed-off-by: royyhuang <roy.y.huang@gmail.com> * enable lmcache remote cache server offloading Signed-off-by: royyhuang <roy.y.huang@gmail.com> * fix service discorvery issue by adding readiness probe to vllm pod Signed-off-by: royyhuang <roy.y.huang@gmail.com> * fix readiness probe Signed-off-by: royyhuang <roy.y.huang@gmail.com> --------- Signed-off-by: royyhuang <roy.y.huang@gmail.com> | 1 年前 |