| 文件 | 最后提交记录 | 最后更新时间 |
|---|---|---|
[bugfix] deprecate disable log request (#885) * bugfix: deprecate disable log request Signed-off-by: Rui Zhang <zrfishnoodles@gmail.com> * Update helm/README.md Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com> Signed-off-by: Rui Zhang <51696593+ruizhang0101@users.noreply.github.com> --------- Signed-off-by: Rui Zhang <zrfishnoodles@gmail.com> Signed-off-by: Rui Zhang <51696593+ruizhang0101@users.noreply.github.com> Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com> | 6 个月前 | |
bump up and use a simplified image. (#698) bump up otel col bump up otel col Signed-off-by: Jared Tan <jian.tan@daocloud.io> | 1 年前 | |
trigger Signed-off-by: Shaoting Feng <shaotingf@uchicago.edu> | 1 年前 | |
[Document, Feat] basic HPA support and tutorials (#209) * [Add] basic HPA support and tutorials Signed-off-by: ApostaC <yihua98@uchicago.edu> * fix shellcheck errors Signed-off-by: ApostaC <yihua98@uchicago.edu> --------- Signed-off-by: ApostaC <yihua98@uchicago.edu> | 1 年前 | |
[Document, Feat] basic HPA support and tutorials (#209) * [Add] basic HPA support and tutorials Signed-off-by: ApostaC <yihua98@uchicago.edu> * fix shellcheck errors Signed-off-by: ApostaC <yihua98@uchicago.edu> --------- Signed-off-by: ApostaC <yihua98@uchicago.edu> | 1 年前 | |
[helm] document every values, udpate json schema and various fix (#886) * fix(helm) update sharedPvcStorage so it correctly create PVC and/or PV Signed-off-by: enneitex <etienne.divet@gmail.com> * fix(helm) various fix to align values, templates and README. update json schema Signed-off-by: enneitex <etienne.divet@gmail.com> * fix(helm) use correct type for lmcacheControllerPort Signed-off-by: enneitex <etienne.divet@gmail.com> * fix(helm) rayCluster: fix templating and add tests Signed-off-by: enneitex <etienne.divet@gmail.com> * fix(helm) deployment-router: simplify templating and add tests Signed-off-by: enneitex <etienne.divet@gmail.com> * feat(helm) improve schema, add tests and CI validation Signed-off-by: enneitex <etienne.divet@gmail.com> feat(helm) improve testing around rayCluster and engine deployment Signed-off-by: enneitex <etienne.divet@gmail.com> ci: retrigger Signed-off-by: enneitex <etienne.divet@gmail.com> fix(tutorials) rename ScaledObject file name Signed-off-by: enneitex <etienne.divet@gmail.com> fix pre-commit Signed-off-by: enneitex <etienne.divet@gmail.com> --------- Signed-off-by: enneitex <etienne.divet@gmail.com> Co-authored-by: Rui Zhang <51696593+ruizhang0101@users.noreply.github.com> | 5 个月前 | |
[Add] yamls for tutorial 3 | 1 年前 | |
[bugfix] deprecate disable log request (#885) * bugfix: deprecate disable log request Signed-off-by: Rui Zhang <zrfishnoodles@gmail.com> * Update helm/README.md Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com> Signed-off-by: Rui Zhang <51696593+ruizhang0101@users.noreply.github.com> --------- Signed-off-by: Rui Zhang <zrfishnoodles@gmail.com> Signed-off-by: Rui Zhang <51696593+ruizhang0101@users.noreply.github.com> Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com> | 6 个月前 | |
[Feat] Added a tutorial document for deploying production stack on amd gpus (#364) * [Feat] Added a tutorial document for deploying production stack on amd gpus. Initial commit. Signed-off-by: insukim1994 <insu.kim@moreh.io> * [Feat] Refined tutorial documentation format and sentences. Added real test example output. Signed-off-by: insukim1994 <insu.kim@moreh.io> * [Feat] Added a guide refers to the link for amd gpu related setup prerequisites. Signed-off-by: insukim1994 <insu.kim@moreh.io> * [Feat] Renamed filename for minimal helm example tutorial on amd gpu node (review updates). Signed-off-by: insukim1994 <insu.kim@moreh.io> --------- Signed-off-by: insukim1994 <insu.kim@moreh.io> | 1 年前 | |
[Feat, Misc] Disable PVC creation when pvcStorage is not provided (#176) * [Add] fix for PVC storage Signed-off-by: ApostaC <yihua98@uchicago.edu> * [Update] the tutorial of minimal example to exclude PVC configurations Signed-off-by: ApostaC <yihua98@uchicago.edu> * Bumping the helm chart version Signed-off-by: ApostaC <yihua98@uchicago.edu> * [fix] condition checking in pvc.yaml Signed-off-by: ApostaC <yihua98@uchicago.edu> --------- Signed-off-by: ApostaC <yihua98@uchicago.edu> | 1 年前 | |
[bugfix] deprecate disable log request (#885) * bugfix: deprecate disable log request Signed-off-by: Rui Zhang <zrfishnoodles@gmail.com> * Update helm/README.md Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com> Signed-off-by: Rui Zhang <51696593+ruizhang0101@users.noreply.github.com> --------- Signed-off-by: Rui Zhang <zrfishnoodles@gmail.com> Signed-off-by: Rui Zhang <51696593+ruizhang0101@users.noreply.github.com> Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com> | 6 个月前 | |
[Bugfix] value file based accessMode (#108) * fix: value file based accessMode * fix: add config to examples --------- Signed-off-by: BrianPark314 <brianpark314@gmail.com> | 1 年前 | |
[Feat] Add support for maxNumSeqs, maxLoras, and gpuMemoryUtilization in serving engine configuration (#371) Signed-off-by: haitwang-cloud <haitao_wht@outlook.com> | 1 年前 | |
[Feature] Moving default vLLM version from v0 to v1 (#580) * Moving default to vLLM v1 Signed-off-by: YuhanLiu11 <yliu738@wisc.edu> * adding v0 field in values.yaml Signed-off-by: YuhanLiu11 <yliu738@wisc.edu> --------- Signed-off-by: YuhanLiu11 <yliu738@wisc.edu> | 1 年前 | |
[helm] document every values, udpate json schema and various fix (#886) * fix(helm) update sharedPvcStorage so it correctly create PVC and/or PV Signed-off-by: enneitex <etienne.divet@gmail.com> * fix(helm) various fix to align values, templates and README. update json schema Signed-off-by: enneitex <etienne.divet@gmail.com> * fix(helm) use correct type for lmcacheControllerPort Signed-off-by: enneitex <etienne.divet@gmail.com> * fix(helm) rayCluster: fix templating and add tests Signed-off-by: enneitex <etienne.divet@gmail.com> * fix(helm) deployment-router: simplify templating and add tests Signed-off-by: enneitex <etienne.divet@gmail.com> * feat(helm) improve schema, add tests and CI validation Signed-off-by: enneitex <etienne.divet@gmail.com> feat(helm) improve testing around rayCluster and engine deployment Signed-off-by: enneitex <etienne.divet@gmail.com> ci: retrigger Signed-off-by: enneitex <etienne.divet@gmail.com> fix(tutorials) rename ScaledObject file name Signed-off-by: enneitex <etienne.divet@gmail.com> fix pre-commit Signed-off-by: enneitex <etienne.divet@gmail.com> --------- Signed-off-by: enneitex <etienne.divet@gmail.com> Co-authored-by: Rui Zhang <51696593+ruizhang0101@users.noreply.github.com> | 5 个月前 | |
[bugfix] deprecate disable log request (#885) * bugfix: deprecate disable log request Signed-off-by: Rui Zhang <zrfishnoodles@gmail.com> * Update helm/README.md Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com> Signed-off-by: Rui Zhang <51696593+ruizhang0101@users.noreply.github.com> --------- Signed-off-by: Rui Zhang <zrfishnoodles@gmail.com> Signed-off-by: Rui Zhang <51696593+ruizhang0101@users.noreply.github.com> Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com> | 6 个月前 | |
[FEAT] Add LoRA helm deployment (#563) * [CI] Add prefix aware routing test Signed-off-by: Rui Zhang <zrfishnoodles@gmail.com> * [ci] refactor k8s discovery e2e test Signed-off-by: Rui Zhang <zrfishnoodles@gmail.com> * [CI] Refactor static discovery testing so that it can support multiple logic Signed-off-by: Rui Zhang <zrfishnoodles@gmail.com> * [CI] Add static e2e test for prefixaware Signed-off-by: Rui Zhang <zrfishnoodles@gmail.com> * refactor the code Signed-off-by: Rui Zhang <zrfishnoodles@gmail.com> * [CI] refactor Signed-off-by: Rui Zhang <zrfishnoodles@gmail.com> * [CI] Add multiple routing logic test Signed-off-by: Rui Zhang <zrfishnoodles@gmail.com> * [CI] fix bug Signed-off-by: Rui Zhang <zrfishnoodles@gmail.com> * add lora helm deployment Signed-off-by: Rui Zhang <zrfishnoodles@gmail.com> * add lora helm deployment Signed-off-by: Rui Zhang <zrfishnoodles@gmail.com> * merge two tutotials into one Signed-off-by: Rui Zhang <zrfishnoodles@gmail.com> * fix pre-commit check Signed-off-by: Rui Zhang <zrfishnoodles@gmail.com> * modify tutorials and modify shared-storage Signed-off-by: Rui Zhang <zrfishnoodles@gmail.com> * fix github check Signed-off-by: Rui Zhang <zrfishnoodles@gmail.com> --------- Signed-off-by: Rui Zhang <zrfishnoodles@gmail.com> Co-authored-by: Yuhan Liu <32589867+YuhanLiu11@users.noreply.github.com> | 1 年前 | |
feat: add vllm-api-key (#194) Signed-off-by: kbvd623 <duy.nguyen4@astrazeneca.com> | 1 年前 | |
[Feat] Router: Add OpenTelemetry tracing support with W3C context propagation (#772) Signed-off-by: Fang Han <fhan0520@gmail.com> | 8 个月前 | |
[Minor] Rename tutorial assets file names to match the tutorial names (#442) | 1 年前 | |
[helm] document every values, udpate json schema and various fix (#886) * fix(helm) update sharedPvcStorage so it correctly create PVC and/or PV Signed-off-by: enneitex <etienne.divet@gmail.com> * fix(helm) various fix to align values, templates and README. update json schema Signed-off-by: enneitex <etienne.divet@gmail.com> * fix(helm) use correct type for lmcacheControllerPort Signed-off-by: enneitex <etienne.divet@gmail.com> * fix(helm) rayCluster: fix templating and add tests Signed-off-by: enneitex <etienne.divet@gmail.com> * fix(helm) deployment-router: simplify templating and add tests Signed-off-by: enneitex <etienne.divet@gmail.com> * feat(helm) improve schema, add tests and CI validation Signed-off-by: enneitex <etienne.divet@gmail.com> feat(helm) improve testing around rayCluster and engine deployment Signed-off-by: enneitex <etienne.divet@gmail.com> ci: retrigger Signed-off-by: enneitex <etienne.divet@gmail.com> fix(tutorials) rename ScaledObject file name Signed-off-by: enneitex <etienne.divet@gmail.com> fix pre-commit Signed-off-by: enneitex <etienne.divet@gmail.com> --------- Signed-off-by: enneitex <etienne.divet@gmail.com> Co-authored-by: Rui Zhang <51696593+ruizhang0101@users.noreply.github.com> | 5 个月前 | |
[helm] document every values, udpate json schema and various fix (#886) * fix(helm) update sharedPvcStorage so it correctly create PVC and/or PV Signed-off-by: enneitex <etienne.divet@gmail.com> * fix(helm) various fix to align values, templates and README. update json schema Signed-off-by: enneitex <etienne.divet@gmail.com> * fix(helm) use correct type for lmcacheControllerPort Signed-off-by: enneitex <etienne.divet@gmail.com> * fix(helm) rayCluster: fix templating and add tests Signed-off-by: enneitex <etienne.divet@gmail.com> * fix(helm) deployment-router: simplify templating and add tests Signed-off-by: enneitex <etienne.divet@gmail.com> * feat(helm) improve schema, add tests and CI validation Signed-off-by: enneitex <etienne.divet@gmail.com> feat(helm) improve testing around rayCluster and engine deployment Signed-off-by: enneitex <etienne.divet@gmail.com> ci: retrigger Signed-off-by: enneitex <etienne.divet@gmail.com> fix(tutorials) rename ScaledObject file name Signed-off-by: enneitex <etienne.divet@gmail.com> fix pre-commit Signed-off-by: enneitex <etienne.divet@gmail.com> --------- Signed-off-by: enneitex <etienne.divet@gmail.com> Co-authored-by: Rui Zhang <51696593+ruizhang0101@users.noreply.github.com> | 5 个月前 | |
[helm] document every values, udpate json schema and various fix (#886) * fix(helm) update sharedPvcStorage so it correctly create PVC and/or PV Signed-off-by: enneitex <etienne.divet@gmail.com> * fix(helm) various fix to align values, templates and README. update json schema Signed-off-by: enneitex <etienne.divet@gmail.com> * fix(helm) use correct type for lmcacheControllerPort Signed-off-by: enneitex <etienne.divet@gmail.com> * fix(helm) rayCluster: fix templating and add tests Signed-off-by: enneitex <etienne.divet@gmail.com> * fix(helm) deployment-router: simplify templating and add tests Signed-off-by: enneitex <etienne.divet@gmail.com> * feat(helm) improve schema, add tests and CI validation Signed-off-by: enneitex <etienne.divet@gmail.com> feat(helm) improve testing around rayCluster and engine deployment Signed-off-by: enneitex <etienne.divet@gmail.com> ci: retrigger Signed-off-by: enneitex <etienne.divet@gmail.com> fix(tutorials) rename ScaledObject file name Signed-off-by: enneitex <etienne.divet@gmail.com> fix pre-commit Signed-off-by: enneitex <etienne.divet@gmail.com> --------- Signed-off-by: enneitex <etienne.divet@gmail.com> Co-authored-by: Rui Zhang <51696593+ruizhang0101@users.noreply.github.com> | 5 个月前 | |
Fix: Update nixlPeerHost to pd-llama-decode-engine-service (#771) Signed-off-by: bitliu <bitliu@tencent.com> Co-authored-by: Rui Zhang <51696593+zerofishnoodles@users.noreply.github.com> | 9 个月前 | |
[Router] Add reply and heartbeat port options for KV-aware routing (#908) Signed-off-by: Can Sun <sucan@amazon.com> Co-authored-by: Rui Zhang <51696593+ruizhang0101@users.noreply.github.com> | 5 个月前 | |
[Misc] Expose LMCache log level as configurable Helm value and default to INFO. (#846) * Expose LMCache log level as configurable Helm value and default to INFO. Signed-off-by: nargit <NargiT@users.noreply.github.com> * Fix names Signed-off-by: NargiT <NargiT@users.noreply.github.com> * fix tests and code Signed-off-by: NargiT <NargiT@users.noreply.github.com> * fix test for ray-cluster Signed-off-by: NargiT <NargiT@users.noreply.github.com> * fix typo Signed-off-by: NargiT <NargiT@users.noreply.github.com> * fix yet another typo Signed-off-by: NargiT <NargiT@users.noreply.github.com> * update doc Signed-off-by: NargiT <NargiT@users.noreply.github.com> --------- Signed-off-by: nargit <NargiT@users.noreply.github.com> Signed-off-by: NargiT <NargiT@users.noreply.github.com> Co-authored-by: nargit <NargiT@users.noreply.github.com> Co-authored-by: Rui Zhang <51696593+ruizhang0101@users.noreply.github.com> | 7 个月前 | |
[Feature] Moving default vLLM version from v0 to v1 (#580) * Moving default to vLLM v1 Signed-off-by: YuhanLiu11 <yliu738@wisc.edu> * adding v0 field in values.yaml Signed-off-by: YuhanLiu11 <yliu738@wisc.edu> --------- Signed-off-by: YuhanLiu11 <yliu738@wisc.edu> | 1 年前 | |
[Feat][Helm] Add HTTPRoute template for Gateway API support (#610) Add a route template to allow for configuring k8s Gateway API HTTP (or other) routes. See https://gateway-api.sigs.k8s.io/ Signed-off-by: Zackeus Bengtsson <github@zackeus.no> Co-authored-by: Yuhan Liu <32589867+YuhanLiu11@users.noreply.github.com> | 1 年前 | |
[Feat] Add basic integration path for semantic router (#740) * add integration for sr Signed-off-by: Rui Zhang <rzhan229@ucsc.edu> * gemini fix Signed-off-by: Rui Zhang <rzhan229@ucsc.edu> * gemini fix Signed-off-by: Rui Zhang <rzhan229@ucsc.edu> --------- Signed-off-by: Rui Zhang <rzhan229@ucsc.edu> Co-authored-by: Shaoting <shaotingf@uchicago.edu> | 11 个月前 |
| 文件 | 最后提交记录 | 最后更新时间 |
|---|---|---|
| 6 个月前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 5 个月前 | ||
| 1 年前 | ||
| 6 个月前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 6 个月前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 5 个月前 | ||
| 6 个月前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 8 个月前 | ||
| 1 年前 | ||
| 5 个月前 | ||
| 5 个月前 | ||
| 5 个月前 | ||
| 9 个月前 | ||
| 5 个月前 | ||
| 7 个月前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 11 个月前 |