| 文件 | 最后提交记录 | 最后更新时间 |
|---|---|---|
fix(llm-client): validate configured headers at startup (#627) * fix(llm-client): validate configured headers at startup Signed-off-by: Clement Pakkam Isaac <cpakkamisaac@nvidia.com> * test: document header validation intent Signed-off-by: Clement Pakkam Isaac <cpakkamisaac@nvidia.com> * refactor(llm-client): streamline header validation Signed-off-by: Clement Pakkam Isaac <cpakkamisaac@nvidia.com> --------- Signed-off-by: Clement Pakkam Isaac <cpakkamisaac@nvidia.com> | 25 天前 | |
feat: Failure cooldown after exhausted transient failures (#887) If a model is unavailable, we would retry the configured number of times and then fall back to the next model in the list. But we would do this on every request. Now we briefly remember the model is not available. We don't retry the model until after a cooldown period. Signed-off-by: Graham King <grahamk@nvidia.com> | 16 天前 | |
fix(translation): finish Codex tool calls through a LiteLLM gateway (#969) * fix(translation): finish Codex tool calls and compaction through a LiteLLM gateway Signed-off-by: Elyas Mehtabuddin <emehtabuddin@nvidia.com> * test(server): shrink the LiteLLM gateway regression tests Signed-off-by: Elyas Mehtabuddin <emehtabuddin@nvidia.com> * refactor: simplify replayed tool definitions, custom-call decoding, and gateway tests Signed-off-by: Elyas Mehtabuddin <emehtabuddin@nvidia.com> * test: move the snapshot-conflict check to the translation tests Signed-off-by: Elyas Mehtabuddin <emehtabuddin@nvidia.com> * fix: stop adding tool definitions to requests that replay tool calls Signed-off-by: Elyas Mehtabuddin <emehtabuddin@nvidia.com> --------- Signed-off-by: Elyas Mehtabuddin <emehtabuddin@nvidia.com> | 2 天前 | |
feat(vgr): discover local backend context capacity (#992) * feat(vgr): discover local backend context capacity Signed-off-by: Giedrius Burachas <gburachas@nvidia.com> * refactor(server): rely on registered context discovery probes Signed-off-by: Giedrius Burachas <gburachas@nvidia.com> --------- Signed-off-by: Giedrius Burachas <gburachas@nvidia.com> | 1 天前 |
| 文件 | 最后提交记录 | 最后更新时间 |
|---|---|---|
| 25 天前 | ||
| 16 天前 | ||
| 2 天前 | ||
| 1 天前 |