main

GGitHubfix(litellm): preserve tool-free Responses requests (#816)

107f7985创建于 10 天前历史提交

文件	最后提交记录	最后更新时间
profiles	refactor(litellm): replace client integration with routing plugin (#532) * refactor LiteLLM integration * fix(litellm): address routing plugin review feedback Signed-off-by: dnandakumar-nv <dnandakumar@nvidia.com> * refactor(litellm): move example out of experimental Signed-off-by: dnandakumar-nv <dnandakumar@nvidia.com> * test(litellm): verify Stage signal preservation Signed-off-by: dnandakumar-nv <dnandakumar@nvidia.com> --------- Signed-off-by: dnandakumar-nv <dnandakumar@nvidia.com>	1 个月前
.env.example	refactor(litellm): replace client integration with routing plugin (#532) * refactor LiteLLM integration * fix(litellm): address routing plugin review feedback Signed-off-by: dnandakumar-nv <dnandakumar@nvidia.com> * refactor(litellm): move example out of experimental Signed-off-by: dnandakumar-nv <dnandakumar@nvidia.com> * test(litellm): verify Stage signal preservation Signed-off-by: dnandakumar-nv <dnandakumar@nvidia.com> --------- Signed-off-by: dnandakumar-nv <dnandakumar@nvidia.com>	1 个月前
Dockerfile	fix(litellm): preserve tool-free Responses requests (#816) Update the LiteLLM example and NeMo Gym runner from 1.97.0 to 1.102.0 so tool-free Responses requests do not acquire an empty `tools` array during translation to Chat Completions. With the previous pin, a request that omits `tools` is translated into a Chat request containing `tools: []`. Backends that reject empty tool arrays then fail before inference, including in the Gym tutorial. This is a dependency compatibility issue, not a routing decision failure. LiteLLM's upstream [fix](https://github.com/BerriAI/litellm/commit/4ea5749642de69e86e9414b1557eb8d00660c63c) removes both `tools` and `tool_choice` when there are no tools. The selected 1.102.0 version includes that behavior; Signed-off-by: Shawn Wang <32839114+enwaiax@users.noreply.github.com>	10 天前
compose.yaml	fix(litellm): preserve tool-free Responses requests (#816) Update the LiteLLM example and NeMo Gym runner from 1.97.0 to 1.102.0 so tool-free Responses requests do not acquire an empty `tools` array during translation to Chat Completions. With the previous pin, a request that omits `tools` is translated into a Chat request containing `tools: []`. Backends that reject empty tool arrays then fail before inference, including in the Gym tutorial. This is a dependency compatibility issue, not a routing decision failure. LiteLLM's upstream [fix](https://github.com/BerriAI/litellm/commit/4ea5749642de69e86e9414b1557eb8d00660c63c) removes both `tools` and `tool_choice` when there are no tools. The selected 1.102.0 version includes that behavior; Signed-off-by: Shawn Wang <32839114+enwaiax@users.noreply.github.com>	10 天前