| 文件 | 最后提交记录 | 最后更新时间 |
|---|---|---|
fix(server): report stage-router stats for a composite route (#943) AlgorithmStats::new creates the stage-router baseline only when a route's algorithm name is literally "stage_router". A composite route is a stage route under another name: CompositeRouter is build_stage_route(config.stage)?.with_name(COMPOSITE) and its StageClassifier records switchyard.stage_router.routing_decisions and the scoring histograms on every turn regardless of the route name. With no baseline the snapshot field stays None and serde skips it, so an operator running a composite route gets algorithm_stats: {} from /v1/stats while /metrics carries the counters, and loses the decision-source breakdown the stage-router docs promise. Key the baseline on either name. The wider fix is for libsy to say which algorithms a route composes, so the next wrapper does not reintroduce this; this keeps the change inside the server, next to the two names already hardcoded there. Signed-off-by: Dmitry Voropaev <dy.voropaev@gmail.com> | 14 天前 | |
fix(llm-client): report Responses state limits without losing saved IDs (#721) The router now remembers Responses state ownership across multiple providers. Recognized previous_response_id and conversation continuations return to the owning model. Bounded tracking excludes store = false, while single-provider routing remains unchanged. Integration tests cover buffered, streamed, and shared-provider behavior. Signed-off-by: Elyas Mehtabuddin <emehtabuddin@nvidia.com> | 1 个月前 | |
fix(server): report stage-router stats for a composite route (#943) AlgorithmStats::new creates the stage-router baseline only when a route's algorithm name is literally "stage_router". A composite route is a stage route under another name: CompositeRouter is build_stage_route(config.stage)?.with_name(COMPOSITE) and its StageClassifier records switchyard.stage_router.routing_decisions and the scoring histograms on every turn regardless of the route name. With no baseline the snapshot field stays None and serde skips it, so an operator running a composite route gets algorithm_stats: {} from /v1/stats while /metrics carries the counters, and loses the decision-source breakdown the stage-router docs promise. Key the baseline on either name. The wider fix is for libsy to say which algorithms a route composes, so the next wrapper does not reintroduce this; this keeps the change inside the server, next to the two names already hardcoded there. Signed-off-by: Dmitry Voropaev <dy.voropaev@gmail.com> | 14 天前 | |
chore: Upgrade Rust edition to 2024 (#236) * chore: Upgrade Rust edition 2021 -> 2024 For if-let chains. Also upgrade `rand` so we have a single version. Signed-off-by: Graham King <grahamk@nvidia.com> * if-let chains Signed-off-by: Graham King <grahamk@nvidia.com> * cargo fmt Signed-off-by: Graham King <grahamk@nvidia.com> --------- Signed-off-by: Graham King <grahamk@nvidia.com> | 2 个月前 |
| 文件 | 最后提交记录 | 最后更新时间 |
|---|---|---|
| 14 天前 | ||
| 1 个月前 | ||
| 14 天前 | ||
| 2 个月前 |