| 文件 | 最后提交记录 | 最后更新时间 |
|---|---|---|
fix(auth,log): resolve all-team-models double-expansion + dedup ModelNotAllowed logs - boom-auth: resolve_team_models() collapses litellm special names in team.models (all-team-models/all-proxy-models → empty), so a key with all-team-models whose team also has all-team-models no longer falls through to ModelNotAllowed. - boom-core: GatewayError::should_dedup_log() — strict superset of !should_log_to_db, adds ModelNotFound/ModelNotAllowed/KeyExpired/ KeyBlocked to the dedup-eligible set. - boom-main/request_log: dedup gate uses should_dedup_log; new log_auth_error() handles extractor-phase failures (no identity yet). - boom-main/extractor: pre_auth Reject / Deny / authenticate-failure paths now log via log_auth_error. AuthError(401) is full-volume; KeyExpired/KeyBlocked/BudgetExceeded dedup per (key_hash,"<auth>",60s). - boom-main/routes: tracing::warn → debug in check_model_access (log_error_with_usage path handles console warn under dedup). extract_client_ip made pub(crate) for extractor reuse. Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com> Signed-off-by: liqiang <liqiang64@huawei.com> | 26 天前 | |
feat: import BooMGateway v1.0 — Rust LLM API Gateway Intelligence Boom Gateway: high-performance LLM API gateway with litellm key compatibility. Core modules: boom-core — core traits and shared types boom-auth — SHA-256 key auth, litellm table compatibility boom-config — YAML config parsing + env var expansion + hot reload boom-provider — 20+ providers (OpenAI/Anthropic/Bedrock/Azure/Gemini/DeepSeek/vLLM/etc.) boom-routing — DeploymentStore + KV-cache affinity scheduling + AliasStore boom-flowcontrol — per-deployment queue/concurrency/context-length flow control, VIP priority queuing boom-limiter — sliding-window RPM rate limiting + PlanStore + time-based schedule overrides boom-audit — request audit log (LoggedStream Drop-trait records real duration) boom-promptlog — prompt logging (team/key directory layout, gzip auto-compression) boom-dashboard — Web UI + REST API + JWT auth (AdminCommand channel decoupling) boom-main — route assembly, state management, hot reload, background tasks Key features: - KV-cache affinity routing: context-aware affinity scheduling with real-time hotspot detection and queue rebalancing, maximizing KV affinity while maintaining cluster load balance - Fine-grained traffic control: per-deployment concurrency/queue/context limits, per-key RPM + concurrency throttling - SLO guarantees: auto-disable on consecutive failures, load-aware least-loaded selection, VIP priority queue - Per-key routing control: model whitelist, public_models, team-level access, hidden aliases - Multi-provider load balancing: weighted routing, priority-based fallback, swappable round-robin/affinity policies - Zero-downtime hot reload: SIGHUP/API trigger, ArcSwap atomic swap, runtime counters preserved across reloads | 4 个月前 |
| 文件 | 最后提交记录 | 最后更新时间 |
|---|---|---|
| 26 天前 | ||
| 4 个月前 |