| chore(.agents/skills): updated agent-browser-electron | 1 个月前 |
| feat(ci): lint swift code | 6 个月前 |
| chore: disable gemini review | 1 个月前 |
| test: resolve spine typecheck and unit test failures in CI (#1895) | 1 个月前 |
| chore(ci): added Godot vscode extension recommendation, and .prototools for managing dotnet versions | 2 个月前 |
| chore(workspace): added Zed editor config | 5 个月前 |
| test: resolve spine typecheck and unit test failures in CI (#1895) | 1 个月前 |
| fix(bucket): update Scoop manifest to v0.9.0-alpha.18 (#1430) --------- Co-authored-by: Matt Van Horn <455140+mvanhorn@users.noreply.github.com> Co-authored-by-agent: Claude Opus 4.6 <noreply@anthropic.com> | 3 个月前 |
| 🖼️ docs(readme): use PNG download buttons on GitCode | 1 个月前 |
| fix(stage-ui-three): OrbitControl initialisation (#1877) ## Summary - Fix the first Live2D -> VRM switch camera regression where OrbitControls could clamp the camera into the model. - Remove the VRM render scale control from the model settings panel. - Remove the now-unused settings.vrm.render-scale locale entries. - Ignore Godot/.NET bin/ and obj/ build artifacts under engines/stage-tamagotchi-godot. ## Root Cause On the first VRM load, OrbitControls can mount before the VRM bootstrap writes a real modelSize. The previous watcher copied modelSize.z = 0 into minDistance and maxDistance, so later camera updates were clamped onto the target before the bootstrap camera pose finished applying. ## Changes - Skip OrbitControls distance-bound updates until modelSize.z is finite and non-zero. - Keep the render scale runtime state intact, but remove the VRM settings UI entry so it is no longer hot-updated from the panel. - Add Godot project ignores for local .NET build output. --------- Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com> | 1 个月前 |
| release: v0.10.2 | 1 个月前 |
| chore(ci): add stage-tamagotchi-godot in publish (#1841) | 1 个月前 |
| test: resolve spine typecheck and unit test failures in CI (#1895) | 1 个月前 |
| chore(stage-tamagotchi): patch uiohook-napi to use prebuilt binaries and skip postinstall build | 1 个月前 |
| release: v0.10.2 | 1 个月前 |
| chore(ci): resolve OpenCollective 401 in sponsors workflow (#1843) | 1 个月前 |
| fix(computer-use-mcp): bound waitForElement frame timeouts (#1856) ## Summary\n- Pass the remaining waitForElement budget into each frame-level CU_ACTION send so unresponsive frames cannot consume the fixed 8s sendMessage timeout.\n- Use the remaining deadline for each poll and stop polling immediately when the budget is exhausted.\n- Reduce the bridge-side waitForElement grace from the legacy 9.5s buffer to a small transport grace.\n- Add a regression test covering the hanging-extension case.\n\n## Validation\n- pnpm -C services/computer-use-mcp exec vitest run --config ./vitest.config.ts src/browser-dom/extension-bridge.test.ts --------- Co-authored-by: Neko <neko@ayaka.moe> Co-authored-by: 刘梓恒 <160735726+3361559784@users.noreply.github.com> Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com> | 1 个月前 |
| feat(ci): proper Dockerfile for current project setup & release workflow Close #424 | 10 个月前 |
| feat(stage-tamagotchi): add click through support (previous macOS only, now both supported) (#187) --------- Co-authored-by: DWCarrot <23579844+DWCarrot@users.noreply.github.com> Co-authored-by: Makito <5277268+sumimakito@users.noreply.github.com> Co-authored-by: Midori Kochiya <1381736+kmod-midori@users.noreply.github.com> | 1 年前 |
| fix(ci): min-integrity: none for safeoutput mcp call (#1645) | 2 个月前 |
| feat(stage-ui): chat sync (#1775) | 1 个月前 |
| chore(ci): added Godot vscode extension recommendation, and .prototools for managing dotnet versions | 2 个月前 |
| chore(workspace): bump node.js version to 24.13.0 | 3 个月前 |
| refactor(stage-web,stage-ui): replace warpdrive plugin with unplugin-basemove (#1818) | 1 个月前 |
| chore(docs): replace CLAUDE.md symlink with @AGENTS.md reference (#1455) | 3 个月前 |
| docs: update LICENSE | 1 年前 |
| 📝 docs(readme): center GitCode banner image | 1 个月前 |
| chore(bumpp): bump versions in iOS project | 3 个月前 |
| chore(ci): autofix crowdin files [skip ci] | 7 个月前 |
| feat(stage-tamagotchi,stage-shared): listen keyup for global shortcut with uiohook | 1 个月前 |
| feat(nix): add nix flake and package (#319) * feat(nix): add nix flake and package * feat: support darwin --------- Co-authored-by: Neko <neko@ayaka.moe> | 11 个月前 |
| feat(auth): email login & profile (#1745) Co-authored-by: Liet Blue <127093491+lietblue@users.noreply.github.com> | 2 个月前 |
| chore(ci): Remove CI concurrency group & small fixes (#1758) ## Description <!-- Please insert your description here and especially provide info about the "what" this PR is solving --> It has no effect. The actions are run in parallel anyway. They have been previously updated to not fail when run in parallel. ## Linked Issues <!-- Optional, if you have any --> ## Additional Context <!-- e.g. is there anything you'd like reviewers to focus on? --> | 2 个月前 |
| chore(ci): Remove CI concurrency group & small fixes (#1758) ## Description <!-- Please insert your description here and especially provide info about the "what" this PR is solving --> It has no effect. The actions are run in parallel anyway. They have been previously updated to not fail when run in parallel. ## Linked Issues <!-- Optional, if you have any --> ## Additional Context <!-- e.g. is there anything you'd like reviewers to focus on? --> | 2 个月前 |
| perf: setup knip, remove unused dependencies (#992) | 5 个月前 |
| test: resolve spine typecheck and unit test failures in CI (#1895) | 1 个月前 |
| test: resolve spine typecheck and unit test failures in CI (#1895) | 1 个月前 |
| chore(stage-tamagotchi): patch uiohook-napi to use prebuilt binaries and skip postinstall build | 1 个月前 |
| feat(inference): unify and optimize WebGPU inference pipeline (#1622) ## Problem The WebGPU inference pipeline had several structural issues: 1. **No unified protocol** — Kokoro TTS, Whisper ASR, and Background Removal workers each used their own ad-hoc message formats. Adding a new model meant reinventing worker communication from scratch. 2. **Infrastructure existed but was disconnected** — GPUResourceCoordinator, LoadQueue, InferenceWorkerManager, and protocol.ts were all implemented but had zero consumers. The adapters duplicated the same lifecycle/timeout/mutex patterns independently. 3. **Performance gaps** — Kokoro only offered fp32 on WebGPU (no fp16), Whisper warm-up compiled shaders for 187.5s of dummy audio, audio transfer went through unnecessary WAV blob encode/decode, and listVoices reloaded the model every time. 4. **Silent failures** — Whisper worker's generate() had no try-catch; errors were swallowed and the main thread waited until timeout. 5. **No graceful degradation** — Whisper and Background Removal workers hardcoded device: 'webgpu' with no WASM fallback. 6. **No observability** — Only Kokoro had performance tracing. No adapter reported status to useInferenceStatus. No cache management UI existed. 7. **Dead code accumulation** — Old KokoroWorkerManager (232 lines), legacy Whisper message types, and scattered duplicate constants. ## Changes ### Phase 0 — Critical Performance & Bugs - Add fp16-webgpu dtype for Kokoro TTS (~2x inference speed on supported GPUs) - Fix Whisper warm-up tensor from [1, 128, 3000] → [1, 128, 1] (minimal shader compilation) - Fix Whisper worker silent error bug (add try-catch to generate() and load()) ### Phase 1 — Data Transfer & Caching - Switch Kokoro audio to Float32Array transferable (skip WAV blob encode in worker, lightweight WAV encode on main thread) - Cache listVoices results (skip redundant model reload when adapter state is ready) - Normalize progress reporting to 0-100 across all adapters, differentiate warmup phase ### Phase 2 — Protocol Unification & Infrastructure - Migrate all 3 workers + 3 adapters to unified protocol.ts message types (load-model, run-inference, model-ready, inference-result, progress, error) - Wire GPUResourceCoordinator into all adapters (VRAM allocation tracking, LRU ordering, memory pressure events) - Wire LoadQueue into all adapters (priority-based sequential model loading: TTS=10 > ASR=5 > BG_REMOVAL=1) - Add coordinator.ts global singleton for GPU coordinator + load queue - Add WebGPU detection + WASM fallback in Whisper and Background Removal workers ### Phase 3 — Error Recovery & Observability - Add restart logic with exponential backoff to Whisper adapter (matching Kokoro's existing pattern) - Integrate classifyError() (OOM / DEVICE_LOST / TIMEOUT classification) in Whisper adapter - Extend defaultPerfTracer to Whisper transcribe() and Background Removal processImage() - Wire useInferenceStatus into all 3 adapters (downloading → ready → terminated lifecycle) ### Phase 4 — Tests - Add unit tests for AsyncMutex (4 tests), LoadQueue (4 tests), GPUResourceCoordinator (7 tests) — all 15 passing ### Phase 5 — Cleanup & Features - Delete old KokoroWorkerManager (232 lines, zero consumers) - Delete orphaned libs/workers/types.ts (old Whisper message types) - Clean up workers/kokoro/types.ts (remove legacy message types, keep domain types) - Create centralized constants.ts (MODEL_IDS, MODEL_NAMES, TIMEOUTS, MAX_RESTARTS) - Remove hardcoded WebGPU check from background-removal devtools pages (worker auto-detects) - Add useModelPreload composable for generic idle-time preloading - Add useInferencePreload composable that reads provider config and preloads configured local models - Wire preloading into both stage-web and stage-tamagotchi App.vue (Kokoro TTS preloads 3s after init) - Add ModelCacheManager.vue settings component (cache size display, per-model status, clear cache) - Document GPU Device isolation architecture in protocol.ts ## After This PR - All inference workers speak the same protocol → adding a new model adapter is straightforward - GPU memory is tracked across all models with automatic pressure warnings at 80%/95% of VRAM budget - Models load sequentially via priority queue → no bandwidth/VRAM contention - Workers auto-detect WebGPU and fall back to WASM → works on browsers without WebGPU - Kokoro TTS preloads during idle time → "instant" first use for configured users - All adapters auto-restart on worker crashes (max 3 attempts, exponential backoff) - 15 unit tests cover core infrastructure (mutex, queue, coordinator) - Zero dead code remains in the inference pipeline ## Test Plan - [x] pnpm exec vitest run packages/stage-ui/src/libs/inference/ — 15 tests pass - [x] pnpm -F @proj-airi/stage-ui exec tsc --noEmit — no TypeScript errors - [x] pnpm lint:fix — no lint errors in changed files - [ ] Manual: verify Kokoro TTS works with fp16-webgpu on a supported browser - [ ] Manual: verify Whisper ASR loads and transcribes correctly - [ ] Manual: verify Background Removal works in devtools page - [ ] Manual: verify preloading triggers in console ([Preload] Loading kokoro-...) --------- Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com> Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com> | 2 个月前 |
| chore: update rust fmt rules (#235) | 1 年前 |
| chore(.agent): added agent-browser skill | 2 个月前 |
| feat(docs): sync download buttons and added SponsorKit (#1407) | 3 个月前 |
| chore(pocket): exclude build and public folder in tsconfig | 2 个月前 |
| | 3 个月前 |
| feat(inference): unify and optimize WebGPU inference pipeline (#1622) ## Problem The WebGPU inference pipeline had several structural issues: 1. **No unified protocol** — Kokoro TTS, Whisper ASR, and Background Removal workers each used their own ad-hoc message formats. Adding a new model meant reinventing worker communication from scratch. 2. **Infrastructure existed but was disconnected** — GPUResourceCoordinator, LoadQueue, InferenceWorkerManager, and protocol.ts were all implemented but had zero consumers. The adapters duplicated the same lifecycle/timeout/mutex patterns independently. 3. **Performance gaps** — Kokoro only offered fp32 on WebGPU (no fp16), Whisper warm-up compiled shaders for 187.5s of dummy audio, audio transfer went through unnecessary WAV blob encode/decode, and listVoices reloaded the model every time. 4. **Silent failures** — Whisper worker's generate() had no try-catch; errors were swallowed and the main thread waited until timeout. 5. **No graceful degradation** — Whisper and Background Removal workers hardcoded device: 'webgpu' with no WASM fallback. 6. **No observability** — Only Kokoro had performance tracing. No adapter reported status to useInferenceStatus. No cache management UI existed. 7. **Dead code accumulation** — Old KokoroWorkerManager (232 lines), legacy Whisper message types, and scattered duplicate constants. ## Changes ### Phase 0 — Critical Performance & Bugs - Add fp16-webgpu dtype for Kokoro TTS (~2x inference speed on supported GPUs) - Fix Whisper warm-up tensor from [1, 128, 3000] → [1, 128, 1] (minimal shader compilation) - Fix Whisper worker silent error bug (add try-catch to generate() and load()) ### Phase 1 — Data Transfer & Caching - Switch Kokoro audio to Float32Array transferable (skip WAV blob encode in worker, lightweight WAV encode on main thread) - Cache listVoices results (skip redundant model reload when adapter state is ready) - Normalize progress reporting to 0-100 across all adapters, differentiate warmup phase ### Phase 2 — Protocol Unification & Infrastructure - Migrate all 3 workers + 3 adapters to unified protocol.ts message types (load-model, run-inference, model-ready, inference-result, progress, error) - Wire GPUResourceCoordinator into all adapters (VRAM allocation tracking, LRU ordering, memory pressure events) - Wire LoadQueue into all adapters (priority-based sequential model loading: TTS=10 > ASR=5 > BG_REMOVAL=1) - Add coordinator.ts global singleton for GPU coordinator + load queue - Add WebGPU detection + WASM fallback in Whisper and Background Removal workers ### Phase 3 — Error Recovery & Observability - Add restart logic with exponential backoff to Whisper adapter (matching Kokoro's existing pattern) - Integrate classifyError() (OOM / DEVICE_LOST / TIMEOUT classification) in Whisper adapter - Extend defaultPerfTracer to Whisper transcribe() and Background Removal processImage() - Wire useInferenceStatus into all 3 adapters (downloading → ready → terminated lifecycle) ### Phase 4 — Tests - Add unit tests for AsyncMutex (4 tests), LoadQueue (4 tests), GPUResourceCoordinator (7 tests) — all 15 passing ### Phase 5 — Cleanup & Features - Delete old KokoroWorkerManager (232 lines, zero consumers) - Delete orphaned libs/workers/types.ts (old Whisper message types) - Clean up workers/kokoro/types.ts (remove legacy message types, keep domain types) - Create centralized constants.ts (MODEL_IDS, MODEL_NAMES, TIMEOUTS, MAX_RESTARTS) - Remove hardcoded WebGPU check from background-removal devtools pages (worker auto-detects) - Add useModelPreload composable for generic idle-time preloading - Add useInferencePreload composable that reads provider config and preloads configured local models - Wire preloading into both stage-web and stage-tamagotchi App.vue (Kokoro TTS preloads 3s after init) - Add ModelCacheManager.vue settings component (cache size display, per-model status, clear cache) - Document GPU Device isolation architecture in protocol.ts ## After This PR - All inference workers speak the same protocol → adding a new model adapter is straightforward - GPU memory is tracked across all models with automatic pressure warnings at 80%/95% of VRAM budget - Models load sequentially via priority queue → no bandwidth/VRAM contention - Workers auto-detect WebGPU and fall back to WASM → works on browsers without WebGPU - Kokoro TTS preloads during idle time → "instant" first use for configured users - All adapters auto-restart on worker crashes (max 3 attempts, exponential backoff) - 15 unit tests cover core infrastructure (mutex, queue, coordinator) - Zero dead code remains in the inference pipeline ## Test Plan - [x] pnpm exec vitest run packages/stage-ui/src/libs/inference/ — 15 tests pass - [x] pnpm -F @proj-airi/stage-ui exec tsc --noEmit — no TypeScript errors - [x] pnpm lint:fix — no lint errors in changed files - [ ] Manual: verify Kokoro TTS works with fp16-webgpu on a supported browser - [ ] Manual: verify Whisper ASR loads and transcribes correctly - [ ] Manual: verify Background Removal works in devtools page - [ ] Manual: verify preloading triggers in console ([Preload] Loading kokoro-...) --------- Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com> Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com> | 2 个月前 |
| refactor(stage-*): analytics and telemetry, including consent (#1414) --------- Co-authored-by-agent: Codex <267193182+codex@users.noreply.github.com> Co-authored-by-agent: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com> Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com> Co-authored-by: RainbowBird <rbxin2003@outlook.com> Co-authored-by: Neko <neko@ayaka.moe> | 3 个月前 |
| refactor(stage-web,stage-ui): replace warpdrive plugin with unplugin-basemove (#1818) | 1 个月前 |