| Serve streaming ASR through the vLLM plugin A streaming prompt interleaves one audio window per chunk, so a single prompt carries N audio items rather than one. The plugin now handles that shape: - Streaming checkpoints declare VibeVoiceForASRStreamingTraining; the decoder is identical, so the architecture name alone selects the interleaved prompt layout. Deriving it from the name rather than a config flag keeps a checkpoint from being served under the wrong protocol. - The multimodal budget is sized from the window the checkpoint was trained on, read off the checkpoint. Profiling the 61-minute non-streaming bound per item would VAE-encode ~88M samples N times over and OOM at startup. - asr_streaming.py carries the chunk geometry; asr_streaming_server.py the incremental session on top of it. Adds a launcher, a browser demo API, an end-to-end API test, and docs/vibevoice-vllm-asr-streaming.md. | 24 天前 |