main

AAlexTYJServe streaming ASR through the vLLM plugin

ca6529ae创建于 18 天前历史提交

文件	最后提交记录	最后更新时间
test_api.py	feat: add hotwords support for vLLM ASR	7 个月前
test_api_auto_recover.py	feat: add hotwords support for vLLM ASR	7 个月前
test_api_streaming.py	Serve streaming ASR through the vLLM plugin A streaming prompt interleaves one audio window per chunk, so a single prompt carries N audio items rather than one. The plugin now handles that shape: - Streaming checkpoints declare VibeVoiceForASRStreamingTraining; the decoder is identical, so the architecture name alone selects the interleaved prompt layout. Deriving it from the name rather than a config flag keeps a checkpoint from being served under the wrong protocol. - The multimodal budget is sized from the window the checkpoint was trained on, read off the checkpoint. Profiling the 61-minute non-streaming bound per item would VAE-encode ~88M samples N times over and OOM at startup. - asr_streaming.py carries the chunk geometry; asr_streaming_server.py the incremental session on top of it. Adds a launcher, a browser demo API, an end-to-end API test, and docs/vibevoice-vllm-asr-streaming.md.	18 天前