Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.
项目介绍
Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.
Apache-2.0 C++1.64 K提交数disaggregationinferencekvcachellmrdmareinforcement-learningsglangtokenspeedtrt-llmvllm
定制我的领域