SGLang is a high-performance serving framework for large language models and multimodal models.
项目介绍
SGLang 是一种为大型语言模型（LLMs）设计的结构化生成语言。它能加快您与模型的互动，并使互动过程更加可控。【此简介由AI生成】
Apache-2.0 Python17.22 K提交数attentionblackwellcudadeepseekdiffusionglmgpt-ossinferencellamallmminimaxmoeqwenqwen-imagereinforcement-learningtransformervlmwan
定制我的领域