sglang:基于 PyTorch 生态的大语言模型高性能服务框架项目

SGLang is a structured generation language designed for large language models (LLMs). It makes your interaction with models faster and more controllable.

分支1Tags0

项目介绍

SGLang is a structured generation language designed for large language models (LLMs). It makes your interaction with models faster and more controllable.

定制我的领域