mini-sglang:基于 Python 的轻量级高性能大语言模型推理框架项目

A compact implementation of SGLang, designed to demystify the complexities of modern LLM serving systems.

分支1Tags0

项目介绍

A compact implementation of SGLang, designed to demystify the complexities of modern LLM serving systems.

定制我的领域
164.61 K748访问 GitHub