mini-sglang:基于 Python 的轻量级高性能大语言模型推理框架项目

A compact implementation of SGLang, designed to demystify the complexities of modern LLM serving systems.

Branch1Tags0

Introduction

A compact implementation of SGLang, designed to demystify the complexities of modern LLM serving systems.

Customize your domain
174.57 K736Visit GitHub