gpustack:基于多推理引擎的 GPU 集群管理项目

Star5

Star5

A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.

Branch20 Tags67

Introduction

管理GPU集群以运行人工智能模型【此简介由AI生成】

Apache-2.0 Python 3.28 KCommitsascend cuda deepseek distributed-inference high-performance-inference inference llama llm llm-inference llm-serving maas mindie openai qwen rocm sglang vllm

Customize your domain

415.3 K566Visit GitHub