atlas:基于 Rust 的 LLM 本地推理加速引擎项目

Star0

Star0

Pure Rust Inference Engine

Introduction

Pure Rust Inference Engine

AGPL-3.0 Rust 158Commitscuda dgx dgx-spark gb10 llm-inference mamba nvfp4 openai-api rust speculative-decoding ssm transformers

Customize your domain

560084Visit GitHub