xllm:基于国产芯片的大模型推理框架项目

A high-performance inference engine for LLMs, optimized for diverse AI accelerators.

Branch14Tags10

Introduction

A high-performance inference engine for LLMs, optimized for diverse AI accelerators.

https://xllm.readthedocs.io/en/latest/Customize your domain