xllm:基于国产芯片的大模型推理框架项目

A high-performance inference engine for LLMs, optimized for diverse AI accelerators.

分支14Tags10

项目介绍

A high-performance inference engine for LLMs, optimized for diverse AI accelerators.

https://xllm.readthedocs.io/en/latest/定制我的领域