LiteRT-LM:基于 LiteRT 的边缘设备 LLM 推理框架项目

LiteRT-LM is Google's production-ready, high-performance, open-source inference framework for deploying Large Language Models on edge devices.

分支328Tags26

项目介绍

LiteRT-LM is Google's production-ready, high-performance, open-source inference framework for deploying Large Language Models on edge devices.

定制我的领域
685.97 K645访问 GitHub