lmdeploy:基于大语言模型技术的压缩、部署与服务工具包项目

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.