llm-compressor:基于 vLLM 生态的大语言模型优化工具项目

Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM