AutoAWQ implements the AWQ algorithm for 4-bit quantization with a 2x speedup during inference. Documentation:
AutoAWQ采用AWQ算法实现4比特量化，在推理过程中实现了2倍的速度提升。【此简介由AI生成】