ktransformers:基于 CPU-GPU 异构计算的大语言模型推理与微调项目

A Flexible Framework for Experiencing Heterogeneous LLM Inference/Fine-tune Optimizations