TensorRT-Edge-LLM:基于 TensorRT 的边缘平台大语言模型推理框架项目

High-performance, light-weight C++ LLM and VLM Inference Software for Physical AI