Open-source desktop app for local LLMs. Text, vision, tool-calling, OpenAI/Anthropic-compatible API. 100% private.
面向大型语言模型的Gradio网页用户界面。支持Transformers、GPTQ、AWQ、EXL2、llama.cpp(GGUF)及Llama模型。【此简介由AI生成】