AI applications
koboldcpp
lostruins/koboldcpp
A one-file local LLM application with a built-in web UI for chatting, roleplay, image, video, speech, and agent-assisted creation.
Topics
Related projects
shimmy6kA tiny pure-Rust local inference server for GGUF models with an OpenAI-compatible API and WebGPU acceleration.
lsp-ai3.2kLSP-AI is an open-source language server that serves as a backend for AI-powered functionality, designed to assist and empower software engineers, not replace them.
LocalAI50.3kAn open-source engine to run LLMs, vision, and audio models locally with OpenAI-compatible APIs.
jan45.7kAn open-source desktop AI platform for chatting with local and cloud models, custom assistants, MCP, and local API.
airllm42.3kA Python inference engine that streams huge language models layer by layer to run 70B to 671B models on small GPUs.
llmfit38.7kA terminal tool that inspects your hardware and tells you which open LLMs will actually run well.