Tools
llmfit
alexsjones/llmfit
A terminal tool that inspects your hardware and tells you which open LLMs will actually run well.
Topics
Related projects
anything-llm68.1kAn all-in-one self-hosted AI platform to chat with docs, run agents and manage models and users privately.
jan45.7kAn open-source desktop AI platform for chatting with local and cloud models, custom assistants, MCP, and local API.
omlx23.6kA macOS LLM inference server with batched serving and SSD caching for local AI agents.
koboldcpp12.3kA one-file local LLM application with a built-in web UI for chatting, roleplay, image, video, speech, and agent-assisted creation.
Soup10.5kA one-config CLI framework for fine-tuning and post-training LLMs with QLoRA, evals, and export.
osaurus8.2kNative macOS AI agent app combining any model, persistent memory, sandboxed autonomous execution and cryptographic identity fully offline for personal use.