Agent infrastructure
ollitert
nightmean/ollitert
An Android app that runs LLMs fully on-device and serves them over your local network via an OpenAI-compatible API.
Related projects
cc-switch144.2kA cross-platform desktop manager for coding agents that switches API providers and centralizes MCP, skills, and prompts.
rtk83.4kA resident CLI proxy that filters and compresses output from common development commands to cut token usage in AI coding sessions, packaged as a dependency-free Rust binary.
OmniRoute76.5kFree open-source AI gateway unifying access to over 1,200 models from 352 providers, offering quota-aware automatic fallback and token compression for coding agents.
free-claude-code60.5kGateway utility for coding-agent users seeking free token access and unified model management, adding multi-provider failover across Claude Code, Codex, Pi, OpenCode, and other supported harnesses.
privateGPT57.6kAn open-source API layer that turns local models into production backends with RAG, tools, MCP, and database access.
whisper.cpp54.4kA dependency-free, high-performance C/C++ port of Whisper for on-device speech recognition, with quantization, broad hardware acceleration, and many language bindings.