Agent infrastructure
llama-cpp-python
abetlen/llama-cpp-python
Python bindings for llama.cpp enabling local large language model inference, completion APIs, and OpenAI-compatible server deployment for developers running models on personal hardware.
Related projects
cc-switch135.3kCross-platform desktop assistant for managing configurations, model switching, and sessions across Claude Code, Codex, OpenCode, and other coding agents centrally.
rtk81.5kA resident CLI proxy that filters and compresses output from common development commands to cut token usage in AI coding sessions, packaged as a dependency-free Rust binary.
OmniRoute69.4kFree open-source AI gateway unifying access to over 1,200 models from 352 providers, offering quota-aware automatic fallback and token compression for coding agents.
free-claude-code55.7kGateway utility for coding-agent users seeking free token access and unified model management, adding multi-provider failover across Claude Code, Codex, Pi, OpenCode, and other supported harnesses.