Agent infrastructure
LMCache
LMCache/LMCache
Reusable persistent KV-cache management layer for LLM inference, compatible with multiple engines and storage backends, helping engineers reduce time-to-first-token and improve throughput.
Related projects
cc-switch135.3kCross-platform desktop assistant for managing configurations, model switching, and sessions across Claude Code, Codex, OpenCode, and other coding agents centrally.
rtk81.5kA resident CLI proxy that filters and compresses output from common development commands to cut token usage in AI coding sessions, packaged as a dependency-free Rust binary.
OmniRoute69.4kFree open-source AI gateway unifying access to over 1,200 models from 352 providers, offering quota-aware automatic fallback and token compression for coding agents.
free-claude-code55.7kGateway utility for coding-agent users seeking free token access and unified model management, adding multi-provider failover across Claude Code, Codex, Pi, OpenCode, and other supported harnesses.