Agent infrastructure
lmdeploy
InternLM/lmdeploy
Toolkit for compressing, quantizing, deploying, and serving large language models with high-performance inference, supporting multiple engines and online API serving for production use.
Related projects
cc-switch135.3kCross-platform desktop assistant for managing configurations, model switching, and sessions across Claude Code, Codex, OpenCode, and other coding agents centrally.
rtk81.5kA resident CLI proxy that filters and compresses output from common development commands to cut token usage in AI coding sessions, packaged as a dependency-free Rust binary.
OmniRoute69.4kFree open-source AI gateway unifying access to over 1,200 models from 352 providers, offering quota-aware automatic fallback and token compression for coding agents.
free-claude-code55.7kGateway utility for coding-agent users seeking free token access and unified model management, adding multi-provider failover across Claude Code, Codex, Pi, OpenCode, and other supported harnesses.