Agent infrastructure
mlc-llm
mlc-ai/mlc-llm
A high-performance large language model deployment engine based on machine learning compilation, enabling developers to run LLMs efficiently across diverse chips and platforms through a unified API.
Related projects
cc-switch135.3kCross-platform desktop assistant for managing configurations, model switching, and sessions across Claude Code, Codex, OpenCode, and other coding agents centrally.
rtk81.5kA resident CLI proxy that filters and compresses output from common development commands to cut token usage in AI coding sessions, packaged as a dependency-free Rust binary.
OmniRoute69.4kFree open-source AI gateway unifying access to over 1,200 models from 352 providers, offering quota-aware automatic fallback and token compression for coding agents.
free-claude-code55.7kGateway utility for coding-agent users seeking free token access and unified model management, adding multi-provider failover across Claude Code, Codex, Pi, OpenCode, and other supported harnesses.