Agent infrastructure
semantic-router
vllm-project/semantic-router
An open programmable routing and AI gateway layer that selects or blends models and compute for each agent call by policy.
Topics
Related projects
bifrost9.5kA high-performance open-source LLM gateway unifying 20-plus providers behind one API with failover, caching, and governance.
LMCache12.3kA vendor-neutral KV cache management layer for LLM inference that reuses cached context to cut latency and boost throughput.
superagent6.8kAn open-source SDK for AI agent safety that blocks prompt injections, redacts PII and secrets, and scans repositories for threats. Developers embed it via TypeScript, Python, or an MCP server to guard agent deployments.
agentgateway6.1kAn open-source agentic proxy providing LLM routing, MCP tool federation, guardrails and observability for agent traffic.
GoModel1.3kGoModel is a self-hosted AI gateway written in Go, unifying OpenAI- and Anthropic-compatible APIs with multi-provider routing, caching, budgets, observability, guardrails, and usage analytics.
hoop842An open-source runtime control sidecar for AI agents that masks sensitive data and blocks destructive SQL or HTTP commands on the wire, with risk analysis and human review, requiring only a port change.