Agent infrastructure
Rapid-MLX
raullenchai/Rapid-MLX
A local LLM inference server and Mac app for Apple Silicon with OpenAI and Anthropic APIs, tuned for coding agents.
Topics
Related projects
mlx-serve2.4kNative LLM inference server for Apple Silicon with OpenAI- and Anthropic-compatible APIs, plus a macOS app offering chat, agent mode, multimodal interaction, and tool calling.
sglang38.7kA fast open-source inference framework for serving large language and multimodal models at scale.
magpie29.7kA local gateway and menu-bar app that lets any coding agent use any model or subscription, with unified provider management, failover, profiles and privacy masking.
fastapi_mcp12kA Python library that exposes FastAPI endpoints as MCP tools with auth, letting developers give agents secure access to existing APIs.
lean-ctx3.9kA local context gateway that selects task-relevant context, enforces controls and budgets, and records usage evidence for coding agents.
karpathy-llm-wiki2.7kA reusable Agent Skills skill that builds a Karpathy-style LLM wiki with ingest, cited answers, and linting workflows.