Agent infrastructure
omlx
jundot/omlx
A macOS LLM inference server with batched serving and SSD caching for local AI agents.
Topics
Related projects
apfel6.6kA Mac CLI and local OpenAI-compatible server exposing Apple Foundation Models for on-device inference and tool calling.
mlx-serve2.4kNative LLM inference server for Apple Silicon with OpenAI- and Anthropic-compatible APIs, plus a macOS app offering chat, agent mode, multimodal interaction, and tool calling.
magpie29.7kA local gateway and menu-bar app that lets any coding agent use any model or subscription, with unified provider management, failover, profiles and privacy masking.
inference9.6kA unified model-serving library to deploy LLMs and multimodal models locally or in the cloud via OpenAI-compatible API.
turbo-fieldfare7.2kAn efficient Gemma 4 inference runtime for Apple-silicon Macs, streaming experts under low-memory budgets and bundling a demo app with evaluation tooling.
Rapid-MLX4.1kA local LLM inference server and Mac app for Apple Silicon with OpenAI and Anthropic APIs, tuned for coding agents.