01
A cross-platform desktop manager for coding agents that switches API providers and centralizes MCP, skills, and prompts.farion1231
2026-06-26
2025-08-04
152.6k stars
Agent infrastructure
436 projects · page 1 / 5
1-100 of 436
02
A free MIT AI gateway that exposes hundreds of providers and models through one OpenAI-compatible endpoint, with quota-aware fallback, token compression, routing strategies and MCP/A2A support.cheaper-inference
2026-10-21
2026-02-13
86.2k stars
03
A free self-hosted AI gateway that routes one OpenAI-compatible endpoint across hundreds of providers with fallback and compression.diegosouzapw
2026-06-24
2026-02-13
85.6k stars
04
This DeepSeek Harness plugin adds free, no-key access to several upstream model pools and exposes a local OpenAI/Anthropic-compatible gateway. It includes fallback routing, usage dashboards, token-saving compression and in-app updates.zouyuxuan122
2026-09-30
2026-09-24
72.7k stars
05
Local proxy gateway letting eleven coding agents share sixty-plus providers with fallback routing, token optimization, cost tracking and admin UI.alishahryar1
2026-06-26
2026-01-28
68.1k stars
06
A DeepSeek Harness plugin that adds free and bring-your-own-key model providers, a local OpenAI/Anthropic-compatible gateway, routing, usage dashboards, and token compression.Ebony-Vinyl
2026-10-05
2026-09-24
58.9k stars
07
An open-source API layer that turns local models into production backends with RAG, tools, MCP, and database access.imartinez
2026-08-26
2023-05-02
57.6k stars
08
A dependency-free, high-performance C/C++ port of Whisper for on-device speech recognition, with quantization, broad hardware acceleration, and many language bindings.ggml-org
2026-08-26
2022-09-25
55.1k stars
09
T3 Code is a remote control surface for the coding agents already installed on your machine, letting you drive Claude Code, Codex, Cursor and others from mobile, web or desktop.pingdotgg
2026-07-26
2026-02-08
53.8k stars
10
A pure-C inference engine that runs giant mixture-of-experts models on everyday hardware by streaming experts from disk with OpenAI-compatible serving.justvugg
2026-07-10
2026-07-01
50.3k stars
11
An open-source engine to run LLMs, vision, and audio models locally with OpenAI-compatible APIs.mudler
2026-06-26
2023-03-18
50.3k stars
12
A terminal multiplexer built for coding agents with persistent sessions, multi-machine views, and agent status tracking.ogulcancelik
2026-06-26
2026-03-27
49.7k stars
13
A self-hosted LLM gateway that unifies dozens of free-tier providers behind one OpenAI-compatible endpoint with routing.tashfeenahmed
2026-06-26
2026-04-21
49.2k stars
14
A terminal runtime and workspace manager for coding agents, keeping sessions alive across detaches, organizing multiple machines, and exposing panes to agents through a CLI and socket API.herdrdev
2026-07-30
2026-03-27
48.6k stars
15
A self-hosted AI API gateway that pools subscription quotas and exposes them as managed API keys with billing and routing.wei-shaw
2026-06-26
2025-12-18
45.6k stars
16
An independent auditing tool for AI agents that simulates realistic business requests and grades responses, surfacing misalignment, privilege abuse, prompt injection, and other risks in a scored report.ifixai-ai
2026-07-24
2026-04-27
43.6k stars
17
A Python inference engine that streams huge language models layer by layer to run 70B to 671B models on small GPUs.lyogavin
2026-06-24
2023-06-12
42.3k stars
18
An open-source product analytics and observability platform with funnels, replays, flags, experiments, errors, logs, and AI tracing.PostHog
2026-06-26
2020-01-23
40.8k stars
19
A fast open-source inference framework for serving large language and multimodal models at scale.sgl-project
2026-06-24
2024-01-08
38.7k stars
20
A local model gateway and control plane for coding agents such as Claude Code, Codex and OpenCode, unifying providers, routing, credentials, tools and request observability.musistudio
2026-08-26
2025-02-25
38.1k stars
21
An out-of-the-box Electron desktop client that packages and manages DeepSeek Harness with plugins.anywhere-labs
2026-08-15
2026-08-13
35.9k stars
22
A desktop manager for the Codex app with provider switching, session tools, extensions, and usage enhancements.bigpizzav3
2026-06-26
2026-05-06
32.9k stars
23
A free AI router and token saver that connects coding tools to 40+ providers with smart fallback and quota tracking.decolua
2026-06-26
2026-01-05
32.2k stars
24
A local gateway and menu-bar app that lets any coding agent use any model or subscription, with unified provider management, failover, profiles and privacy masking.yetone
2026-11-04
2026-09-23
29.7k stars
25
A Claude Code statusline plugin showing live context usage, rate limits, active tools, agents and todo progress.jarrodwatts
2026-06-24
2026-01-02
29.1k stars
26
An open-source AI engineering platform for tracing, evaluating, monitoring, and governing LLMs, agents, and models.mlflow
2026-06-24
2018-06-05
28.8k stars
27
A native macOS terminal built for running many coding agents in parallel, with tabs, notifications, and browser panes.manaflow-ai
2026-06-24
2026-01-28
28.8k stars
28
An open-source CLI and library for evaluating prompts and red-teaming LLM apps, with CI integration and model comparisons.promptfoo
2026-06-24
2023-04-28
27.1k stars
29
A Mozilla project that packs LLMs into single-file executables for local, no-install inference across operating systems.mozilla-ai
2026-06-24
2023-09-10
26.6k stars
30
A narrow native inference engine for running DeepSeek and GLM models fast on consumer hardware.antirez
2026-06-26
2026-05-06
24.3k stars
31
A macOS LLM inference server with batched serving and SSD caching for local AI agents.jundot
2026-06-24
2026-02-13
23.6k stars
32
A universal ML-compilation engine for deploying large language models with high-performance inference across GPUs, mobile, and browsers.mlc-ai
2026-06-24
2023-04-29
23.4k stars
33
An open-source LLM observability platform for tracing agents, running evaluations, and monitoring production.comet-ml
2026-06-24
2023-05-10
23.4k stars
34
Reference stack for securely running AI agents such as Hermes and OpenClaw inside NVIDIA OpenShell, providing managed inference and lifecycle controls for deployments.nvidia
2026-07-15
2026-03-15
22.9k stars
35
A desktop command center for Claude Code for managing sessions, custom agents, usage analytics, and MCP servers.winfunc
2026-06-24
2025-06-19
22.4k stars
36
A cross-platform high-performance inference and training accelerator for ML models with hardware acceleration and graph optimizations.microsoft
2026-06-24
2018-11-10
22.3k stars
37
A safe, private runtime for agent fleets that enforces filesystem, syscall and network policies inside isolated sandboxes.NVIDIA
2026-06-24
2026-02-24
21.3k stars
38
Wasmer is a fast, lightweight WebAssembly sandbox runtime and CLI with SDKs for JavaScript, Python, Rust and Swift, letting you run portable or untrusted code safely across local, cloud and browser environments.wasmerio
2026-08-26
2018-10-11
21.2k stars
39
Browser extension for developers using Codex that securely exports a logged-in ChatGPT session locally to generate a spec-compliant auth.json backup file.zhishile
2026-07-15
2026-06-02
20.3k stars
40
OpenAI's framework for evaluating LLMs and LLM systems, with an open registry of benchmarks and tooling for custom eval creation.openai
2026-06-24
2023-01-23
19.7k stars
41
Desktop tool centrally managing accounts, quotas, multi-instance sessions, and wake-up automation across AI coding IDEs including Codex, Copilot, Cursor, and Gemini CLI.jlcodes99
2026-07-16
2026-01-16
19.7k stars
42
DeepEval is an open-source LLM evaluation framework with Pytest-style testing, diverse judge metrics, synthetic datasets, and tracing for agents and RAG pipelines.confident-ai
2026-06-24
2023-08-10
19.5k stars
43
A high-performance in-browser LLM inference engine with WebGPU acceleration and OpenAI-compatible APIs for building private web AI apps.mlc-ai
2026-06-24
2023-04-13
19.4k stars
44
opencodex is a local AI gateway that lets Codex, Claude Code, Claude Desktop, and Grok Build use many model providers, with routing, account pooling, and a management dashboard.lidge-jun
2026-07-21
2026-06-18
18.3k stars
45
Self-hosted platform for cloud workspaces and AI coding agents with isolated environments, governance, and cost controls.coder
2026-08-26
2021-12-22
17.4k stars
46
FreeToken is an edge-native Mixture-of-Experts inference engine that runs large open-weight models on consumer hardware, with a desktop app, CLI, and OpenAI/Anthropic-compatible APIs.flashml-org
2026-08-22
2026-07-20
16.8k stars
47
An open-source model gateway and router that unifies providers behind one API with budgets, guardrails, and optimization.experientiallabs
2026-08-28
16.7k stars
48
An isolated sandbox runtime for AI agents to run code, files, browsers, and desktops locally via Docker or on Kubernetes.opensandbox-group
2026-06-24
2025-12-17
16.5k stars
49
A lightweight vLLM reimplementation in about 1,200 lines of Python delivering fast, readable offline LLM inference.GeeeekExplorer
2026-06-24
2025-06-09
16.3k stars
50
A bridge that exposes local AI coding agents to chat apps with multi-bot relay, sessions, scheduling, and remote control.chenhg5
2026-06-24
2026-02-28
16.3k stars
51
An evaluation toolkit for LLM apps offering objective metrics, test generation, and production feedback loops.vibrantlabsai
2026-06-24
2023-05-08
16.2k stars
52
An observability and evaluation platform for LLM agents, offering tracing, debugging, analytics, and guardrails.raga-ai-hub
2026-06-24
2024-08-26
16.2k stars
53
An Obsidian plugin that embeds Claude Code, Codex, OpenCode and other coding agents in your vault, with sessions, inline editing, skills, and cross-session messaging.YishenTu
2026-07-15
2025-12-05
15.9k stars
54
NVIDIA's open-source library for optimizing LLM inference with custom kernels and a high-performance runtime.NVIDIA
2026-06-24
2023-08-16
15.0k stars
55
An open-source sandbox infrastructure for running AI-generated code securely, controlled via Python and JavaScript SDKs.e2b-dev
2026-06-24
2023-03-04
14.7k stars
56
Google's declarative runtime for running autonomous agent workloads at scale on Kubernetes, sandboxing each task and pre-wiring repositories, tools and models.google
2026-09-22
2026-03-30
14.6k stars
57
A native desktop companion for installing, configuring, and chatting with the Hermes Agent in one place.fathah
2026-06-24
2026-04-02
14.5k stars
58
An open-source web and mobile UI for Claude Code, Cursor CLI, and Codex, letting you manage coding-agent sessions, files, Git, and MCP from anywhere.siteboon
2026-08-26
2025-06-25
14.5k stars
59
A highly customizable status line for the Claude Code CLI that shows model, Git branch, token usage, cost, and limits in real time, with themes and Powerline styling.sirmalloc
2026-07-16
2025-08-08
13.5k stars
60
An open-source AI gateway that routes requests across 1600+ LLMs with retries, guardrails, caching, observability, and MCP server management.Portkey-AI
2026-06-24
2023-08-23
13.3k stars
61
An instant, secure MicroVM sandbox service for AI agents with millisecond startup, hardware isolation, and E2B compatibility.tencentcloud
2026-07-09
2026-04-10
13.2k stars
62
An open-source platform for self-hosting LLMs and serving them as OpenAI-compatible APIs in the cloud.bentoml
2026-06-24
2023-04-19
12.6k stars
63
A vendor-neutral KV cache management layer for LLM inference that reuses cached context to cut latency and boost throughput.LMCache
2026-06-24
2024-05-28
12.3k stars
64
An open-source AI observability platform for tracing, evaluating, and debugging LLM and agent applications.Arize-ai
2026-08-26
2022-11-09
12.3k stars
65
An eBPF-powered network observability platform for Kubernetes that indexes L4/L7 traffic, decrypts TLS, and serves AI agents via MCP.kubeshark
2026-06-24
2021-04-19
12.1k stars
66
A local observability tool that tracks AI coding token spend across dozens of agents, broken down by model, project, and task.getagentseal
2026-08-19
2026-04-13
11.7k stars
67
An experiment tracking and observability platform for logging, visualizing, and managing machine learning training runs.wandb
2026-06-24
2017-03-24
11.3k stars
68
Official developer inspector for MCP servers with web, CLI and TUI clients to connect, list tools, call methods and smoke-test servers.modelcontextprotocol
2026-06-24
2024-10-03
11.2k stars
69
NVIDIA's open-source inference serving software for deploying AI models efficiently across cloud and edge.triton-inference-server
2026-06-24
2018-10-04
11.1k stars
70
A cloud-native API and AI gateway that secures, routes and observes REST and MCP traffic for apps and agents.TykTechnologies
2026-08-26
2014-05-07
10.9k stars
71
A universal CLI that installs and syncs SKILL.md skills to any coding agent, matching Claude Code format everywhere.numman-ali
2026-06-24
2025-10-26
10.8k stars
72
Python bindings and an OpenAI-compatible server for llama.cpp, bringing fast local LLM inference to Python apps.abetlen
2026-06-24
2023-03-23
10.7k stars
73
An operating-system-grade runtime for AI agents that runs WebAssembly capsules with capability security, sandboxing, isolation, and auditable execution.unicity-astrid
2026-06-24
2026-02-15
10.3k stars
74
A portable C99 inference engine that runs the 2.78T-parameter Kimi K3 model on a single CPU with streaming.fareedkhan-dev
2026-08-02
2026-08-01
10.2k stars
75
An open-source observability platform unifying logs, metrics, traces and session replays on ClickHouse for fast debugging.hyperdxio
2026-06-24
2023-09-13
10k stars
76
An LLM vulnerability scanner that red-teams models with probes for injection, jailbreaks, leaks, and toxicity.NVIDIA
2026-06-24
2023-05-10
9.9k stars
77
A durable virtual computer for agents with a persistent filesystem and sandboxed shell and code execution.cloudflare
2026-08-05
2026-06-05
9.9k stars
78
A unified model-serving library to deploy LLMs and multimodal models locally or in the cloud via OpenAI-compatible API.xorbitsai
2026-06-24
2023-06-14
9.6k stars
79
The self-hosted Sentry distribution packaging full error tracking and performance monitoring for private low-volume deployments.getsentry
2026-06-24
2016-02-11
9.6k stars
80
A high-performance open-source LLM gateway unifying 20-plus providers behind one API with failover, caching, and governance.maximhq
2026-08-26
2025-03-19
9.5k stars
81
A desktop control center for coding agents that runs Claude Code, Codex and others side by side with shared memory and session checkpoints.pacifio
2026-08-07
2026-05-14
9.4k stars
82
Atlas is an agent visibility and control layer that records coding agent sessions, links them to commits, and gives teams a shared timeline, memory, and usage dashboard.tryatlas
2026-11-06
2026-05-14
9.4k stars
83
A fast local-first microVM runtime and SDK for running untrusted AI agents, code, and automation in hardware-isolated sandboxes.superradcompany
2026-06-24
2024-10-03
9k stars
84
Claude Code Usage Monitor is a terminal companion that tracks Claude Code token, message, and cost usage in real time, with forecasting, warnings, and machine-readable exports.Maciek-roboblog
2026-08-26
2025-06-19
8.8k stars
85
A terminal TUI for running multiple coding agents in isolated git worktrees, managing sessions, diffs, and background tasks.smtg-ai
2026-06-24
2025-03-09
8.7k stars
86
An on-device GenAI inference runtime for Snapdragon that runs frontier LLMs and VLMs locally via CLI, SDK, or server.qualcomm
2026-06-24
2024-08-16
8.5k stars
87
Open agent operating system community edition providing command-line runtime, isolated environments, composable capsules, and model connectivity for building agent applications.unicity-aos
2026-07-26
2026-07-12
8.5k stars
88
An open-source OpenAI-compatible API server that unifies models, vector search, and agentic orchestration as infrastructure for AI applications anywhere with pluggable providers.ogx-ai
2026-06-24
2024-06-25
8.5k stars
89
Observability and policy enforcement for agent harnesses with tracing, guardrails, and local audits.failproofai
2026-08-12
2026-04-06
8.2k stars
90
A toolkit for compressing, deploying, and serving LLMs with fast inference engines, quantization, and distributed serving.InternLM
2026-06-24
2023-06-15
8.1k stars
91
An open-source framework to evaluate, test, and monitor ML and LLM systems with reports and a monitoring dashboard.evidentlyai
2026-06-24
2020-11-25
8k stars
92
A local browser interface for the Pi coding agent that lets users browse and resume sessions, inspect runs, and manage models and files.agegr
2026-07-21
2026-03-22
8k stars
93
A lightweight C/C++ diffusion-model inference engine built on ggml, supporting Stable Diffusion, FLUX, Wan, Qwen Image, and other image and video models on local CPU or GPU backends.leejet
2026-09-24
2023-08-13
7.9k stars
94
Multi-account API gateway for developers using Grok, aggregating Grok Build, Web, and Console channels into one unified interface for model access and management.chenyme
2026-07-15
2025-10-10
7.9k stars
95
A fast Rust LLM inference engine with quantization, OpenAI-compatible serving and SDKs for local and multi-GPU deployment.EricLBuehler
2026-06-24
2024-02-26
7.8k stars
96
An open-source local inference engine tuned for each machine that runs open models quickly and connects them to popular coding agents via compatible APIs.magnitudedev
2026-08-09
2026-06-12
7.8k stars
97
A skill management layer for AI agents that retrieves, evaluates, shares, and evolves skills using real execution evidence.hkuds
2026-08-16
2026-03-24
7.8k stars
98
Open-source LLM gateway routing 300+ models through one endpoint with fallbacks, logging, and spend tracking.mnfst
2026-08-26
2022-09-27
7.6k stars
99
An open-source LLM gateway that unifies API keys, subscriptions, and local models behind one OpenAI-compatible endpoint, with routing, fallback, cost tracking, and full request logs.mnfst
2026-09-10
2022-09-27
7.6k stars
100
A desktop client for OpenClaw agents that replaces CLI orchestration with chat, scheduling, channels and skill management.ValueCell-ai
2026-06-24
2026-02-05
7.6k stars