Agent infrastructure
ninfer
neroued/ninfer
A high-performance C++ and CUDA inference engine for single-GPU execution, optimized for Qwen checkpoints and RTX 5090 hardware across text, image, and video with a compatible API.
Related projects
cc-switch135.3kCross-platform desktop assistant for managing configurations, model switching, and sessions across Claude Code, Codex, OpenCode, and other coding agents centrally.
rtk81.5kA resident CLI proxy that filters and compresses output from common development commands to cut token usage in AI coding sessions, packaged as a dependency-free Rust binary.
OmniRoute69.4kFree open-source AI gateway unifying access to over 1,200 models from 352 providers, offering quota-aware automatic fallback and token compression for coding agents.
free-claude-code55.7kGateway utility for coding-agent users seeking free token access and unified model management, adding multi-provider failover across Claude Code, Codex, Pi, OpenCode, and other supported harnesses.