Agent infrastructure
tokenspeed
lightseekorg/tokenspeed
A blazing-fast open-source LLM inference engine tuned for agentic workloads, pairing TensorRT-class speed with vLLM-like ease for production deployments at scale.
Topics
Related projects
open-interpreter68.6kA terminal coding agent optimized for low-cost models with sandboxing, harness switching, and editor integration.
FastGPT29.8kA visual low-code platform for building knowledge-based AI agents with RAG retrieval, workflows, plugins, and MCP.
sglang37.2kA fast open-source inference framework for serving large language and multimodal models at scale.
dsh-our-free-model17.8kA dsh plugin that supplies free frontier models with availability probing and a local OpenAI-compatible gateway.
dsh-our-free-model17.7kA dsh provider plugin that exposes free frontier models with availability probing and a local OpenAI-compatible endpoint.
freetoken14.5kAn edge-native MoE inference engine that runs massive open-weight models on consumer GPUs with fast execution and OpenAI-compatible APIs.