Agent infrastructure
ragas
vibrantlabsai/ragas
An evaluation toolkit for LLM apps offering objective metrics, test generation, and production feedback loops.
Topics
Related projects
promptfoo27.1kAn open-source CLI and library for evaluating prompts and red-teaming LLM apps, with CI integration and model comparisons.
OpenLLM12.6kAn open-source platform for self-hosting LLMs and serving them as OpenAI-compatible APIs in the cloud.
opencompass7.6kA one-stop open platform for evaluating foundation models across 100+ datasets, with unified inference, judging, and leaderboards.
llm-app58.7kOpen-source templates for real-time RAG pipelines with live indexing, vector search, and deployable HTTP APIs.- serviette58.7kA collection of production-ready RAG and enterprise search pipeline templates with live data sync, built-in indexing, and Docker-based deployment.
llm-action25.3kA curated Chinese knowledge base sharing LLM training, fine-tuning, inference, and deployment tutorials with hands-on code.