Agent infrastructure
RagaAI-Catalyst
raga-ai-hub/RagaAI-Catalyst
An observability and evaluation platform for LLM agents, offering tracing, debugging, analytics, and guardrails.
Topics
Related projects
phoenix12.3kAn open-source AI observability platform for tracing, evaluating, and debugging LLM and agent applications.
second-brain-ai-assistant-course3.1kAn open-source course teaching how to build a Second Brain AI assistant with RAG, agents, fine-tuning and LLMOps.
mlflow28.8kAn open-source AI engineering platform for tracing, evaluating, monitoring, and governing LLMs, agents, and models.
promptfoo27.1kAn open-source CLI and library for evaluating prompts and red-teaming LLM apps, with CI integration and model comparisons.
ragas16.2kAn evaluation toolkit for LLM apps offering objective metrics, test generation, and production feedback loops.
gateway13.3kAn open-source AI gateway that routes requests across 1600+ LLMs with retries, guardrails, caching, observability, and MCP server management.