Agent infrastructure
opencompass
open-compass/opencompass
A one-stop open platform for evaluating foundation models across 100+ datasets, with unified inference, judging, and leaderboards.
Topics
Related projects
promptfoo27.1kAn open-source CLI and library for evaluating prompts and red-teaming LLM apps, with CI integration and model comparisons.
ragas16.2kAn evaluation toolkit for LLM apps offering objective metrics, test generation, and production feedback loops.
PocketFlow-Tutorial-Codebase-Knowledge12.7kAn AI app that turns any codebase into a beginner-friendly tutorial by analyzing structure and generating docs.
rig9.1kA Rust library for building modular LLM apps with a unified provider interface, agent runtime, tools, and vector stores.
dsh-our-free-model72.7kThis DeepSeek Harness plugin adds free, no-key access to several upstream model pools and exposes a local OpenAI/Anthropic-compatible gateway. It includes fallback routing, usage dashboards, token-saving compression and in-app updates.
dsh-our-free-model58.9kA DeepSeek Harness plugin that adds free and bring-your-own-key model providers, a local OpenAI/Anthropic-compatible gateway, routing, usage dashboards, and token compression.