Promptfoo
EvaluationTesting
Test and evaluate LLM prompts and RAG pipelines. Red-teaming, A/B testing, and CI integration for prompt quality.
Built with
TypeScriptNode.jsLLM
Share this part
More in Evaluation
DeepEval
Open-source LLM evaluation framework. Unit-test your LLM outputs with 14+ metrics including hallucination, toxicity, and RAG.
HELM
Holistic Evaluation of Language Models. Evaluates LLMs across 42 scenarios and 7 metrics for a complete capability picture.
BIG-Bench
Beyond the Imitation Game benchmark. 200+ tasks designed to probe LLM capabilities beyond standard NLP benchmarks.
AgentBench
Benchmark for evaluating LLMs as agents across 8 distinct environments including OS, web browser, and database tasks.
Label Studio
Open-source data labeling platform. Annotate text, images, audio, and video for training and evaluating AI models.
Ragas
Framework for evaluating RAG pipelines. Measures faithfulness, answer relevancy, context recall, and more without ground truth.