evaluation-metrics

deepeval

+134

The LLM Evaluation Framework

agentops

+18

Python SDK for AI agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks including CrewAI, Agno, OpenAI Agents SDK, Langchain, Autogen, AG2, and CamelAI

eval

+7

Public results and task definitions for FrontierHarness Eval

lighteval

+4

Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends