evals

failproofai

+945

Observability and enforcement for AI agent harnesses. Capture every run and runtime reliability with policy enforcement.

ai-system-design-guide

+387

AI system design guide for engineers building production AI systems and evals.

harbor

+199

Framework for evaluating and improving agents

mastra

+143

Mastra is the modern TypeScript framework for AI-powered applications and agents.

phoenix

+94

AI Observability & Evaluation

paperthin

+42

Low-level agentic design patterns. Turning old engineering wisdom into reflexes your agent reaches for on its own—on any agent.

lmnr-ai/lmnr

+29

Laminar - open-source observability platform purpose-built for AI agents. YC S24.

waku-agent

+29

Waku Waku! Waku Agent is a local-first AI agent harness you actually own, including loop, memory, eval, all in code built to stay legible as it grows.

future-agi

+21

Open-source, end-to-end platform for evaluating, observing, and improving LLM and AI agent applications. Tracing · Evals · Simulations · Datasets · Gateway · Guardrails. Self-hostable. Apache 2.0.