llm-observability

ThinkWatch-Lite

+293

Local gateway for Claude Code, Codex and other AI clients on macOS, Windows and Linux: switch upstreams without touching clients, keep API keys from relays, cut off malicious tool calls, trace every request.

failproofai

+1k

Observability and enforcement for AI agent harnesses. Capture every run and runtime reliability with policy enforcement.

langfuse

+498

🪢 Open source agent evals & observability: Trace, evaluate, and improve LLM applications with one open platform.

comet-ml/opik

+194

Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.

bifrost

+150

Open-source, high-performance AI gateway that works as your LLM gateway, MCP gateway and agent gateway. One OpenAI-compatible API for 10,000+ models, with failover, load balancing, semantic caching, virtual keys, budgets and MCP Code Mode. Works with any SDK or agent and adds under 200µs of overhead at 5k RPS.

claude-flightdeck

+58

A Claude Code mod that puts a live agent dashboard in your terminal: context and cost, advisor timeline, every permission check, subagent cards and swimlanes.

Tracely-ai

+50

Trace-native CI/CD for AI agents: grade production traces, cluster failures, freeze them into replayable regression tests, and block PRs that regress. Self-hostable.

future-agi

+34

Open-source, end-to-end platform for evaluating, observing, and improving LLM and AI agent applications. Tracing · Evals · Simulations · Datasets · Gateway · Guardrails. Self-hostable. Apache 2.0.

lmnr-ai/lmnr

+30

Laminar - open-source observability platform purpose-built for AI agents. YC S24.