Evals and Observability · Agent evals

Evaluating Agents

Video + articles

Video

From Agent Traces to Agent Simulations — Rustem Feyzkhanov, Snorkel AI

AI Engineer · 20 min · July 25, 2026

Articles

Demystifying evals for AI agents

Anthropic Engineering · Anthropic · January 9, 2026

Lost in Simulation: LLM-Simulated Users are Unreliable Proxies for Human Users in Agentic Evaluations

arXiv · Seshadri et al. · January 23, 2026

AI Agents That Matter

arXiv · Sayash Kapoor, Benedikt Stroebl, Zachary S. Siegel, Nitya Nadgir, Arvind Narayanan · July 1, 2024

Supplementary

Everything Is a Rollout — Alex Shaw + Ryan Marten, Terminal-Bench, Harbor, Laude Institute

AI Engineer · 21 min · July 24, 2026

Agentic Evaluations Workshop - Deep Dive on the Future on Evals for Agents.

Hugging Face · 1 hr 49 min · March 20, 2026

Agentic Evaluations at Scale, For Everybody — Nicholas Kang & Michael Aaron, Google DeepMind

AI Engineer · 20 min · May 25, 2026