Curriculum
/
Evals and Observability
Evals and Observability
8 core lessons · 6 hr 28 min
·
0
of 8 complete
Building evals
Eval-Driven Development
Hamel Husain · 34 min
Video + articles
Error Analysis and Failure Taxonomies
Hamel Husain · 27 min
Video + articles
Graders and Eval Types
AI Engineer · 2 hr 4 min
Video + articles
Judging
LLM-as-Judge
AI Engineer · 41 min
Video + articles
Statistics for Evals
AI Agent Frontier · 1 hr
Video + articles
Agent evals
Evaluating Agents
AI Engineer · 20 min
Video + articles
Benchmarks and Their Limits
TNG Technology Consulting GmbH · 50 min
Video + articles
Observability
Tracing and Observability
Tyler Renelle · 31 min
Video + articles
Extended
6 lessons ·
All extended lessons
Building evals
Evals in CI
Eval Tooling
AI Engineer · 26 min
Video + articles
Agent evals
Evaluating RAG
Eval Awareness and Contamination
Observability
OpenTelemetry for Agents
Production Monitoring