Evals and Observability · Judging

LLM-as-Judge

Video + articles

Video

Judge the Judge: Building LLM Evaluators That Actually Work with GEPA — Mahmoud Mabrouk, Agenta AI

AI Engineer · 41 min · April 10, 2026

Articles

Using LLM-as-a-Judge For Evaluation: A Complete Guide

hamel.dev · Hamel Husain · October 29, 2024

Evaluating the Effectiveness of LLM-Evaluators (aka LLM-as-Judge)

eugeneyan.com · Eugene Yan · August 18, 2024

AlignEval: Building an App to Make Evals Easy, Fun, and Automated

eugeneyan.com · Eugene Yan · October 27, 2024

Supplementary

The Future of Evals: From LLM as a Judge to Agent as a Judge — Aparna Dhinakaran, Arize AI

AI Engineer · 6 min · July 24, 2026