Skip to content

Error analysis: turning failures into a roadmap

Look at your failures systematically: sample, label with a taxonomy, count, and prioritise. Covers building a failure taxonomy, open coding then axial grouping, measuring annotator agreement with Cohen's kappa (runnable), and converting categories into targeted fixes and new tests.

15 minยทVerified 2026-11Pro+50 XP

Aggregate scores tell you how much is wrong. Error analysis tells you what is wrong, which is what you can act on.

Pro content

Keep reading with Inference Academy Pro

Unlock the rest of this lesson, plus every advanced lesson, hands-on lab, the larger playground models and completion certificates.