Skip to content

Reasoning Foundations

What reasoning means, verifiers, and honest evaluation.

0 of 2 complete

  1. ▶ Up next16 min+50 XPWhat reasoning means, and how a verifier makes it measurableA working definition of reasoning for language models, the difference between knowing and multi-step deriving, tasks…
  2. Pro17 min+50 XPVerifiers and honest evaluation: pass@k, error bars and costMeasure reasoning properly: the unbiased pass@k estimator (runnable), confidence intervals on small benchmarks…