pass-at-k

1 free lesson tagged pass-at-k across AI. Each one is a short sequence of focused steps with narration and a five-question quiz at the end — take them in any order, no signup required.

advanced

Measuring a Harness Change: Trials, Error Bars and pass^k

Every harness change is a hypothesis. Learn how evaluation harnesses record agent runs, why one run is one noisy sample, how paired comparisons and repeated trials separate real gains from luck, and when to report pass@k versus pass^k, with computed simulations.

10 steps·~15 min

Measuring a Harness Change: Trials, Error Bars and pass^k

Related topics