All lessons
agent-evaluation
2 free lessons tagged agent-evaluation across AI. Each one is a short sequence of focused steps with narration and a five-question quiz at the end — take them in any order, no signup required.
AI
advancedMeasuring a Harness Change: Trials, Error Bars and pass^k
Every harness change is a hypothesis. Learn how evaluation harnesses record agent runs, why one run is one noisy sample, how paired comparisons and repeated trials separate real gains from luck, and when to report pass@k versus pass^k, with computed simulations.
10 steps·~15 min
AI
intermediateModel Plus Harness: Why the Same Model Scores Differently
An agent is a model plus everything around it. Using controlled evidence from SWE-agent and Terminal-Bench, see how interface design, harness choice and even container limits move the results of a fixed model, and why the model still sets the ceiling.
11 steps·~17 min