Benchmark

Simple

An exam for AI: identical tasks so you can fairly compare who is better.

Business

A standardized comparison of models/systems; the methodology matters more than the number — chapter 11 is about this.

Tech

A fixed dataset + metric + run protocol (SWE-bench, GAIA, BrowseComp); risks: contamination, self-reporting, version drift.

Related terms

Where the term is covered

All glossary terms