The Ledger · Entry 021 · Reasoning
Autonomous completion of long tasks
ContestedSince 2025Criterion performanceLast reviewed 2026-08-17
Event
METR reports that the length of software tasks frontier models complete with 50 percent reliability has doubled roughly every seven months since 2019, reaching about an hour of human time in early 2025.
The measure is the length, in skilled-human time, of a task a model finishes half the time; at 80 percent reliability the horizon is several times shorter, and the tasks are self-contained software and research problems with clear success criteria. METR's 2026 revision put the recent doubling faster, around four months, and reported horizons above ten hours for the newest models, with a warning that measurements beyond sixteen hours are unreliable on the current suite. Weeks-long work with shifting goals, other people, and consequences that cannot be reset is what remains; the steepness of the curve is why this entry is contested rather than held.