The Ledger · Entry 010 · Reasoning
Passing professional licensing exams
Ceded to machinesSince 2023Criterion performanceLast reviewed 2026-08-17
Event
OpenAI's GPT-4 report claims a passing Uniform Bar Exam score around the 90th percentile of test takers, plus passing scores on many other standardized exams.
The passing scores are not in dispute; the ranking is. A 2024 re-analysis found that the 90th percentile figure was measured against a February cohort heavy with repeat takers, and estimated GPT-4 below the 69th percentile against July takers, at the 48th on essays, and around the 15th on essays among those who passed. Later models score higher, but exams are written to be gradable, and a licence still attaches to a person who can be struck off. Ceded: clearing the bar; not ceded: the practice the bar is meant to gate.