HOW GOOD AI
REALLY IS.
How good AI models actually are — and what it takes to run them. Frontier-model benchmarks, the shift to test-time compute and reasoning, AI infrastructure and data-center energy demand, and AI safety, governance, and incidents. Every figure primary-sourced and dated.
Thank you for reading this post, don't forget to subscribe!
The state of play: AI capability in 2026
The capability leap is real and measurable. On SWE-bench Verified, where models resolve real GitHub issues, scores that sat in the single digits in 2023 reached roughly 72% and now approach 100% on frontier systems (Stanford HAI, 2026 AI Index). The frontier is also no longer a single-country story: the top US–China model gap on the Arena leaderboard narrowed to about 2.7% as of March 2026 (Stanford HAI).
But capability now carries a compute bill. The shift to test-time — or reasoning — compute means models “think” before they answer: median inference energy rises from about 0.31 Wh per query to roughly 3.91 Wh under a long 5,000-token reasoning workload, a ~13x jump (Stanford HAI, 2026 AI Index). At the fleet level, the IEA projects global data-center electricity to roughly double to about 945 TWh by 2030, with AI the primary driver.
That compute is highly concentrated. Epoch AI estimates the US hosts roughly three-quarters of the world’s AI-supercomputer performance, with the US and China together holding close to 90%. Capability may be converging; the hardware behind it is not.
- Benchmarks are nearing saturation: SWE-bench Verified went from single digits to ~72% and climbing (Stanford HAI, 2026 AI Index).
- Reasoning is expensive: per-query inference energy can rise ~13x, and data-center demand heads toward ~945 TWh by 2030 (IEA).
- Compute is concentrated: ~75% of AI-supercomputer performance sits in the US, and the US plus China hold about 90% (Epoch AI).
AI Model Benchmarks 2026
SWE-bench jumped from 4.4% to 71.7% in a year (Stanford HAI). MMLU saturated above 92%. US–China gap at 2.7%.
Test-Time Compute & Reasoning Models
Deep Research hit 26.6% on Humanity’s Last Exam. Gemini Deep Think won IMO 2025 gold (35/42).
AI Infrastructure 2026
Data-center electricity: 415 TWh (2024) → ~945 TWh by 2030 (IEA). IDC: AI infra spend $487B in 2026, >$1T by 2029.
AI Safety & Governance 2026
AI incidents, the EU AI Act, US regulation, and responsible-AI adoption — the policy and risk picture.
Compare AI statistics year over year
Put any two figures side by side, 2022–2026, with sources attached.