The LLM Leaderboard & Benchmark Repository

An LLM leaderboard ranks language models by benchmark score. This one publishes raw results — MMLU-Pro, GPQA Diamond, SWE-bench Verified, LiveCodeBench, Aider Polyglot, BFCL and Chatbot Arena ELO — for every major frontier and open-weights model, with token pricing on each row, source attribution on every score, and a daily refresh.

The full table is open: sort any column, filter to open weights, and jump to what each benchmark measures. Only the CSV export asks for an email.

LLM Benchmarks 2026 Intelligence Index SWE-bench Verified GPQA Diamond Agentic Evaluation Chatbot Arena ELO
Models Tracked
20+
Benchmarks
4
Live Sources
Daily
Refresh Cadence
Need help choosing? Pair these scores with our LLM selection guide, then plan deployment with the hardware sizing guide and token cost guide.
Read the Selection Guide
Search
Providers
Benchmarks (Spec Sheet)
Provider Model Context Input $/M Output $/M
Loading benchmark snapshot...

Download the Full Benchmark CSV

Get the complete snapshot of all tracked models, their raw benchmark scores, and source attribution. We'll email you when new benchmarks or sources go live.

What are the most important LLM benchmarks in 2026?

The most important LLM benchmarks in 2026 are MMLU-Pro (broad reasoning), GPQA Diamond (graduate-level science), SWE-bench Verified and Aider Polyglot (real-world coding), BFCL (tool/function calling), and Chatbot Arena ELO (human preference). Compare raw scores — not opaque composite indexes — against your specific use case, then validate the shortlist with our LLM selection guide.

The benchmarks on this LLM leaderboard, and what each one measures

The leaderboard above carries one column per benchmark. Each section below says what that benchmark tests, how the score is produced, and which source supplies it, with a link that reloads the table ranked by that column. Benchmarks whose sources have published no model scores yet are marked on their card instead of linking to an empty ranking.

Knowledge and reasoning benchmarks: MMLU-Pro, GPQA Diamond and BIG-Bench Hard

These columns separate models on breadth of knowledge, factual reliability and multi-step reasoning. Together they are the closest thing to a general capability read, which is exactly why they belong side by side as separate numbers rather than averaged into one.

MMLU-Pro

A multiple-choice exam across fourteen academic and professional domains. It extends the original MMLU with ten answer options instead of four and drops the items frontier models had already saturated, so the spread between models is readable again.

Scored as
Accuracy, 0-100%
Source
Hugging Face Open LLM Leaderboard v2
Rank every model by MMLU-Pro

GPQA Diamond

The hardest 198 questions of the Graduate-Level Google-Proof Q&A set, written by PhD holders in physics, chemistry and biology and validated so that non-experts with web access still fail them.

Scored as
Accuracy, 0-100%
Source
Hugging Face Open LLM Leaderboard v2, with published model-card results backfilled
Rank every model by GPQA Diamond

BIG-Bench Hard

Twenty-three BIG-Bench tasks that language models had not beaten against the average human rater when the suite was published: logic grids, symbol manipulation, date arithmetic and multi-hop deduction.

Scored as
Accuracy, 0-100%
Source
Hugging Face Open LLM Leaderboard v2
Rank every model by BIG-Bench Hard

Humanity's Last Exam

Expert-written closed-ended questions across mathematics, the natural sciences and the humanities, assembled by the Center for AI Safety and Scale AI to stay unsaturated after models cleared MMLU-style tests.

Scored as
Accuracy, 0-100%
Source
Curated from published results
Rank every model by Humanity's Last Exam

SimpleQA

Short factual questions with a single verifiable answer, written by OpenAI so that a model either holds the fact or does not. It doubles as a hallucination read, because a confident wrong answer scores exactly as badly as no answer at all.

Scored as
Accuracy, 0-100%
Source
Epoch AI benchmark data, with published model-card results backfilled
Rank every model by SimpleQA

MMMLU

The MMLU question set translated into fourteen languages. It separates models that carry their English knowledge across languages from models that lose a large share of it in translation.

Scored as
Accuracy, 0-100%
Source
Curated from published model cards
Rank every model by MMMLU

ARC-AGI-2

The second Abstraction and Reasoning Corpus: coloured grid puzzles where each task carries its own rule that has to be inferred from two or three examples. It is built to resist pattern matching, so scores stay low even at the frontier.

Scored as
Accuracy, 0-100%
Source
Epoch AI benchmark data
Rank every model by ARC-AGI-2

Math and problem-solving benchmarks: AIME, FrontierMath and MATH Level 5

Math columns are the least forgiving on the leaderboard because the answer is either right or it is not. They are also where contamination shows up fastest, which is why the contamination-resistant sets belong in the same view as the classic ones.

AIME

Problems from the American Invitational Mathematics Examination. Every answer is an integer between 0 and 999, so scoring needs no judge model and no partial credit.

Scored as
Accuracy, 0-100%
Source
Curated from published model cards and public evaluations
Rank every model by AIME

FrontierMath

Research-level problems commissioned by Epoch AI from working mathematicians and deliberately kept unpublished, so a model cannot have seen them during training.

Scored as
Accuracy, 0-100%
Source
Epoch AI benchmark data
Rank every model by FrontierMath

MATH Level 5

The hardest tier of the MATH competition set. Only Level 5 problems count, scored on the final answer rather than on the working.

Scored as
Accuracy, 0-100%
Source
Hugging Face Open LLM Leaderboard v2
Rank every model by MATH Level 5

MuSR

Multistep Soft Reasoning: long natural-language scenarios such as murder mysteries, object placement and team allocation, where the model has to hold several inferences at once to answer.

Scored as
Accuracy, 0-100%
Source
Hugging Face Open LLM Leaderboard v2
Rank every model by MuSR

GSM8K

Grade-school arithmetic word problems that take a short chain of steps to solve. Saturated at the frontier, and kept on the leaderboard because it still separates small open-weights models from one another.

Scored as
Accuracy, 0-100%
Source
Epoch AI benchmark data, with published model-card results backfilled
Rank every model by GSM8K

Coding benchmarks: SWE-bench Verified, LiveCodeBench and Aider Polyglot

The coding columns are the most decision-relevant on this leaderboard because they are verified by test suites rather than by a judge model. Sort on the one that matches your workload: repository-scale patches, competitive problems, or multi-language edits.

SWE-bench Verified

Five hundred human-validated GitHub issues drawn from real Python repositories. A model has to produce a patch, and the patch only counts when the repository’s own test suite passes.

Scored as
Issues resolved, 0-100%
Source
SWE-bench leaderboard
Rank every model by SWE-bench Verified

LiveCodeBench

Competitive-programming problems published after each model’s training cutoff, on a rolling window. The design makes the score hard to inflate by memorising public solutions.

Scored as
Accuracy, 0-100%
Source
Curated from the LiveCodeBench project
Rank every model by LiveCodeBench

Aider Polyglot

Exercism exercises across C++, Go, Java, JavaScript, Python and Rust, scored by whether the model’s edited files pass the exercise unit tests. It measures editing an existing file, not writing one from scratch.

Scored as
Exercises passed, 0-100%
Source
Curated from the Aider leaderboard
Rank every model by Aider Polyglot

HumanEval

One hundred and sixty-four hand-written Python functions scored against unit tests on the first attempt. Saturated at the frontier, and kept on the leaderboard because it still separates smaller and older open-weights models.

Scored as
pass@1, 0-100%
Source
Curated from published results
Rank every model by HumanEval

Agentic and tool-calling benchmarks: BFCL V4, Terminal-Bench and Cybench

Agent workloads fail on tool calls and long horizons rather than on knowledge. These columns are the ones to sort by before putting a model behind a function-calling API or a shell.

BFCL V4

The Berkeley Function-Calling Leaderboard. Emitted calls are compared by abstract syntax tree against the expected call, so a model cannot score by describing the call in prose or by guessing plausible arguments.

Scored as
Accuracy, 0-100%
Source
Curated from the Berkeley Gorilla project
Rank every model by BFCL V4

Terminal-Bench

End-to-end tasks in a real shell. The model runs commands, reads the output and recovers from its own failures before the task is scored complete, which makes it a long-horizon test rather than a single-turn one.

Scored as
Tasks completed, 0-100%
Source
Curated from published results
Rank every model by Terminal-Bench

SWE-bench Live

A continuously refreshed SWE-bench variant built from recent repository issues, so the task pool keeps moving ahead of training cutoffs.

Scored as
Issues resolved, 0-100%
Source
Curated from published results
Rank every model by SWE-bench Live

ToolComp

Multi-step tool-use problems with supervision at each step, so the score reflects where a chain of calls broke rather than only whether the final answer was right.

Scored as
Accuracy, 0-100%
Source
Curated from published results
Rank every model by ToolComp

Cybench

Capture-the-flag security tasks that require running commands in a shell and chaining several steps before a flag comes back. It reads agentic execution under adversarial conditions rather than security knowledge.

Scored as
Accuracy, 0-100%
Source
Epoch AI benchmark data
Rank every model by Cybench

Instruction-following benchmarks: IFEval, IFBench and WildBench

Instruction following is what breaks structured output in production: the model is capable, and it still returns six bullets when the schema asked for four. Two of these three columns are checked by a program; the third is judged by a model and tagged accordingly.

IFEval

Verifiable instruction constraints such as word counts, casing, formats and forbidden words, checked by a program rather than by a judge model.

Scored as
Accuracy, 0-100%
Source
Hugging Face Open LLM Leaderboard v2
Rank every model by IFEval

IFBench

Held-out constraint types that do not appear in IFEval-style training data, which separates genuine instruction following from memorised formats.

Scored as
Accuracy, 0-100%
Source
Curated from published results
Rank every model by IFBench

WildBench

Real user tasks collected from in-the-wild traffic and scored by an LLM judge against per-task checklists. It carries the JUDGE tag on this leaderboard because the scorer is itself a model.

Scored as
Win rate, judged
Source
Curated from published results
Rank every model by WildBench

Human preference: Chatbot Arena ELO

Preference ratings answer a different question from accuracy benchmarks: which answer did a person prefer when the two were shown side by side. Useful, and never comparable to a percentage score.

Chatbot Arena ELO

Crowdsourced pairwise votes between two anonymous models, converted into an ELO-style rating that generally sits between about 1,000 and 1,600. It is a preference signal, not an accuracy measurement, so it is tagged PREF and styled apart from every objective column.

Scored as
ELO rating
Source
LMArena community mirror
Rank every model by Chatbot Arena ELO

What each model costs per million tokens

Two more columns sit beside the benchmark scores: input and output price per million tokens, taken from the OpenRouter catalog in the same daily snapshot as the scores. Sort by either one to see the cost of the models a benchmark column just ranked, and read the pair together — an output-heavy workload can cost several times more on a model with an attractive input price.

What the price columns do not cover. Throughput and time-to-first-token are properties of the serving stack, not of the model: the same weights answer at different speeds on different hardware, batch sizes and quantisations, so this leaderboard does not publish a speed column it cannot source. Model the full bill with the LLM pricing calculator, size the hardware behind a self-hosted deployment with the hardware sizing guide, and shortlist against requirements in the LLM selection guide.

Why raw benchmarks beat composite indexes

Almost every LLM leaderboard on the public internet publishes a composite intelligence index — a single 0–100 number computed by weighted-averaging whatever benchmarks happened to be available for each model. These composites look clean and sortable, but they have three fundamental problems that make them actively misleading for real decisions.

Problem 1: composites hide sparsity. Imagine two models. Model A scored 80 on GPQA and nothing else. Model B scored 80 on GPQA, 79 on MMLU-Pro, 78 on SWE-bench, 82 on MATH, and 77 on BBH. A composite "intelligence index" might give both models the same 80 — because the average of 80 is 80, and the average of (80, 79, 78, 82, 77) is also ~79. You cannot tell them apart from the composite alone, even though Model B's number is backed by 5× the evidence and Model A's is a single data point that could easily be wrong.

Problem 2: composites mix incomparable scales. Chatbot Arena ELO ranges from ~1000 to ~1600 and measures subjective human preference. MMLU-Pro is a 0–100% accuracy score on multiple-choice questions. SWE-bench Verified is the percentage of GitHub issues a model resolved that passed the actual test suite. These three things measure completely different phenomena and cannot be meaningfully averaged — but composites do it anyway.

Problem 3: composites hide what was weighted. Every composite has a proprietary formula. Is Intelligence weighted 30% or 40%? Does Coding include SWE-bench Live or only SWE-bench Verified? Does the "Reasoning" index include AIME, or not? You have to read a methodology page to find out — if one even exists. Raw benchmarks need no explanation: the number means exactly what the benchmark page says it means.

Our approach: This repository shows only raw benchmark scores, direct from each source, with a clear source link on every cell. No hidden weights. No normalized scaling. No averaging of incomparable things. You add the columns you care about, you see the actual numbers, and you judge comparability yourself.

Raw scores also do not transfer one-for-one to enterprise workloads: a model that tops a public eval can still miss on your contracts, policies and product data. For that counterpoint, see why the most powerful model is not the most accurate on company data.

Which benchmarks actually matter in 2026?

Many of the benchmarks from the GPT-3 era are now fully saturated — top models routinely score 95%+ on MMLU, HumanEval, and HellaSwag, making them useless for distinguishing frontier capability. The benchmarks that do matter in 2026 share three properties:

  1. Contamination-resistant. LiveBench rotates new questions monthly from recently-published research. FrontierMath sources from unpublished research papers. LiveCodeBench uses post-cutoff competitive programming problems.
  2. Verifiable. SWE-bench runs the PR against the repo’s actual test suite. Aider Polyglot scores against Exercism unit tests. BFCL uses Abstract Syntax Tree comparison rather than LLM-as-judge.
  3. Long-horizon. SWE-bench Pro averages 107 lines of changes across 4.1 files per task. Terminal-Bench requires multi-step shell execution. These measure real-world capability, not pattern-matching.

Use the open-weight filter on the table above to see how locally deployable models place against closed frontier systems, and pair it with the LLM rankings 2026 for a shortlist organised by deployment scenario.

Running the best benchmark winners privately

The Intelligence and Coding champions on this leaderboard are increasingly open-weight models — Llama 4, DeepSeek V3.2, Qwen 3.6, Kimi K2 Thinking, MiniMax M2.7 — that match or beat GPT-5 on specific evals at 1/20th the cost. The challenge for enterprises is running them privately: fully air-gapped, with no data leaving the device.

Iternal's AirgapAI platform runs any of these open-weights models locally with Intel Core Ultra chipsets, requires zero cloud dependency, and matches GPU-class performance on modern laptops. Use this benchmark repository to pick the right model, then deploy it without giving your data to a hyperscaler.

Data freshness & sources

The repository refreshes every 24 hours via a Cloudflare Cron Trigger. On each run, a worker fetches from four live sources in parallel: OpenRouter for the model catalog, pricing, and context windows; SWE-bench for software engineering scores; the LMArena community mirror for crowdsourced Chatbot Arena ELO; and the Hugging Face Open LLM Leaderboard v2 for MMLU-Pro, GPQA, BBH, IFEval, MATH Lvl 5, and MuSR. Benchmarks the live sources don’t cover — FrontierMath, HLE, LiveCodeBench, Aider Polyglot, BFCL V4, HumanEval, Terminal-Bench, AIME — are backfilled from a curated seed compiled from model-provider announcements and public research papers. The health of every source is shown in the summary strip above the table, and any single source failure simply falls through to the next without breaking the snapshot. Every cell in the detail drawer shows exactly which source provided the score and when it was fetched.

Frequently Asked Questions

Why raw scores instead of a composite index?
Composite "intelligence indexes" look tidy but hide what actually matters. A model with one GPQA score of 80 and a single-benchmark composite of 80 looks identical to a model that averages 80 across 15 benchmarks — even though they represent wildly different levels of confidence in the number. By showing only raw benchmarks, you can see exactly which evaluations a model was tested on, which it skipped, and judge comparability yourself. No hidden weights, no normalized fudging, no apples-to-oranges combinations.
Where does the benchmark data come from?
Data is pulled daily via Cloudflare Cron from four live sources: OpenRouter (model catalog, pricing, context windows), SWE-bench (software engineering), the LMArena community mirror (Chatbot Arena ELO), and the Hugging Face Open LLM Leaderboard v2 (MMLU-Pro, GPQA, BBH, IFEval, MATH Lvl 5, MuSR). Benchmarks the live sources don't cover — FrontierMath, HLE, LiveCodeBench, Aider Polyglot, BFCL V4, HumanEval, Terminal-Bench, AIME — are backfilled from a curated seed compiled from public research and model-provider announcements. Every cell in the detail drawer shows its source and timestamp.
How often is the data updated?
The repository is refreshed once every 24 hours via a Cloudflare Cron Trigger at 06:00 UTC. The sync fetches all sources in parallel with Promise.allSettled so a single source outage cannot corrupt the snapshot. Each source's freshness and health status is shown in the summary strip above the table.
Why do different models have different numbers of benchmarks?
LLM providers and evaluation labs publish on different benchmarks. OpenAI might publish GPQA and SWE-bench for a new model but skip Aider Polyglot; an open-weights lab might run Hugging Face's Open LLM Leaderboard suite but not the proprietary Scale SEAL evals. This is exactly why raw scores matter: a gap in a column is informative — it tells you "we don't know" — whereas a composite would silently invent a number from whatever happened to be available.
Why is Chatbot Arena ELO shown differently?
Chatbot Arena ELO is a crowdsourced human-preference rating on a ~1000–1600 scale, not a 0–100 accuracy measurement. Mixing it with objective benchmarks is misleading — you can't directly compare "1504 ELO" to "82% on MMLU-Pro". Arena ELO is shown in its own "Human Preference (Subjective)" category with the raw ELO displayed, clearly tagged PREF, and visually styled with a dashed amber border so you never accidentally confuse it with an objective score.
How do I compare specific models?
Add the benchmark columns you care about from the sidebar picker (or use the "Add Benchmark Columns" quick-select dropdown at the top). Sort by any column. Pin up to 5 models using the thumbtack icon and toggle "Pinned Only" for a head-to-head view. Copy the "Share" link to send the exact filtered view to a colleague — all filters, pins, columns, and sort order are encoded in the URL.
Can I export the data?
Yes. The "Export CSV" button downloads your current filtered view with every raw benchmark score, the source that provided it, and the fetch timestamp. We ask for an email before the first export so we can notify you when new benchmark sources go live.
Which benchmarks actually matter in 2026?
Most GPT-3 era benchmarks (MMLU, HumanEval, HellaSwag) are now saturated — top models routinely score 95%+ which makes them useless for distinguishing frontier capability. The benchmarks that matter in 2026 are contamination-resistant (LiveBench rotates questions monthly, FrontierMath uses unpublished research, LiveCodeBench uses post-cutoff problems), verifiable (SWE-bench runs actual test suites, Aider Polyglot uses Exercism unit tests, BFCL uses AST comparison), and long-horizon (SWE-bench Pro averages 107 lines of changes across 4.1 files). Click any column header to sort by it — focus on GPQA Diamond, SWE-bench Verified, and FrontierMath for the sharpest frontier signal.
Which models should I actually deploy in production?
Public benchmarks tell you which models are capable on standardized tests — not which are right for your specific use case. Use this repository to narrow down 2–3 candidates based on the benchmarks closest to your workload, then run them against your own private evaluation set. Public benchmarks cannot predict production behavior on your data. Iternal's AirgapAI platform can run any open-weights model listed here in a fully private, on-premise deployment.
Is this a leaderboard or a composite LLM ranking?
It works as a per-benchmark leaderboard: sort any column — MMLU-Pro, GPQA Diamond, SWE-bench Verified, Aider Polyglot, BFCL, or Chatbot Arena ELO — to rank every tracked model on that benchmark, and use the open-weights filter to turn it into a local-LLM leaderboard. What it deliberately is not is a composite ranking: we never average scores into a single index, because composites hide trade-offs. A model that tops coding leaderboards can rank mid-pack on tool calling, so sort by the benchmark closest to your workload.
What is an LLM leaderboard?
An LLM leaderboard ranks language models by their score on a benchmark. This one is per-benchmark rather than composite: pick a column — MMLU-Pro, GPQA Diamond, SWE-bench Verified, LiveCodeBench, Aider Polyglot, BFCL V4 or Chatbot Arena ELO — and the table ranks every tracked model on that measurement, with the source of each score and the price per million tokens on the same row. There is no gate on the table; only the CSV export asks for an email.
Which model is cheapest per million tokens?
The cheapest models on this leaderboard list at about $0.02 per million input tokens, while the most expensive frontier reasoning tier runs to $150 per million input and $600 per million output (OpenRouter catalog, refreshed daily). Sort the leaderboard by the Input $/M or Output $/M column for the current order: both prices ride the same daily snapshot as the scores, so the ranking moves when list prices move. Read the two columns together: reasoning models emit far more output tokens than they consume, so the output price usually dominates the bill. For a full workload estimate with volume and caching assumptions, use the LLM pricing calculator.
Does this leaderboard measure LLM speed or latency?
No. Throughput and time-to-first-token are properties of the serving stack rather than of the model — the same weights answer at different speeds depending on hardware, batch size, quantisation and how far the request travels — so publishing a single speed number per model would be misleading. The leaderboard tracks accuracy-style benchmark scores, context window and token price, and the hardware sizing guide covers what determines speed in a self-hosted deployment.

Deploy the top-ranked open-weight model privately

Pick your model here. Run it on your own hardware with AirgapAI — no cloud, no data egress, no per-token bills. Match GPU-class performance on Intel Core Ultra laptops.