Local AI build choices ranked by measured effect

What you control when you pick a build of one model

One model name comes in many builds and can be run with many settings, and those choices are yours. Each bar is the largest measured effect of one choice, as a percentage. A plus is a gain and a minus is a cost or a reduction. Dashed lines are the tier edges at 5%, 30% and 100%. Each number comes from a different source and test, so the bars rank the size of the effect, not the choices against each other.

Details and sources

Every choice with its tier, options, what it changes, the measured effect and where the number comes from, one row per choice, ordered by tier.

Tier Choice Options What it changes Effect Source
Loading data…

How to use this

The choices that change the result most are the model itself (size tier, dense or mixture of experts), the bits, thinking and a draft model. How the build was made, the harness, caching and parallel requests are mid-sized. Which runtime you use matters least. No choice falls under 5%.

From the article What makes LLMs better, faster and cheaper: the techniques, ranked by measured effect. Data file: llm-user-choices-2026-11-19.csv.