AI scaling: cloud racks, agents served and price

Cloud racks

Datacenter racks and 8-GPU servers. T/s = tokens per second. Click a column heading to sort. Numbers in italics with “est.” are estimates; the basis and sources for every figure are listed below the table.

Loading data…

Basis and sources