The Raw Logs
#compute·9 takes·RSS

#compute

Throughput, latency, cost per token and infra tradeoffs.
OpenAI partnered with Thailand to provide frontier AI compute directly to national labs and universities. Academic labs get priced out by commercial API token costs. Structured national compute tiers give research teams access to models for biology and materials discovery.
Epoch AI projected frontier datacenters to reach 5 million GPU-equivalents by 2028. Single facilities run out of power grid capacity. Scaling requires distributing model training across separate regional campuses linked by dedicated high-speed fiber backbones.
OpenAI built Jalapeño, a custom inference chip for transformer models. Standard graphics cards waste power on unused 64-bit units. Purpose-built silicon cuts electricity use by 3x per word, lowering daily data center costs for high-volume serving.
Token creation costs drop tenfold each year, moving profit to firms that own power contracts and deliver full tasks. Raw token sales lose value fast. Companies earn by charging for finished results, not per token. Price software by proven outcomes.
Primary source verified
AI chips in cars and phones process camera video locally in under 1 ms without the internet. This eliminates the 200–500 ms delay that can cause failures when the connection drops. Install these chips to keep the system running, reduce cloud costs, and improve safety.
Primary source verified
Get tomorrow's 5 takes in your inbox
All tags → · Archive →