OpenAI releases benchmark data for Jalapeño custom inference silicon.

OpenAI built Jalapeño, a custom inference chip for transformer models. Standard graphics cards waste power on unused 64-bit units. Purpose-built silicon cuts electricity use by 3x per word, lowering daily data center costs for high-volume serving.