OpenAI posted Jalapeno's first inference results
OpenAI said Jalapeno is its first custom inference chip. The company said the chip delivered 1.5 to 1.9 times more AI work per watt. OpenAI also claimed latency was 1.7 to 3.6 times lower than comparison systems across three public models.
Verified 9:08 AM PDT · 2 original sources
OpenAI posted the first measured Jalapeno results on August 25. The company said it built the chip for inference, especially interactive agent work. OpenAI said it plans to add Jalapeno to its compute infrastructure by the end of 2026.
OpenAI supplied the benchmark claims. The company compared Jalapeno with commercial systems on public workloads. Those results do not prove that Jalapeno changes OpenAI's production costs.
OpenAI pays to serve each AI answer. If its numbers hold outside the release, Jalapeno could cut latency and power use. The chip could also give OpenAI more room in supplier negotiations.
Watch independent InferenceX results and real deployment volume. Watch the latency users feel. Jalapeno changes OpenAI's economics only if it takes enough production work off the cloud bill or the Nvidia bill.
Audit the story
Original sources
Company claims remain company claims. Follow the reporting and judge the evidence directly.
Continue the edition