Full-Stack AI OpenAI and Broadcom announce chip designed for LLM inference at scale The silicon race is heating up amid the struggle to keep up with demand. Samuel Axon – Jun 24, 2026 6:28 pm | 62 OpenAI CEO Sam Altman and Broadcom President and CEO Hock Tan. Credit: OpenAI OpenAI CEO Sam Altman and Broadcom President and CEO Hock Tan. Credit: OpenAI Text settings Story text Size Small Standard Large Width * Standard Wide Links Standard Orange * Subscribers only Learn more Minimize to nav OpenAI, the company behind ChatGPT and Codex and the models those tools use, and Broadcom, an established silicon supplier, have announced a new chip, called Jalapeño, designed specifically for large language model inference in data centers. The companies intend to deploy the chip at large data centers and claim this is just the first generation in a long-term project that will see chips refined over time. Broadcom says that this ASIC (Application-Specific Integrated Circuit) was designed from scratch for LLM inference, based on “detailed insights” from the company’s conversations with researchers at OpenAI, and that the chip’s development was informed by OpenAI’s own roadmap for future models and products.
The design and production of the chip took nine months. The promise is that this chip is more specialized for the current needs of LLMs than those that inference systems currently run on in existing data centers. OpenAI claims that “early testing shows that Jalapeño will deliver performance per watt substantially better than current state-of-the-art,” but notes that it is not done measuring performance, and that a “detailed technical report will be presented in the coming months.” Until then, we don’t have many details to go on. The company, which is known for its ChatGPT and Codex services and harnesses, hopes to ultimately own the full stack behind its models and products, reducing dependence on outside companies like Nvidia and ostensibly providing better performance or efficiency thanks to vertical integration.
Source: https://arstechnica.com/gadgets/2026/06/openai-and-broadcom-announce-chip-designed-for-llm-inference-at-scale/
The design and production of the chip took nine months. The promise is that this chip is more specialized for the current needs of LLMs than those that inference systems currently run on in existing data centers. OpenAI claims that “early testing shows that Jalapeño will deliver performance per watt substantially better than current state-of-the-art,” but notes that it is not done measuring performance, and that a “detailed technical report will be presented in the coming months.” Until then, we don’t have many details to go on. The company, which is known for its ChatGPT and Codex services and harnesses, hopes to ultimately own the full stack behind its models and products, reducing dependence on outside companies like Nvidia and ostensibly providing better performance or efficiency thanks to vertical integration.
Source: https://arstechnica.com/gadgets/2026/06/openai-and-broadcom-announce-chip-designed-for-llm-inference-at-scale/