OpenAI and Broadcom unveil Jalapeño chip for large-scale LLM inference

OpenAI and Broadcom have announced a new chip called Jalapeño, specifically designed for large language model inference in data centers. The companies plan to deploy the chip at large-scale facilities, marking the first generation of a long-term project that will see successive refinements over time.