OpenAI and Broadcom Unveil Jalapeño Chip for Large-Scale LLM Inference

OpenAI and Broadcom have announced a new chip called Jalapeño, purpose-built for large language model inference in data centers. The companies plan to deploy the chip at scale, describing it as the first generation in a long-term project that will see continuous refinements over time.