OpenAI and Broadcom Unveil Jalapeño Chip for Large-Scale LLM Inference

OpenAI and Broadcom have announced a new chip, named Jalapeño, specifically designed for large language model inference in data centers. The companies plan to deploy the chip at large data centers and describe it as the first generation of a long-term project that will see continuous refinement of the silicon over time.