OpenAI and Broadcom Unveil Jalapeño Chip for Large-Scale LLM Inference

OpenAI and Broadcom have announced a new chip called Jalapeño, designed specifically for large language model inference in data centers. The companies plan to deploy the chip at scale and describe it as the first generation of a long-term project that will be refined over time.