OpenAI and Broadcom Unveil Jalapeño Chip for Large-Scale LLM Inference

OpenAI and Broadcom have announced a new chip called Jalapeño, designed specifically for large language model inference in data centers. The companies plan to deploy the chip at scale, positioning it as the first generation in a long-term project that will see ongoing refinements.