OpenAI and Broadcom Announce Jalapeño Chip for LLM Inference at Scale

OpenAI and Broadcom have announced a new chip called Jalapeño, designed specifically for large language model inference in data centers. The companies plan to deploy the chip at large data centers. They describe it as the first generation in a long-term project that will see chips refined over time.