OpenAI and Broadcom Unveil Jalapeño, an LLM-Optimized Inference Chip
OpenAI and Broadcom have unveiled Jalapeño, a custom AI accelerator designed specifically for large language model inference. Early testing indicates the chip delivers substantially better performance per watt than current state-of-the-art hardware, with deployment expected to begin at gigawatt scale by the end of 2026.