Data, AI, & Machine Learning
OpenAI Says Jalapeño Beats Nvidia Systems in Inference Tests
The custom chip delivered up to 1.9 times the peak throughput per watt and cut latency by as much as 72% in company tests.
The custom chip delivered up to 1.9 times the peak throughput per watt and cut latency by as much as 72% in company tests.
The company’s first custom processor was built with Broadcom for large language model inference.