OpenAI says its Jalapeño chip beats Nvidia Blackwell in AI inference tests
New Delhi, Aug. 26 -- OpenAI's custom Jalapeño AI chip has outperformed Nvidia's Blackwell-based GB300 in key inference benchmarks, according to results released by the company, as the ChatGPT maker works to reduce its reliance on Nvidia for running AI models.
The results, presented at the Hot Chips conference at Stanford University on Tuesday, showed Jalapeño delivering better performance per watt and faster response times in tests conducted using SemiAnalysis' InferenceX benchmark.
Jalapeño is designed for AI inference, the stage at which trained models process user requests, rather than for training AI models.
OpenAI's head of hardware Richard Ho said the chip was built to handle both high-volume workloads and applica...
Click here to read full article from source
To read the full article or to get the complete feed from this publication, please
Contact Us.