Nvidia comes out on top in first MLPerf inference benchmarks
The first benchmark results from the MLPerf consortium have been released and Nvidia is a clear winner for inference performance.
For those unaware, inference takes a deep learning model and processes incoming data however it’s been trained to.
MLPerf is a consortium which aims to provide “fair and useful” standardised benchmarks for inference performance. MLPerf can be thought of as doing for inference what SPEC does for benchmarking CPUs and general system...