MLPerf Inference Test Bench

MLPerf Inference Test Bench, or Mitten, is a framework by NVIDIA to run the MLPerf Inference benchmark.

Features

Mitten, while more optimized for NVIDIA GPU-based systems, is a generic framework that supports arbitrary systems. Some of the things that Mitten handles are:

• System Detection
• Benchmark Configuration
• SUT Harnesses running as a separate executable