BenchCouncil AI Benchmark Specification introduces the benchmark, terminology, and background, and defines the benchmark methodology and design principles, including system under test (SUT), life of running a workload, benchmark problem domains, quality targets, scenario and metrics, implementation constraints, measure and reporting procedure, and reference implementation.

Benchmark Specification Call for Comments

BenchCouncil^TM AIBench Standard Specification Draft 1.0 [PDF]
BenchCouncil^TM HPC AI500 Standard Specification Draft 1.0 [PDF]
BenchCouncil^TM Edge AIBench Standard Specification Draft 1.0 [PDF]
BenchCouncil^TM AIoTBench Standard Specification Draft 1.0 [PDF]