BenchCouncil AI Benchmark Specification introduces the benchmark, terminology, and background, and defines the benchmark methodology and design principles, including system under test (SUT), life of running a workload, benchmark problem domains, quality targets, scenario and metrics, implementation constraints, measure and reporting procedure, and reference implementation.
Benchmark Specification Call for Comments