BenchCouncil Testbed: Tai

BenchCouncil Testbed---Tai---is the world's first large-scale and open artificial intelligence testbed, aiming to provide platforms for verification and demonstration of new technology, and provide tools for training education and communication.


(1)Accelerators for the construction of industry ecology. Tai provides evidence for defining specifications and benchmarks for new technology, and publish performance numbers.

(2)Tai has the ability to simulate large-scale complex scenarios and supports rapid construction and deployment.

(3)Tai provides training education platforms and commnumcation tools---Xinxiu.

(4)Tai provides competition platforms for BenchCouncil International AI System and Algorithm Competition, with the total awards 500,000 CNY.

Computing Nodes in Tai

Tai is mainly conducted and managed by International Open Benchmarking Council (BenchCouncil), while most compute resources are jointly provided by National Supercomputing Center in Shenzhen, Cambricon, Ohio State University, CloudTA, CSTC, Zhejiang Lab, China RISC-V Alliance, and Institute of Computing Technology.

Tai Architecture

Testbed not only provides multiple mainstream evaluation environment, but also supports the environment generation within seconds and supports specified cluster environment according to evaluation requirements. The testbed gathers various the state-of-the-art or state-of-the-practice hardware environment, including multiple GPUs and CPUs with different versions, Cambrian, RISC-V.

Prominent Systems and Applications:

  • E-commerce business AI evaluation environment for Alibaba
  • EB-level intelligent data management and analysis system for high-energy physics
  • AI-powered weather forecast platform
  • Federal learning testbed
  • Edge computing testbed