For Citations

If you need a citation for AIBench, please cite the following papers related with your work:

DC AIBench: Towards Scalable and Comprehensive Datacenter AI Benchmarking. [PDF]

Wanling Gao, Chunjie Luo, Lei Wang, Xingwang Xiong, Jianan Chen, Tianshu Hao, Zihan Jiang, Fanda Fan, Mengjia Du, Yunyou Huang, Fan Zhang, Xu Wen, Chen Zheng, Xiwen He, Jiahui Dai, Hainan Ye, Zheng Cao, Zhen Jia, Kent Zhan, Haoning Tang, Daoyi Zheng, Biwei Xie, Wei Li, Xiaoyu Wang, and Jianfeng Zhan. 2018 BenchCouncil International Symposium on Benchmarking, Measuring and Optimizing (Bench18)

HPC AI500: A Benchmark Suite for HPC AI Systems. [PDF]

AIoT Bench: Towards Comprehensive Benchmarking Mobile and Embedded device Intelligence. [PDF]

Chunjie Luo, Fan Zhang, Cheng Huang, Xingwang Xiong, Jianan Chen, Lei Wang, Wanling Gao, Hainan Ye, Tong Wu, Runsong Zhou, and Jianfeng Zhan. 2018 BenchCouncil International Symposium on Benchmarking, Measuring and Optimizing (Bench18)

Edge AIBench: Towards Comprehensive End-to-end Edge Computing Benchmarking. [PDF]

Tianshu Hao, Yunyou Huang, Xu Wen, Wanling Gao, Fan Zhang, Chen Zheng, Lei Wang, Hainan Ye, Kai Hwang, Zujie Ren, and Jianfeng Zhan. 2018 BenchCouncil International Symposium on Benchmarking, Measuring and Optimizing (Bench18)

BigDataBench: a Scalable and Unified Big Data and AI Benchmark Suite. [PDF]

Wanling Gao, Jianfeng Zhan, Lei Wang, Chunjie Luo, Daoyi Zheng, Rui Ren, Chen Zheng, Gang Lu, Jingwei Li, Zheng Cao, Shujie Zhang, and Haoning Tang. Technical Report, arXiv preprint arXiv:1802.08254, January 27, 2018.

BOPS, Not FLOPS! A New Metric and Roofline Performance Model For Datacenter Computing. [PDF]

Data Motifs: A Lens Towards Fully Understanding Big Data and AI Workloads. [PDF]

Wanling Gao, Jianfeng Zhan, Lei Wang, Chunjie Luo, Daoyi Zheng, Fei Tang, Biwei Xie, Chen Zheng, Xu Wen, Xiwen He, Hainan Ye, Rui Ren. The 27th International Conference on Parallel Architectures and Compilation Techniques (PACT18).

BigDataBench: a Big Data Benchmark Suite from Internet Services. [PDF]

Lei Wang, Jianfeng Zhan, Chunjie Luo, Yuqing Zhu, Qiang Yang, Yongqiang He, WanlingGao, Zhen Jia, Yingjie Shi, Shujie Zhang, Cheng Zhen, Gang Lu, Kent Zhan, Xiaona Li, and Bizhu Qiu. The 20th IEEE International Symposium On High Performance Computer Architecture (HPCA-2014), February 15-19, 2014, Orlando, Florida, USA.

Understanding Big Data Analytics Workloads on Modern Processors. [PDF]

Zhen Jia, Jianfeng Zhan, Lei Wang, Chunjie Luo, Wanling Gao, Yi Jin, Rui Han and Lixin Zhang. IEEE Transactions on Parallel and Distributed Systems, 28(6), 1797-1810, 2017.

Understanding Processors Design Decisions for Data Analytics in Homogeneous Data Centers. [PDF]

Zhen Jia, Wanling Gao, Yingjie Shi, Sally A. McKee, Jianfeng Zhan, Lei Wang, Lixin Zhang. IEEE Transactions on Big Data, 2017.

Data Motif-based Proxy Benchmarks for Big Data and AI Workloads. [PDF]

Wanling Gao, Jianfeng Zhan, Lei Wang, Chunjie Luo, Zhen Jia, Daoyi Zheng, Chen Zheng, Xiwen He, Hainan Ye, Haibin Wang, and Rui Ren. IEEE International Symposium on Workload Characterization (IISWC 2018).

Characterization and Architectural Implications of Big Data Workloads. [PDF]
Lei Wang, Jianfeng Zhan, Zhen Jia and Rui Han. arXiv:1506.07943 [cs.DC]

Characterizing data analysis workloads in data centers. [PDF]
Zhen Jia, Lei Wang, Jianfeng Zhan, Lixin Zhang, Chunjie Luo. 2013 IEEE International Symposium on Workload Characterization (IISWC 2013) (Best paper award).

Identifying Dwarfs Workloads in Big Data Analytics. [PDF]

W Gao, C Luo, J Zhan, H Ye, X He, L Wang, Y Zhu, X Tian. arXiv preprint arXiv:1505.06872

BDGS: A Scalable Big Data Generator Suite in Big Data Benchmarking. [PDF]

Zijian Ming, Chunjie Luo, Wanling Gao, Rui Han, Qiang Yang, Lei Wang, and Jianfeng Zhan. In Advancing Big Data Benchmarks (pp. 138-154). Springer International Publishing.

BigDataBench-MT: A Benchmark Tool for Generating Realistic Mixed Data Center Workloads. [PDF]

R Han, S Zhan, C Shao, J Wang, J Xu, LK John, L Wang, J Zhan. arXiv preprint arXiv:1504.02205

Characterizing and Subsetting Big Data Workloads. [PDF]

Zhen Jia, Jianfeng Zhan, Wang Lei, Rui Han, Sally A. McKee, Qiang Yang, Chunjie Luo, and Jingwei Li. In 2014 IEEE International Symposium on Workload Characterization (IISWC). IEEE, 2014.

BigOP: generating comprehensive big data workloads as a benchmarking framework. [pdf]

Yuqing Zhu, Jianfeng Zhan, Chuliang Weng, Raghunath Nambiar, Jingchao Zhang,
Xingzhen Chen, and Lei Wang. The 19th International Conference on Database Systems for Advanced Applications (DASFAA 2014), 2014.

BigDataBench: a Big Data Benchmark Suite from Web Search Engines.

Wanling Gao, Yuqing Zhu, Zhen Jia, Chunjie Luo, Lei Wang, Jianfeng Zhan, Yongqiang He, Shiming Gong, Xiaona Li, Shujie Zhang, and Bizhu Qiu. Third Workshop on Architectures and Systems for Big Data (ASBD 2013) in conjunction with The 40th International Symposium on Computer Architecture, May 2013.

CloudRank-D: Benchmarking and Ranking Private Cloud Computing System
for Data Processing Applications.

Chunjie Luo, Jianfeng Zhan, Zhen Jia, Lei Wang, Gang Lu, Lixin Zhang, Cheng-Zhong Xu, Ninghui Sun. Front. Comput. Sci., 2012, 6(4): 347-362.

Characterization of real workloads of web search engines.

Xi, H., Zhan, J., Jia, Z., Hong, X., Wang, L., Zhang, L., … Lu, G. (2011, November). In
2011 IEEE International Symposium on Workload Characterization (IISWC),
on (pp. 15-25). IEEE.