Overview

News: We are organizing workshop on Big data Benchmarks, Performance Optimization, and Emerging Hardware with VLDB 2014.

We will upgrade big data analytics benchmarks and report the performance number of Shark, Impala, and Hive soon.

BigDataBench is a big data benchmark suite from internet services (Please refer to our summary paper and our presentation (.ppt) at HPCA 2014). It includes six real-world data sets, and nineteen big data workloads, covering six application scenarios: micro benchmarks, Cloud "OLTP", relational query, search engine, social networks, and e-commerce. In generating representative and variety of big data workloads, BigDataBench features an abstracted set of Operations and Patterns for big data processing (Please refer to our DASFAA paper ). BigDataBench also provides several big data generation tools–BDGS– to generate scalable big data, e.g, PB scale, from small-scale real-world data while preserving their original characteristics. For the same workloads, different implementations are provided. For example, we and other developers implemented the offline analytics workloads using MapReduce, MPI, Spark, DataMPI, and etc. Several users used BigDataBench for different purposes, e. g., workload characterization and evaluating hardware systems.

License

BigDataBench is available for researchers interested in big data. Software components of BigDataBench are all available as open-source software and governed by their own licensing terms. Researchers intending to use BigDataBench are required to fully understand and abide by the licensing terms of the various components. BigDataBench is open-source under the Aapche License, Version 2.0. Please use all files in compliance with the License.

Benchmarks

Covering six application scenarios, BigDataBench 2.0 includes six real-world data sets and nineteen big data workloads.

Table 1: The Summary of Six Data Sets

Table 2: The Summary of BigDataBench

Downloads

Downloading user manuals

Publications

For Citations

If you need a citation for BigDataBench, please cite the following papers related with your work:

BigDataBench: a Big Data Benchmark Suite from Internet Services. [PDF]

Lei Wang, Jianfeng Zhan, Chunjie Luo, Yuqing Zhu, Qiang Yang, Yongqiang He, Wanling Gao, Zhen Jia, Yingjie Shi, Shujie Zhang, Cheng Zhen, Gang Lu, Kent Zhan, Xiaona Li, and Bizhu Qiu. The 20th IEEE International Symposium On High Performance Computer Architecture (HPCA-2014), February 15-19, 2014, Orlando, Florida, USA.

BigOP: generating comprehensive big data workloads as a benchmarking framework. [pdf]

Yuqing Zhu, Jianfeng Zhan, ChuliangWeng, Raghunath Nambiar, Jingchao Zhang,
Xingzhen Chen, and Lei Wang. The 19th International Conference on Database Systems for Advanced Applications (DASFAA 2014), 2014.

BDGS: A Scalable Big Data Generator Suite in Big Data Benchmarking. [PDF]

Zijian Ming, Chunjie Luo, Wanling Gao, Rui Han, Qiang Yang, Lei Wang, and Jianfeng Zhan. Lecture note in computer sciences, extended version for the fourth workshop on big data benchmarking, 2014.

BigDataBench: a Big Data Benchmark Suite from Web Search Engines

Wanling Gao, Yuqing Zhu, Zhen Jia, Chunjie Luo, Lei Wang, Jianfeng Zhan, Yongqiang He, Shiming Gong, Xiaona Li, Shujie Zhang, and Bizhu Qiu. Third Workshop on Architectures and Systems for Big Data(ASBD 2013) in conjunction with The 40th International Symposium on Computer Architecture, May 2013.

Presentations:

BigDataBench: A big data benchmark suite

Jianfeng Zhan, Professor, invited talk at Third Workshop on Big Data Benchmarking. 2013.

Research Highlights of BPOE

Jianfeng Zhan, Professor, invited talk at Forth Workshop on Big Data Benchmarking 2013. [PPT]

BigDataBench: Benchmarking Big Data Systems

Yingjie Shi, Assistant professor, invited talk at First Workshop on Big Data Benchmarks, Performance Optimization, and Emerging Hardware, In conjunction with IEEE Big Data 2013.[PPT]

Benchmarking Datacenter and Big Data Systems

Jianfeng Zhan, professor, invited talk at Third Workshop on Big Data Benchmarking 2013 [PPT]

BigDataBench: a Big Data Benchmark Suite from Web Search Engines

Jianfeng Zhan, professor, Third Workshop on Architectures and Systems for Big Data(ASBD 2013) in conjunction with The 40th ISCA 2013. [PPT]

BigDataBench: a Benchmark Suite for Big Data Application

Wanling Gao, Ph.D candidate, the 19th IEEE International Symposium on High Performance Computer Architecture (HPCA 2013) Tutorial [PPT]

The Implications of Diverse and Scalable Data Sets in Benchmarking Big Data Systems

Zhen Jia, Ph.D candidate, Second Workshop on Big Data Benchmarking 2012 [PPT]

News

2014-3-14, MPI and Spark implementations are released.

2014-2-27, Prof. Jianfeng Zhan gave an open talk at Ohio State University.

2014-2-18, Prof. Jianfeng Zhan gave a talk about BigDataBench at HPCA 2014.

2014-1-15, Our another paper about BigDataBench is accepted by a data management conference– DASFAA 2014.

2014-1-4, Our paper about BigDataBench 2.0 is accepted by HPCA 2014 [PDF]

2013-11-22, Prof. Jianfeng Zhan gave a talk at IBM Austin Research Laboratory.

2013-10-9, Professor Jianfeng Zhan gave a invited talk at Fourth Workshop on Big Data Benchmarking

2013-10-8, BigDatabench 2.0 Realeased

2013-10-8, Assistant professor Yingjie Shi gave a invited talk at First Workshop on Big Data Benchmarks, Performance Optimization, and Emerging Hardware.

2013-6-25, professor Jianfeng Zhan gave a presentation at the ASBD 2013 in conjunction with The 40th ISCA. [PPT]

2013-6-25, BigDatabench 1.0 Realeased

2013-6-16, Professor Jianfeng Zhan gave a invited talk at Third Workshop on Big Data Benchmarking [PPT]

2013-2-24, Ph.D candidate Wanling Gao gave a presentation at the HPCA 2013 Tutorial [PPT]

Users

(Please write to zhanjianfeng@ict.ac.cn if you have suggestions of other papers or would like to have your publications included here. )

Comments to BigDataBench

(1) Guojie Li, Big Data Challenges to Computer Systems (in Chinese), Communication of CCF, Vol. 9, December, 2012.

(2) Nicole Hemsoth (HPCWire Editor), Toward Comprehensive Big Data Benchmarking. 2014.1.3

Research Projects Using BigDataBench

(1) DataMPI, Prof. Zhiwei Xu, Fan Liang(ICT, Chinese Academy of Sciences), Dr. Xiaoyi Lu (Ohio State University)

Research Papers Using BigDataBench

1. Workload Characterization

3. Performance diagnosis and Optimization of Big Data Systems

4. Evaluating and Optimizating Big Data Systems Energy Eficiency

5. Evaluation of Virtualization Systems

6. Evaluating Programming Systems

Other Papers Citing BigDataBench

1. Data Center Resource Managment

2. Hadoop Systems Evaluation and Optimization

People

• Prof. Jianfeng Zhan
• Lei Wang
• Chunjie Luo
• Yuqing Zhu
• Qiang Yang
• Wanling Gao
• Zijian Ming

Contact Us

Email:

zhanjianfeng@ict.ac.cn

wl@ncic.ac.cn

ICTBench

http://prof.ict.ac.cn/ICTBench

Workshop on Big Data Benchmarks

http://prof.ict.ac.cn/bpoe