Posts

HiBench 7.0 Build and Run, a step-by-step guidance

This blog serves as a step-by-step guidance about how to build and run HiBench 7.0 ( https://github.com/intel-hadoop/HiBench ) on a Big Data cluster. Big Data Cluster used here is deployed through  Bigtop 1.3.0 . Components I installed are:  Hadoop: 2.8.4 Spark: 2.2.1 Regarding how I deploy Bigtop 1.3.0 on multiple physical nodes, I have another blog, which is posted on  https://collaborate.linaro.org/pages/viewpage.action?pageId=115311164 1. HiBench Build This is to install  HiBench 7.0  on Bigtop master node. 1.1. Install Maven Refer to:  https://github.com/apache/bigtop/blob/branch-1.3/bigtop_toolchain/manifests/maven.pp , which indicates 3.5.x version is required for Bigtop. Refer to: https://maven.apache.org/download.cgi , for how to download and install. # cd /usr/local/src # wget  http://www-us.apache.org/dist/maven/maven-3/3.5.4/binaries/apache-maven-3.5.4-bin.tar.gz # tar -xf apache-maven-3.5.4-bin.tar.gz # mv apache-maven-3.5.4/ apache