Linux环境编译Hadoop源码包

hadoop2.7.4centos6.51.准备的资料源码根目录下有个BUILDINT.txt打开即可看见里面关于编译hadoop的一些环境要求/opt/software/ 存放软件安装包/opt/module/ 存放解压包2.安装JDK(1.8)[rootmaster-node software]# tar -zxvf jdk-8u211-linux-x64.tar.gz -C /opt/module/ [rootmaster-node software]# vim /etc/profile #Java配置 export JAVA_HOME/opt/module/jdk1.8.0_211 export CLASSPATH.:$JAVA_HOME/jre/lib/rt.jar:$JAVA_HOME/lib/dt.jar:$JAVA_HOME/lib/tools.jar export PATH$JAVA_HOME/bin:$PATH [rootmaster-node software]# source /etc/profile [rootmaster-node software]# java -version3.安装maven(3.6.1)[rootmaster-node software]# tar -zxvf apache-maven-3.6.1-bin.tar.gz -C /opt/module/ [rootmaster-node apache-maven-3.6.1]# vim conf/settings.xml mirrors !--添加阿里镜像-- mirror idalimaven/id mirrorOfcentral/mirrorOf namealiyun maven/name urlhttps://maven.aliyun.com/repository/central/url /mirror mirror idaliyun-maven/id mirrorOf*/mirrorOf namealiyun maven/name urlhttp://maven.aliyun.com/nexus/content/groups/public/url /mirror /mirrors [rootmaster-node software]# vim /etc/profile #Maven配置 export MAVEN_HOME/opt/module/apache-maven-3.6.1 export PATH$PATH:$MAVEN_HOME/bin [rootmaster-node software]# source /etc/profile [rootmaster-node software]# mvn -version4.安装cmake,zlib-devel,openssl-devel 依赖库[rootmaster-node software]# yum -y install cmake zlib-devel openssl-devel5.安装ProtocolBuffer 2.5.0[rootslave-node1 software]# tar -zxvf protobuf-2.5.0.tar.gz -C /opt/module/ [rootslave-node1 software]# cd /opt/module/protobuf-2.5.0/ [rootmaster-node protobuf-2.5.0]# ./configure --prefix/opt/module/protobuf [rootmaster-node protobuf-2.5.0]# make [rootmaster-node protobuf-2.5.0]# make check [rootmaster-node protobuf-2.5.0]# make install [rootmaster-node protobuf-2.5.0]# vim /etc/profile #Protobuf配置 export PROTOC_HOME/opt/module/protobuf export PATH$PATH:$PROTOC_HOME/bin [rootmaster-node protobuf-2.5.0]# source /etc/profile [rootmaster-node protobuf-2.5.0]# protoc --version到此编译工具安装基本完成6.编译Hadoop1解压源码到/opt/module/目录[rootmaster-node software]# tar -zxvf hadoop-2.7.4-src.tar.gz -C /opt/module/2进入到Hadoop源码主目录通过maven命令执行编译[rootmaster-node software]# cd /opt/module/hadoop-2.7.4-src/ [rootmaster-node hadoop-2.7.4-src]# mvn package -Pdist,native -DskipTests -Dtar编译成功3编译成功的64位hadoop包在/opt/module/hadoop-2.7.4-src/hadoop-dist/target目录下[rootmaster-node target]# cd /opt/module/hadoop-2.7.4-src/hadoop-dist/target