ambari2.6 installation alluxio2.1.0
Preparation of documents:
alluxio-2.1.0-bin.tar.gz (download to own)
ranger-Hive-plugin-0.7.0.2.6.5.0-292.jar (if there is no ranger control authority, the following relevant operations involving negligible)
ambari- alluxio-service-master.zip (I ambari secondary development plug-ins to achieve ambari control management alluxio)
Link: https: //pan.baidu.com/s/1f_C6E1_ZsqOyonPoUuroVA
extraction code: pbk1
step1. Linux environment configuration
In ambari server execute on the node:
cd /var/lib/ambari-server/resources/stacks/HDP/2.6/services
mkdir ALLUXIO
unzip ambari-alluxio-service-master.zip -d ALLUXIO/
mv alluxio-2.1.0-bin.tar.gz ALLUXIOF/package/files/
As the online hive by ranger control authority, alluxio to hive tables have permission issues ranger management is supported only after I modify the source code to bypass alluxio rights management ranger, it has been providing to recompile fight jar package: ranger-hive- plugin-0.7.0.2.6.5.0-292.jar
In hiveserver2 executed on the node:
#均强制覆盖
cp ranger-hive-plugin-0.7.0.2.6.5.0-292.jar /usr/hdp/2.6.5.0-292/hive/lib/ranger-hive-plugin-impl/
cp ranger-hive-plugin-0.7.0.2.6.5.0-292.jar /usr/hdp/2.6.5.0-292/hive2/lib/ranger-hive-plugin-impl/
cp ranger-hive-plugin-0.7.0.2.6.5.0-292.jar /usr/hdp/2.6.5.0-292/ranger-hive-plugin/lib/ranger-hive-plugin-impl/
cp ranger-hive-plugin-0.7.0.2.6.5.0-292.jar /usr/hdp/2.6.5.0-292/ranger-admin/ews/webapp/WEB-INF/classes/ranger-plugins/hive/
Since alluxio itself is the root user to start, can not be modified, hdfs have access rights problem, the root user needs to join hdfs group, each machine will need to perform:
usermod -a -G hdfs root
alluxio's home directory on the new hdfs, set permissions
hadoop fs -mkdir /user/alluxio
hadoop fs -chown root:hdfs /user/alluxio
hadoop fs -chmod 755 -R /user/alluxio
Since the need to restart a new installation ambari-server, this operation has no effect on the line
sudo ambari-server restart
step2. ambari Configuration
Recent machine load observed by determining the master node selects cxy-hdp-node-60 this machine
Since the machine line cxy-hdp-node-171, cxy-hdp-node-172 these two machine overload, worker node selects two machines other than machine that all node Datanode
This removes all the way until the next hook
All the way until the next successful installation, until a green
Restart hiveserver2
