1.下载jar包(官方)
http://archive.cloudera.com/cdh5/repo-as-tarball/5.14.0/cdh5.14.0-centos6.tar.gz
2.上传解压
注意:由于jar的大小比较大若没有硬盘大小,那么大建议添加一块新的大小要大于12G
tar -zxvf cdh5.14.0-centos6.tar.gz -C .
3.安装nc服务
yum -y install nc
4.配置网络资源库
安装http服务: yum -y install http
启动合http 服务: /etc/init.d/httpd start
创建一个软链接:cd c/var/www/html ln -s /mnt/disk003/cdh/5.14.0 cdh
修改yum.repos.d : cd /etc/yum.repos.d touch cdh.repos
[c6-media] name=CentOS-$releasever - Media baseurl=http://192.168.100.203/cdh gpgcheck=0 enabled=1
其他节点一样修改yum.repos.d : cd /etc/yum.repos.d touch cdh.repos
5.安装impala
主节点安装:
yum install -y impala impala-server impala-state-store impala-catalog impala-shell
从节点安装
yum install -y impala-server
6.修改Hadoop .hive
在一个节点上
vim /export/servers/hive/conf/hive-site.xml
添加
</property> <property> <name>hive.metastore.uris</name> <value>thrift://node01:9083</value> </property>
修改hadoop
hdfs-site.xml
添加
<property> <name>dfs.client.read.shortcircuit</name> <value>true</value> </property> <property> <name>dfs.domain.socket.path</name> <value>/var/run/hdfs-sockets/dn</value> </property> <property> <name>dfs.client.file-block-storage-locations.timeout.millis</name> <value>10000</value> </property> <property> <name>dfs.datanode.hdfs-blocks-metadata.enabled</name> <value>true</value> </property>
分发到其他节点
scp /export/servers/hive-1.1.0-cdh5.14.0/conf/hive-site.xml node02:/$PWD scp /export/servers/hive-1.1.0-cdh5.14.0/conf/hive-site.xml node03:/$PWD scp /export/servers/hadoop-2.6.0-cdh5.14.0/etc/hadoop/hdfs-site.xml node02:/$PWD scp /export/servers/hadoop-2.6.0-cdh5.14.0/etc/hadoop/hdfs-site.xml node03:/$PWD
7.将Hadoop 和hive 复制到配置文件impla
cp -r /export/servers/hadoop-2.7.5/etc/hadoop/core-site.xml /etc/impala/conf/core-site.xml
cp -r /export/servers/hadoop-2.7.5/etc/hadoop/hdfs-site.xml /etc/impala/conf/hdfs-site.xml
cp -r /export/servers/hive/conf/hive-site.xml /etc/impala/conf/hive-site.xml
8.修改impala
vim /etc/default/impala
IMPALA_CATALOG_SERVICE_HOST=node03
IMPALA_STATE_STORE_HOST=node03添加MySQL驱动
MYSQL_CONNECTOR_JAR 注释去掉
ln -s /export/servers/hive/lib/mysql-connector-java-5.1.32.jar /usr/share/java/mysql-connector-java.jar
修改
bigtop
vim /etc/default/bigtop-utils
export JAVA_HOME=${JAVA_HOME}
9.启动hadoop hive impala服务
启动hive
nohup bin/hive --service metastore &
nohup bin/hive --service hiveserver2 &
启动Hadoop
sbin/start-dfs.sh
启动impala
service impala-state-store start
service impala-catalog start
service impala-server start