impala 安装部署

1.下载jar包(官方)

http://archive.cloudera.com/cdh5/repo-as-tarball/5.14.0/cdh5.14.0-centos6.tar.gz

2.上传解压 

注意:由于jar的大小比较大若没有硬盘大小,那么大建议添加一块新的大小要大于12G

 tar -zxvf cdh5.14.0-centos6.tar.gz  -C .

3.安装nc服务

 yum -y install nc

 4.配置网络资源库

安装http服务: yum -y install http

启动合http 服务: /etc/init.d/httpd start

创建一个软链接:cd c/var/www/html    ln -s /mnt/disk003/cdh/5.14.0 cdh 

修改yum.repos.d : cd /etc/yum.repos.d touch cdh.repos

[c6-media]
name=CentOS-$releasever - Media
baseurl=http://192.168.100.203/cdh
gpgcheck=0
enabled=1

其他节点一样修改yum.repos.d : cd /etc/yum.repos.d touch cdh.repos

5.安装impala

主节点安装:

yum install -y impala impala-server impala-state-store impala-catalog impala-shell

从节点安装

yum install -y impala-server

6.修改Hadoop .hive 

在一个节点上

vim /export/servers/hive/conf/hive-site.xml

添加

 </property>
             <property>
                <name>hive.metastore.uris</name>
                <value>thrift://node01:9083</value>
        </property>

 修改hadoop hdfs-site.xml 添加

<property>
		<name>dfs.client.read.shortcircuit</name>
		<value>true</value>
	</property>
	<property>
		<name>dfs.domain.socket.path</name>
		<value>/var/run/hdfs-sockets/dn</value>
	</property>
	<property>
		<name>dfs.client.file-block-storage-locations.timeout.millis</name>
		<value>10000</value>
	</property>
	<property>
		<name>dfs.datanode.hdfs-blocks-metadata.enabled</name>
		<value>true</value>
	</property>

分发到其他节点

 scp /export/servers/hive-1.1.0-cdh5.14.0/conf/hive-site.xml  node02:/$PWD
 scp /export/servers/hive-1.1.0-cdh5.14.0/conf/hive-site.xml  node03:/$PWD
scp /export/servers/hadoop-2.6.0-cdh5.14.0/etc/hadoop/hdfs-site.xml  node02:/$PWD  
scp /export/servers/hadoop-2.6.0-cdh5.14.0/etc/hadoop/hdfs-site.xml  node03:/$PWD  

7.将Hadoop 和hive 复制到配置文件impla

cp -r /export/servers/hadoop-2.7.5/etc/hadoop/core-site.xml /etc/impala/conf/core-site.xml

cp -r /export/servers/hadoop-2.7.5/etc/hadoop/hdfs-site.xml /etc/impala/conf/hdfs-site.xml

cp -r /export/servers/hive/conf/hive-site.xml /etc/impala/conf/hive-site.xml

8.修改impala

vim /etc/default/impala

IMPALA_CATALOG_SERVICE_HOST=node03
IMPALA_STATE_STORE_HOST=node03

添加MySQL驱动

MYSQL_CONNECTOR_JAR 注释去掉

ln -s /export/servers/hive/lib/mysql-connector-java-5.1.32.jar /usr/share/java/mysql-connector-java.jar

修改bigtop

vim /etc/default/bigtop-utils

export JAVA_HOME=${JAVA_HOME}

9.启动hadoop hive  impala服务

启动hive

nohup bin/hive --service metastore &

nohup bin/hive --service hiveserver2 &

启动Hadoop

sbin/start-dfs.sh

启动impala

service impala-state-store start

service impala-catalog start

service impala-server start

发布了42 篇原创文章 · 获赞 47 · 访问量 17万+

猜你喜欢

转载自blog.csdn.net/qq_43791724/article/details/103475659