Hadoop + spark + hive build environment (configuration installed Hive)

I, download and unzip hive

# Download Hive
 wget HTTP: // apache.claz.org/hive/hive-2.3.6/apache-hive-2.3.6-bin.tar.gz

# Unzip
tar zxf-hive apache, 2.3 . 6 And bin. tar gz

# Hadoop folder to move
Music Videos Apache-hive- 2.3 . . 6 -bin / usr / local / Hadoop / hive- 2.1 . . 1 

# Configure system environment variables 
Vim / etc / Profile 
# Add the following three lines

export HIVE_HOME=/usr/local/hadoop/hive
export HIVE_CONF_DIR=$HIVE_HOME/conf
export PATH=$PATH:$HIVE_HOME/bin

II, install additional dependencies

1, mysql-connector drive

# Download mysql- Connector driving
 wget HTTPS: // dev.mysql.com/get/Downloads/Connector-J/mysql-connector-java-5.1.48.tar.gz

# Unzip
tar zxf mysql-connector-java-5.1.48.tar.gz 

# Enter and MySQL -connector-Java- 5.1 . 48 -bin.jar, MySQL-Connector-Java- 5.1 . 48 .jar two packages to move / Hive / lib in
 CP MySQL-Connector-Java- 5.1 . 48 - bin.jar / usr / local / Hadoop / hive- 2.1 . . 1 / lib /
 CP MySQL-Connector-Java- 5.1 . 48 .jar / usr / local / Hadoop / hive- 2.1 . . 1 / lib /

2, hive on spark necessary packet

# Into the already installed / hadoop / spark / scala-library spark-core copy spark-network-common package to hive / in jars directory under lib, according to different versions, different suffix number
 cp Scala-Library- 2.11 . 12 . Spark-core_2 JAR. . 11 - 2.4 . . 4 .jar Spark-Network-common_2. . 11 - 2.4 . . 4 .jar / usr / local / Hadoop / Hive / lib /

3、