After the spark consolidation hive, hive start error:
ls: cannot access /export/servers/spark/lib/spark-assembly-*.jar: No such file or directory
The reason: After the spark upgrade to version 2.x, large JAR package under the original lib directory is dispersed into small JAR package, the original spark-assembly - * jar does not exist, so there is no way to find the hive JAR package. .
Solution: Open the hive following bin directory, find the hive files, edit hive file, find the following line:
sparkAssemblyPath=`ls ${SPARK_HOME}/lib/spark-assembly-*.jar`
Amended to the following line:
sparkAssemblyPath=`ls ${SPARK_HOME}/jars/*.jar`