问题
Exception in thread “main” java.lang.IllegalArgumentException: Unable to instantiate SparkSession with Hive support because Hive classes are not found.
详细问题
springboot集成spark,创建sparkSession对象后,对于sparkSession对象添加hive支持,控制台报错
Exception in thread "main" java.lang.IllegalArgumentException: Unable to instantiate SparkSession with Hive support because Hive classes are not found.
at org.apache.spark.sql.SparkSession$Builder.enableHiveSupport(SparkSession.scala:869)
at com.haut.edu.epidemicstatisticsbackend2.controller.Test_Hive.main(Test_Hive.java:103)
解决方案
在pom文件中增加依赖
<dependency>
<groupId>org.apache.spark</groupId>
<artifactId>spark-hive_2.11</artifactId>
<version>2.4.4</version>
</dependency>
原因
由于sparkSession对象添加hive支持,因此需要导入spark-hive_2.11
依赖
参考文献
Unable to instantiate SparkSession with Hive support because Hive classes are not found.
原创不易
转载请标明出处
如果对你有所帮助 别忘啦点赞支持哈