IDEA中Spark SQL操作Hive

1.添加依赖

<dependency>
    <groupId>org.apache.spark</groupId>
    <artifactId>spark-hive_2.11</artifactId>
    <version>2.1.1</version>
</dependency>
<dependency>
    <groupId>org.apache.hive</groupId>
    <artifactId>hive-exec</artifactId>
    <version>1.2.1</version>
</dependency>

2.将hive-site.xml文件拷贝到项目的resources文件夹下

3.代码

• 注意：builder()需要添加对hive的支持enableHiveSupport()

    val conf: SparkConf = new SparkConf().setAppName(this.getClass.getSimpleName).setMaster("local[*]")
    val spark: SparkSession = SparkSession.builder()
                                          .enableHiveSupport()  //添加对hive的支持
                                          .config(conf).getOrCreate()
    //spark.sql("show tables").show()
    spark.sql("select * from dept").show()


    spark.stop()