spark sql data source --hive

The idea is to use editor

spark sql step of reading data from the hive: hive jar package 1 is introduced

                                                          2. The hive-site.xml put under resource

                3.spark sql statement in support of the hive

Case:

def main(args: Array[String]): Unit = {
val spark: SparkSession = SparkSession
.builder()
.appName(s"${this.getClass.getSimpleName}")
.master("local[*]")
.enableHiveSupport()
.getOrCreate()

//指明要使用的数据库
spark.sql("use zhangqi")
spark.sql("select * from monitor_camera_info limit 10").show()
//关闭资源
spark.close()

 

Guess you like

Origin www.cnblogs.com/yezihan/p/11563108.html
Recommended