SparkSQL(二)spark-shell和spark-sql以及thriftserver&beeline访问hive表

一、spark-shell

1.把hive的hive-site.xml复制到spark的conf下面

2.开启spark-shell

bin/spark-shell --master local[2] --jars /opt/datas/mysql-connector-java-5.1.27-bin.jar

3.运行测试语句

spark.sql("select * from imooc.emp").show
spark.sql("show tables from imooc").show
spark.sql("select * from imooc.emp e join imooc.dept d on e.deptno=d.deptno").show

二、spark-sql

1.启动

bin/spark-sql --master local[2] --jars /opt/datas/mysql-connector-java-5.1.27-bin.jar

 2.直接运行sql语句

select * from imooc.emp;
show tables from imooc;
select * from imooc.emp e join imooc.dept d on e.deptno=d.deptno;、

三、thriftserver&beeline

1.启动thriftserver

sbin/start-thriftserver.sh  \
--master local[2] \
--jars /opt/datas/mysql-connector-java-5.1.27-bin.jar  \
--hiveconf hive.server2.thrift.port=14000 

2.启动beeline

bin/beeline -u jdbc:hive2://bigdata.ibeifeng.com:14000 -n bigdata.ibeifeng.com

其中

“bigdata.ibeifeng.com:14000”是thriftserver设定端口

“bigdata.ibeifeng.com:14000”是服务器hostname

猜你喜欢

转载自blog.csdn.net/u010886217/article/details/82916401