一、spark-shell
1.把hive的hive-site.xml复制到spark的conf下面
2.开启spark-shell
bin/spark-shell --master local[2] --jars /opt/datas/mysql-connector-java-5.1.27-bin.jar
3.运行测试语句
spark.sql("select * from imooc.emp").show
spark.sql("show tables from imooc").show
spark.sql("select * from imooc.emp e join imooc.dept d on e.deptno=d.deptno").show
二、spark-sql
1.启动
bin/spark-sql --master local[2] --jars /opt/datas/mysql-connector-java-5.1.27-bin.jar
2.直接运行sql语句
select * from imooc.emp;
show tables from imooc;
select * from imooc.emp e join imooc.dept d on e.deptno=d.deptno;、
三、thriftserver&beeline
1.启动thriftserver
sbin/start-thriftserver.sh \
--master local[2] \
--jars /opt/datas/mysql-connector-java-5.1.27-bin.jar \
--hiveconf hive.server2.thrift.port=14000
2.启动beeline
bin/beeline -u jdbc:hive2://bigdata.ibeifeng.com:14000 -n bigdata.ibeifeng.com
其中
“bigdata.ibeifeng.com:14000”是thriftserver设定端口
“bigdata.ibeifeng.com:14000”是服务器hostname