Hive项目实战系列(2) | 分析前准备(创建表与插入数据)

  此次博主为大家带来的是Hive项目实战系列的第二部分。

---

一 启动hive

• .1 启动hiveserver2服务

[bigdata@hadoop002 hive]$ bin/hiveserver2

• 2 启动beeline

[bigdata@hadoop002 hive]$ bin/beeline
Beeline version 1.2.1 by Apache Hive
beeline>

• 3 连接hiveserver2

beeline> !connect jdbc:hive2://hadoop002:10000（回车）
Connecting to jdbc:hive2://hadoop002:10000
Enter username for jdbc:hive2://hadoop002:10000: bigdata（回车）
Enter password for jdbc:hive2://hadoop002:10000: （直接回车）
Connected to: Apache Hive (version 1.2.1)
Driver: Hive JDBC (version 1.2.1)
Transaction isolation: TRANSACTION_REPEATABLE_READ

0: jdbc:hive2://hadoop002:10000> create database guli;
0: jdbc:hive2://hadoop002:10000> use guli;
0: jdbc:hive2://hadoop002:10000> show tables;
+-----------+--+
| tab_name  |
+-----------+--+
+-----------+--+
No rows selected (0.036 seconds)

二. 创建表

2.1 拿到原始数据(日志数据| ori表 )

• 1. 创建user_text

create external table user_text(
uploader string,
videos int, 
friends int)
row format delimited fields terminated by '\t'
collection items terminated by '&'
location '/guli/user';

// 查看前五行
0: jdbc:hive2://hadoop002:10000> select * from user_text limit 5;

• 2. 创建video_text

// video表
create external table video_text(
    videoId string, 
    uploader string, 
    age int, 
    category array<string>, 
    length int, 
    views int, 
    rate float, 
    ratings int, 
    comments int,
    relatedId array<string>
)
row format delimited fields terminated by '\t'
collection items terminated by '&'
location '/guli/video_etc';

// 查询 
select * from video_text limit 5;

类型我们大致可以看到就行。

2.2 把数据导入到hive中进行处理(创建两张orc表)

• 1. 创建video_orc：

create table video_orc(
    videoId string, 
    uploader string, 
    age int, 
    category array<string>, 
    length int, 
    views int, 
    rate float, 
    ratings int, 
    comments int,
    relatedId array<string>
)
row format delimited fields terminated by '\t'
collection items terminated by '&'
stored as orc;

如果创建的是表为如下的这种

就需要输入如下的命令修改，并出现下图标记处的类型就行了：

0: jdbc:hive2://hadoop002:10000> alter table video_orc set tblproperties("EXTERNAL"="FALSE")
0: jdbc:hive2://hadoop002:10000> desc formatted video_orc;

• 2. 创建user_orc

create table user_orc(
uploader string,
videos int, 
friends int)
row format delimited fields terminated by '\t'
collection items terminated by '&'
stored as orc;

2.3 向ORC表插入数据

• 1. 向user_orc插入数据

0: jdbc:hive2://hadoop002:10000> insert into user_orc select * from user_text;

结果在：

• 2. 向video_orc插入数据

0: jdbc:hive2://hadoop002:10000> insert into video_orc select * from video_text;

• 3. 测试是否成功

0: jdbc:hive2://hadoop002:10000> select * from user_orc limit 5;
0: jdbc:hive2://hadoop002:10000> select * from video_orc limit 5;

  好了，到这里，我们就把分析前的数据准备好了。

扫描二维码关注公众号，回复： 11276074 查看本文章

---

   $\color{#FF0000}{看完就赞，养成习惯！！！}$^ _ ^ ❤️ ❤️ ❤️
  码字不易，大家的支持就是我坚持下去的动力。点赞后不要忘了关注我哦！