FLUME导入数据到HDFS,HIVE建立外部表-载入外部表数据

  1. FLUME采集数据到apps_log/clean/2019-03-12目录下
  2. HIVE创建外部表
CREATE EXTERNAL TABLE ods_app_log (
    sdk_ver string
    ,time_zone string
    ,commit_id string
    ...
    ) partitioned BY (day string ,os string) 
    row format delimited 
    fields terminated BY '\001' location 'apps_log/clean/';
  1. FLUME导入的数据分别是:’/apps_log/clean/’/2019-03-12/android’与’/apps_log/clean/’/2019-03-12/ios’,把这2个文件夹内容映射到ds_app_log 表中
ALTER TABLE ods_app_log ADD PARTITION (day = '2019-03-12',os = 'android') location '/apps_log/clean/'/2019-03-12/android';
ALTER TABLE ods_app_log ADD PARTITION (day = '2019-03-12',os = 'ios') location '/apps_log/clean/'/2019-03-12/ios';

猜你喜欢

转载自blog.csdn.net/ddbbff2005/article/details/88431869
今日推荐