关系数据库导入hdfs

方法一:

使用sqoop:

sqoop import --connect $1 --table eventinfos --columns "id, client_id, event_name, deduplication, deduplication_type" \
    --target-dir /conversion_mapping/lookups/eventinfos \
    --fields-terminated-by \\001 -m 1 \
    --username $2 --password $3 || exit 1

方法二:
外表加载方式:
create table conversiondatas (
  id string,
  event_id int,
  event_date string,
  edate_i_raw string,
  ipisp string
)
partitioned by (edate_i string, batch_id string)
row format delimited
location '/conversion_mapping/conversiondatas';

猜你喜欢

转载自schooltop.iteye.com/blog/2241626