Sqoop2: import and export data By Hue

Import data from mysql to hdfs ----------------------------------------

    Export data from hdfs to mysql --------------------------------------

----------------------------------------------------

The difference between sqoop1 and sqoop2

Feature Sqoop Sqoop2
Connectors for all major RDBMS Supported.

Not supported.

Workaround: Use the generic JDBC Connector which has been tested on the following databases: Microsoft SQL Server, PostgreSQL, MySQL and Oracle.

This connector should work on any other JDBC compliant database. However, performance might not be comparable to that of specialized connectors in Sqoop.

Kerberos Security Integration Supported.

Not supported.

Encryption of Stored Passwords Not supported. No workaround. Supported using Derby's on-disk encryption.

Disclaimer: Although expected to work in the current version of Sqoop2, this configuration has not been verified.

Data transfer from RDBMS to Hive or HBase Supported.

Not supported.

Workaround: Follow this two-step approach.
  1. Import data from RDBMS into HDFS (either as a text or sequence file)
  2. Export to Hive or HBase using Sqoop2
Data transfer from Hive or HBase to RDBMS Not supported.
Workaround: Follow this two-step approach.
  1. Import data from Hive or HBase into HDFS (either as a text or sequence file)
  2. Export to RDBMS using Sqoop2

Not supported.

Follow the same workaround as for Sqoop.

http://www.cloudera.com/content/cloudera-content/cloudera-docs/CDH5/latest/CDH5-Installation-Guide/cdh5ig_sqoop_vs_sqoop2.html

猜你喜欢

转载自ylzhj02.iteye.com/blog/2039541