Sqoop 报 :ERROR tool.ExportTool: Error during export: Export job failed!

20/09/14 10:18:18 INFO client.RMProxy: Connecting to ResourceManager at emr-header-1.cluster-171958/172.17.132.216:8032
20/09/14 10:18:21 INFO input.FileInputFormat: Total input files to process : 1
20/09/14 10:18:21 INFO input.FileInputFormat: Total input files to process : 1
20/09/14 10:18:21 INFO lzo.GPLNativeCodeLoader: Loaded native gpl library from the embedded binaries
20/09/14 10:18:21 INFO lzo.LzoCodec: Successfully loaded & initialized native-lzo library [hadoop-lzo rev 97184efe294f64a51a4c5c172cbc22146103da53]
20/09/14 10:18:21 INFO mapreduce.JobSubmitter: number of splits:1
20/09/14 10:18:21 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1599023974385_62983
20/09/14 10:18:22 INFO impl.YarnClientImpl: Submitted application application_1599023974385_62983
20/09/14 10:18:22 INFO mapreduce.Job: The url to track the job: http://emr-header-1.cluster-171958:20888/proxy/application_1599023974385_62983/
20/09/14 10:18:22 INFO mapreduce.Job: Running job: job_1599023974385_62983
20/09/14 10:18:30 INFO mapreduce.Job: Job job_1599023974385_62983 running in uber mode : false
20/09/14 10:18:30 INFO mapreduce.Job:  map 0% reduce 0%
20/09/14 10:18:37 INFO mapreduce.Job:  map 100% reduce 0%
20/09/14 10:18:37 INFO mapreduce.Job: Job job_1599023974385_62983 failed with state FAILED due to: Task failed task_1599023974385_62983_m_000000
Job failed as tasks failed. failedMaps:1 failedReduces:0

20/09/14 10:18:37 INFO mapreduce.Job: Counters: 8
        Job Counters 
                Failed map tasks=1
                Launched map tasks=1
                Data-local map tasks=1
                Total time spent by all maps in occupied slots (ms)=232405
                Total time spent by all reduces in occupied slots (ms)=0
                Total time spent by all map tasks (ms)=4385
                Total vcore-milliseconds taken by all map tasks=4385
                Total megabyte-milliseconds taken by all map tasks=7436960
20/09/14 10:18:37 WARN mapreduce.Counters: Group FileSystemCounters is deprecated. Use org.apache.hadoop.mapreduce.FileSystemCounter instead
20/09/14 10:18:37 INFO mapreduce.ExportJobBase: Transferred 0 bytes in 19.7395 seconds (0 bytes/sec)
20/09/14 10:18:37 WARN mapreduce.Counters: Group org.apache.hadoop.mapred.Task$Counter is deprecated. Use org.apache.hadoop.mapreduce.TaskCounter instead
20/09/14 10:18:37 INFO mapreduce.ExportJobBase: Exported 0 records.
20/09/14 10:18:37 ERROR mapreduce.ExportJobBase: Export job failed!
20/09/14 10:18:37 ERROR tool.ExportTool: Error during export: 
Export job failed!
        at org.apache.sqoop.mapreduce.ExportJobBase.runExport(ExportJobBase.java:445)
        at org.apache.sqoop.manager.MySQLManager.upsertTable(MySQLManager.java:145)
        at org.apache.sqoop.tool.ExportTool.exportTable(ExportTool.java:73)
        at org.apache.sqoop.tool.ExportTool.run(ExportTool.java:99)
        at org.apache.sqoop.Sqoop.run(Sqoop.java:147)
        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76)
        at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:183)
        at org.apache.sqoop.Sqoop.runTool(Sqoop.java:234)
        at org.apache.sqoop.Sqoop.runTool(Sqoop.java:243)
        at org.apache.sqoop.Sqoop.main(Sqoop.java:252)
[root@emr-header-1 ~]# 
[root@emr-header-1 ~]# 

上面报了这个错 

我就查找yarn上的日志

步骤 1.报错的job Id 就是  job_1599023974385_62983

打开yarn 

按ctrl+f 输入你的jobId  搜索你的job  我是在第二个页面上  . 

找到log  然后打开

点击here出 打开详细的日志 

根据日志解析

得出来结果是我的 数据类型没写对 没有Hive的数据类型和Mysql的数据类型对应起来 ,也有可能使你的sqoop输出列的顺序和你在Mysql上的字段顺序不一致导致的

猜你喜欢

转载自blog.csdn.net/weixin_45592182/article/details/108574080