ERROR StdoutPluginCollector - 脏数据:
{"message":"No enum constant com.alibaba.datax.plugin.unstructuredstorage.reader.UnstructuredStorageReaderUtil.Type.BIGINT","record":[{"byteSize":2,"index":0,"rawData":"城市","type":"STRING"},{"byteSize":0,"index":1,"rawData":"","type":"STRING"},{"byteSize":6,"index":2,"rawData":"临沂市分公司","type":"STRING"},{"byteSize":2,"index":3,"rawData":"二级","type":"STRING"},{"byteSize":0,"index":4,"rawData":"","type":"STRING"},{"byteSize":4,"index":5,"rawData":"书房家具","type":"STRING"}],"type":"reader"}
Solution
Dirty data type error
Since DataX cannot fully support the data types of all Hive tables, the type of the column field in hdfsreader in the DataX startup file should be changed to the type supported by DataX
Then re-execute the DataX startup script