hadoop file output 报 java.lang.OutOfMemoryError: Requested array size exceeds VM



 Use kettle to extract data from hive to hdfs, and report java.lang.OutOfMemoryError: Requested array size exceeds VM

 

The reason is that there are two fields in hive with a defined length of 2.1 billion, which exceeds the length of the jvm data. It is enough to reduce the length of these two fields.

 

 

 

 

Guess you like

Origin http://43.154.161.224:23101/article/api/json?id=326332708&siteId=291194637