WARN hdfs.DataStreamer: Caught exception

When uploading files to hdfs, reported such a mistake:

Exception in thread "main" java.lang.RuntimeException: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.server.namenode.SafeModeException):

WARN hdfs.DataStreamer: Caught exception
java.lang.InterruptedException
    at java.lang.Object.wait(Native Method)
    at java.lang.Thread.join(Thread.java:1252)
    at java.lang.Thread.join(Thread.java:1326)
    at org.apache.hadoop.hdfs.DataStreamer.closeResponder(DataStreamer.java:980)
    at org.apache.hadoop.hdfs.DataStreamer.endBlock(DataStreamer.java:630)
    at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:807)

After Quguan online to find reasons to enter https://issues.apache.org/jira/browse/HDFS-10429 View

The reason is translated: Initially, datastreamer :: closeresponder always print a warning about interruptedexception; as hdfs-9812, dfsoutputstream :: closeimpl always forced to shut down the thread, which can lead to interruptedexception.
A simple fix is to use the debug level log rather than the warning level.

But if he do not think that is important, then you can ignore, because I think there might not be uploaded in accordance with standard hdfs upload only required official website reported wrong, but if it is then modified using the above method.

Guess you like

Origin www.cnblogs.com/z12568/p/11566683.html