Flume collected console prompt:
at The Full Channel IS or Unexpected failure at The Source by Will Again the try the After 1000 MS.
This is because the current is too large collection of files, documents underlying reason is gathering speed and sink rate is not a good match. So it should be resolved by increasing the value of keep-alive:
#channel cache up to how much
a1.channels.c1.capacity = 5000
#channel a maximum number of spit to sink
a1.channels.c1.transactionCapacity = 2000
active time of #event
a1.channels.c1.keep-alive = 10
Or write to HDFS using compression, by compression to save space and network traffic, but will increase the cpu consumption.