phenomenon
1.kafka topic backlog partition portion
2. Problems kafka given node has: a java.lang.IllegalStateException: Invalid Message size: 0
[2019-09-27 14: 25: 09,829] ERROR [ON Replica Broker Manager 2]: Error Processing Partition Operation ON FETCH [Topic-the Log-Test,. 17], offset 1519780193 (kafka.server.ReplicaManager)
a java.lang.IllegalStateException: Invalid Message size: 0
AT kafka.log.FileMessageSet.searchForOffsetWithSize (FileMessageSet.scala: 151)
AT kafka.log.LogSegment.translateOffset (LogSegment.scala: 128)
AT kafka.log.LogSegment.read (LogSegment.scala: 151)
AT kafka.log.Log.read (Log.scala: 563)
3. Check the monitoring found problems io presence of more than 90% kafka node usage data disks, and time of occurrence, and error logs anastomosis
Solution
1. Restart kafka services, consumer ease the backlog, but the problem still exists
a problem removing the data disk 2. configuration, restart the service, kafka service back to normal (My question is disk / data / disk05, after removing the disk configuration problem)
