Several key technical points in the high-performance design of Kafka are summarized:
- Use batch processing to improve system throughput.
- The storage structure is designed based on the characteristics of high-performance sequential read and write of disk files.
- Use the operating system's PageCache to cache data, reduce IO and improve read performance.
- Accelerate the consumption process with zero-copy technology.