Debezium series: Multiple tables distribute data to Kafka Topic according to the specified fields, and ensure that the same value of the specified fields of multiple tables always appears in the same partition
1. Demand background
- According to the productId distribution data of the two tables productInfo and productorder, the data of the same productId always appears in the same partition, and it is hoped that the same order data of the two tables always appears in the same partition.
- For example, the addition, deletion, and modification data of the order 1206827245738502144 in the productInfo table always appear in partition 2, and the addition, deletion, and modification data of the order 1206827245738502144 in the productorder table also always appear in partition 2.
2. Relevant implementation technologies
For detailed implementation details of distributing data according to specified fields, please refer to the blogger's following two technical blogs: