Debezium series: Use Debezium to collect PostgreSQL database to Kafka Topic, and create an account with data collection authority
- 1. Demand background
- 2. Detailed steps to install PostgreSQL15 database
- 3. Set up PostgreSQL database logical replication
- 4. Create a PostgreSQL database collection account
- 5. Create SCHEMA and tables
- 6. Submit Debezium Connector
- 7. Detailed Explanation of Core Parameters
- Eight, Debezium UI view Connector status
- Nine, insert data
- 10. View the generated table-level Topic
- 11. Send data from multiple tables to the same Topic
- 12. View data at consumption table level Topic
1. Demand background
- Need to use Debezium Connector to collect data from PostgreSQL database to Kafka Topic in real time
- The data collection of PostgreSQL database version 9 is based on wal2json, and the data collection of PostgreSQL database version 10 and above is based on decoderbufs and pgoutput.
Details of data acquisition implementation of PostgreSQL database version 9