Data migration by Kafka Connect

In the processing of streaming data, E-MapReduce often require data migration or data synchronization between clusters between Kafka Kafka with other systems. This section shows you how to quickly implement data synchronization between Kafka cluster or data migration by Kafka Connect on E-MapReduce.

Prerequisites

Background Information

Kafka Connect is a scalable, reliable, fast a tool for streaming data transmission between Kafka and other systems. For example, Kafka Connect binlog can get data from the database, the database data synchronization to Kafka clusters, so as to achieve the purpose of data migration database. Since the cluster may interface Kafka streaming system, it can also be achieved indirectly downstream docking streaming object database processing system. At the same time, Kafka Connect also provides


Guess you like

Origin yq.aliyun.com/articles/741428