Data synchronization tool Elasticsearch-datatran 6.2.8 released. Elasticsearch-datatran is an open source data synchronization migration tool by bboss , which supports data synchronization between Elasticsearch, relational databases, Mongodb, HBase, Hive, Kafka, text files, and SFTP/FTP. Synchronize massive data.
Elasticsearch version compatibility: Supports data migration between various Elasticsearch versions (1.x, 2.x, 5.x, 6.x, 7.x, +)
v6.2.8 feature improvements
-
Data synchronization tool improvement: When Elasticsearch-File-Ftp/Sftp data is synchronized, the custom field added in the global configuration/record level does not work. Fixed the problem
-
Data synchronization tool extension: add elasticsearch data export and send to kafka module, use case: https://github.com/bbossgroups/kafka2x-elasticsearch/blob/master/src/main/java/org/frameworkset/elasticsearch/imp/ES2KafkaDemo .java
-
Data synchronization tool extension: Add relational database data export and send to the kafka module, use case: https://github.com/bbossgroups/kafka2x-elasticsearch/blob/master/src/main/java/org/frameworkset/elasticsearch/imp/ DB2KafkaDemo.java
V 6.2.7 function improvements
-
Data synchronization tool improvement: Add Elasticsearch-File-Ftp/Sftp data synchronization upload function
-
Data synchronization tool improvement: Add the function of Database-File-Ftp/Sftp data synchronization upload
es and database data are exported to files and uploaded to ftp and sftp cases:
https://github.com/bbossgroups/elasticsearch-file2ftp
v6.2.6 function improvements
- Data synchronization tool function improvement: database to database data synchronization to increase the synchronization of modified and deleted data, reference case: Db2DBdemoWithStatusConfigDB
- Data synchronization tool function improvement: add Kafka to the database data synchronization plug-in, support for adding, modifying, and deleting operation synchronization, reference case: Kafka2DBdemo
v6.2.3 function improvements
- Data synchronization module improvement: increase the support for the open source ip address library ip2region, use the reference document IP-regional operator latitude and longitude coordinate conversion