DTS practical experience transfer station

Traditional data migration has been a troublesome topic, you may need to stop doing mysqldump, or written to the target database crawl through a number of programs, but these programs often lack a large-scale usage, data inconsistencies prone.

The other is a heterogeneous scene, even if there are commercial databases such as Oracle EXPDP these tools, but a heterogeneous scenario, there is no useful here.

DTS Supported Migration Types

Data source structure migration to migrate the whole amount of incremental migration
Oracle-> MySQL support support support
Oracle-> RDS For PPAS Yes Yes Yes
Oracle-> DRDS not support support support
Oracle-> ADS Support Support Support
Oracle-> Oracle Support Support Support
MySQL -> RDS For MySQL Yes Yes Yes
MySQL -> PostgreSQL does not support support support
SQLServer-> SQLServer Yes Yes Yes
postgreSQL-> PostgreSQL support support support
MongoDB -> MongoDB support support support
Redis -> Redis support support support
MySQL-> DRDS does not support support support
MySQL-> PetaData not support support support
MySQL-> OceanBase Yes Yes Yes
DB2-> MySQL support support support

Our DTS is divided into pre-inspection, structural migration, the total amount of migration, incremental migration in several stages.

Pre-examination, mainly to check connectivity and account permissions, and many other things, such as whether there is a conflict topology.

Structure migration, mainly to the migration of DDL statements table structure. Here we must note, the incremental migration process target instance is best not to use trigger, trigger-generated value of the source database will synchronize with the binlog over.

Full amount of migration, mainly based on SQL queries by slicing algorithm, data segments to pull the whole amount taken over.

If the data need incremental changes, then we need the incremental migration. Incremental migration is by pulling the source database log files, such as MySQL's binlog, sqlserver the LDF, etc., analyze the dump into SQL statements for the target instance, and then increments concurrent writes to the target instance.

First, under the cloud room cloud migration

https://help.aliyun.com/document_detail/26621.html?spm=a2c4g.11186623.6.601.cc2b3588wFTiPu

Precautions:

1) Permissions

Migration type structure migration incremental migration to migrate the whole amount of
local MySQL instances the SELECT Super the SELECT
the SELECT
Replication Slave
Replication Client
target end RDS for MySQL instance read and write permissions to read and write permissions to read and write permissions

2) binlog format Source Library

binlog_format = row

binlog_row_image=full

3) mapping relationship

DTS can not be changed when the migration to migrate objects, configuration, to choose the right relationship mapping

Second, Examples of the lower room and on the cloud synchronization cloud

https://help.aliyun.com/document_detail/66730.html?spm=a2c4g.11186623.6.631.571d2b32sICq3v

Precautions

1) must be synchronized within the network, so the need for green, smart gateway, VPN, etc., properly configured network routing

Configuration on dedicated lines can refer to this

https://help.aliyun.com/document_detail/58143.html?spm=a2c4g.11186623.6.616.ccb169a7r7zrhq

2) synchronization and migration to other configuration is similar, but after the initial synchronization is complete, you can change the synchronization objects

Note that after each change, need to wait until a new object is added to the synchronization initialization is complete, the next to be one change

3) synchronization also supports two-way synchronization, great to meet the premise cloud testing.

https://help.aliyun.com/document_detail/56776.html?spm=a2c4g.11186623.6.627.6472636abYrkHY

Note that the two-way synchronization, conflict tactics, the default is interrupted after conflict

Third, other cloud vendors of migration and synchronization

https://help.aliyun.com/document_detail/52555.html?spm=a2c4g.11186623.6.596.cc2b3588wFTiPu

AWS

https://help.aliyun.com/document_detail/52904.html?spm=a2c4g.11186623.6.597.4f814a512mVENC

Tencent

It should be noted, confirming MySQL account privileges under other cloud vendors, as well as binlog open case, if you can buy green, speed will go further.

Guess you like

Origin yq.aliyun.com/articles/708016
DTS