HBase TB-level data scale non-stop migration best practices

background

For information about how to do data migration stop HBase cluster service has always been more of a question asked of cloud HBase, there are many open source tools or HBase itself integrated solution in terms of performance, stability, experience is not very good Therefore BDS Ali cloud provides migration services to help customers implement cloud TB-level data on the scale of non-stop migration

Support scene

  • HBase big upgrade, 1.x 2.x upgrade
  • Cluster configuration upgrade, upgrade to 8-core 16-core 16G 32G
  • Clustered network environment changes, the classic network migration to VPC
  • Off-site migration across room
  • HBase Business Split

An Introduction

Open source programs

HBase non-stop migration mainly includes three parts: migration, real-time data table structure synchronization, the total amount of historical data migration

Table Structure Migration

For table structure migration, the open source DataX or HBase table structure itself does not provide a migration function can only be manually build the table, the manual construction of the table there will be a few questions:

  1. If the source table data clusters are more customers to manually build the table too much trouble
  2. After the construction of the table may have overlooked the manual partition table, leading to the target partition table is very reasonable, complete migration

Guess you like

Origin yq.aliyun.com/articles/709857