Palm Data joins hands with HUAWEI CLOUD GaussDB to facilitate financial technology innovation and jointly create industry benchmarks

This article is shared from HUAWEI CLOUD community " Palm Data Technology joins hands with HUAWEI CLOUD GaussDB to help financial technology innovation and jointly build industry benchmarks ", author: GaussDB database.

Recently, at the " GaussDB Database, Creating a Lightweight Migration and Deployment Solution " forum at the Huawei Developer Conference 2023 (Cloud) , Gao Xing, general manager of Palmdata Solutions , as an excellent partner of Huawei Cloud GaussDB, shared the practice and achievements of the long-term cooperation between Palmdata and Huawei Cloud GaussDB.

Work together to create a complete GaussDB ecosystem

Palm Data Technology is a financial technology company focusing on the securities and large asset management industries, oriented to the fields of database and big data technology, intelligent scene applications, and industry information technology application innovation, serving more than 80 large financial institution customers across the country. As a comprehensive partner of Huawei in the field of database technology in the financial industry, Palm Data has long cooperated with Huawei Cloud GaussDB to provide supporting ecological software products and service support systems based on Huawei Cloud GaussDB database, and actively invests in financial big data services and application migration to the cloud to help industry users quickly transform.

Gao Xing said that as a manufacturer that provides technical services and support for customers in the financial segment, PalmData chose to cooperate strategically with Huawei Cloud GaussDB because Huawei has a very good R&D strength as a foundation, can support the stable and efficient operation of customer application scenarios, and also provides a lot of support for the construction of our service capabilities and service system, and has long-term R&D investment and firm development plans. These are all important factors that we value very much.

For financial core scenarios, based on GaussDB to create an overall solution for migration and disaster recovery

Over the past two years, PalmData and Huawei Cloud GaussDB have jointly created GaussDB's complete supporting software for financial core business systems, forming a comprehensive product system, including integrated disaster recovery and backup solutions (Z-XCP), data migration and continuous replication software (Z-RPS), and GaussDB value-added plug-in packages (Z-DB+). At the same time, GaussDB has also created a GaussDB technical support and service team for customers and partners. Work together to create industry benchmarks, as well as after-sales expert support and professional services.

The disaster recovery and backup integrated solution (Z-XCP) aims to protect the business continuity of the enterprise. It can complete the construction of the enterprise's "two locations and three centers" disaster recovery system and the deployment of important functional management systems in one stop, helping customers to easily deal with management problems such as disaster recovery, backup, monitoring, and development/test library construction of GaussDB clusters. It can meet the data security requirements of different industries and business scenarios in a lower cost and more efficient way.

With the help of this product, PalmData can not only manage the original standard GaussDB deployment solution, but also develop some more flexible and flexible deployment solutions that meet the needs of industry applications, so that customers have more choices.

The GaussDB value-added plug-in package (Z-DB+) provides more personalized tools, focusing on solving the problem of interconnection between databases. The slow SQL statement tracking tool provides the monitoring function of slow SQL and execution plans during the use of the business system, which is used to analyze and optimize system performance, and solve problems of business performance degradation during business transformation. The DBcopy tool supports ultra-high-speed two-way replication between GaussDB and the original heterogeneous database, helping enterprises quickly complete migration and synchronization. The DBlink tool can support two-way real-time access between the GaussDB database and other heterogeneous databases during the migration and transformation phase. The customer's disaster recovery requirements in the same city or remote computer room under narrow bandwidth (such as 100M network) wide area network.

Data Migration and Continuous Replication Software (Z-RPS) supports real-time migration of the system, database active-active disaster recovery, escape channel guarantee (reverse migration), and meets the needs of core system data real-time migration, real-time aggregation and real-time distribution.

Continue to implement in core financial scenarios to meet more needs of customers

With the blessing of these ecological tools, the product system has fully supported the technological innovation of financial industries such as securities, funds, banks, insurance, and trusts, and met the needs of more and more customers.

The legal person liquidation system is one of the core business systems of securities companies in my country, and plays a vital role in the settlement link after securities transactions. The migration of the legal person liquidation system of a medium and large securities company faced several major challenges:

Large amount of data: The migration data is in T units, not only the data time span is long, but also the data quality must be accurate;

High frequency of migration: In the stages of data testing and production, dual-track and single-track operation, it is necessary to re-migrate and compare. Repeated migration leads to high migration frequency and long implementation period;

Heterogeneous database migration technology is difficult: different databases have different storage methods, field types, precision and lengths, table structures are also different, and blank characters and garbled characters require special handling, all of which increase the difficulty of heterogeneous migration.

The palm data migration solution has customized and adapted more than 8,000 tables in the system. It has built-in data synchronization and comparison between the historical database of legal entity liquidation and the current database, a special conversion model for heterogeneous data, and special processing for legal entity liquidation. It also supports the migration of various modes such as full, incremental, batch, and specified tables, as well as verification and analysis of abnormal data and scheduled migration. Finally, the two-way migration between the original database and the GaussDB database is quickly completed. The verification has realized the multi-dimensional data accuracy verification of the two systems, and has been running stably during the dual-track period.

The migration of the pension core system of a super-large insurance company is also facing important challenges. It is necessary to complete the full migration of 17TB of data in a short period of time. There are also problems with garbled data and character sets, and a large number of tables use clob and blob fields, which brings great challenges to incremental migration and subsequent data verification. There are also problems with non-partitioning, no primary key, and no index for extra-large tables, which increase the difficulty of migration. The palm data migration solution completed the full data migration of 17TB in 4 days. The migration speed maintained a linear trend. After the migration, the system function was stable and there was no abnormality. The entire migration is efficient, accurate, and stable, and the migration efficiency is more than 100 times higher than that of ordinary synchronization tools.

A large fund company chose GaussDB’s disaster recovery construction plan of 1AZ in the same city and 1AZ in different places, and realized a variety of flexible disaster recovery deployment architectures, high compression and low bandwidth remote disaster recovery, failover/disaster recovery, rehearsal switch/planned downtime disaster recovery management, full and incremental backup recovery, policy-based automated backup and recovery, logical backup and recovery of databases, schemas, and tables, development and test database recovery and point-in-time recovery (PITR) based backup and recovery mechanisms, as well as cluster core indicators and databases through the palm data disaster recovery and backup integrated solution. Monitoring and management of core indicators and database nodes enables integrated management of data disaster recovery and backup to meet business needs.

"In the process of continuous evolution and development, the ecosystem of HUAWEI CLOUD GaussDB is becoming more and more mature. PalmData positions itself as a member of the HUAWEI CLOUD GaussDB ecosystem, and is committed to becoming one of the best service providers in the HUAWEI CLOUD GaussDB ecosystem. In the future, we will continue to carry out in-depth cooperation, continuously improve the HUAWEI CLOUD GaussDB technical support and service system, and create a benchmark case for industry implementation from a financial perspective, so that industry customers can trust HUAWEI CLOUD GaussDB and make good use of HUAWEI CLOUD GaussDB." Gao Xing said.

Click to follow and learn about Huawei Cloud's fresh technologies for the first time~