Abstract: The future-oriented data platform 3.0 needs to be subtracted from the architecture. The platform will be N->1. Huawei Cloud GaussDB (DWS) will be the only platform for the data warehouse in the future. The data link will be realized from the data lake to the Huawei Cloud GaussDB (DWS) data warehouse.
Recently, Huawei held the 5th HUAWEI CONNECT. During the period, the Huawei Cloud GaussDB (DWS) data warehouse, as one of the heavyweight products of Huawei Cloud, received the attention of finance, government, operators and various enterprises. Liu Miao, Deputy Director of the Information Technology Department of China Everbright Bank, was invited to share the "Innovative Practice of Everbright Bank Based on Huawei Cloud GaussDB (DWS) Data Warehouse".
Liu Miao mentioned in his speech that China Everbright Bank was the first national joint-stock bank to introduce domestic products into the data warehouse system. Huawei Cloud GaussDB (DWS) was launched on Everbright Bank and became one of the important supporting platforms for the data warehouse system. "Digital transformation is the proposition and responsibility of an era for the development of commercial banks." In today's society, with the rapid development of 5G, AI, cloud computing, IoT and other technologies, data has exploded, which determines the needs of enterprises Introducing new MPP technology to enhance the competitiveness of the platform. Therefore, Everbright Bank has adopted a steadily advancing approach to the architecture design of the multi-data platform, introducing the Huawei Cloud GaussDB (DWS) data warehouse platform, and gradually in the process of data migration From "TD processing to GaussDB" changed to "processing on GaussDB", the localization of the data warehouse was finally realized.
Liu Miao said, “For the future-oriented data platform 3.0, the architecture will be subtracted. The platform will be N->1. HUAWEI CLOUD GaussDB (DWS) will be the only platform for the data warehouse in the future. The data link will be implemented directly from the data lake to HUAWEI CLOUD GaussDB (DWS) database."
Currently, Everbright Bank uses Huawei Cloud GaussDB (DWS) data scale has reached hundreds of terabytes, and plans to expand to the PB level. Peng Guiping, general manager of Huawei Cloud GaussDB (DWS), said that the product has full confidence in supporting the continuous innovation and evolution of Everbright Bank's business.
According to reports, Huawei Cloud GaussDB (DWS) data warehouse currently serves 1,000+ customers worldwide, and a single cluster of a major customer has reached 10PB, breaking the general perception that a single cluster of MPP databases does not exceed 1PB. The core competitiveness of Huawei Cloud GaussDB (DWS) data warehouse is embodied in three aspects: large, fast and stable:
(1) Large: GaussDB (DWS) is based on a distributed architecture, and on the basis of ensuring ACID, it has broken through the cluster communication (Multi-Streams) and logical cluster (Multi-Groups) technologies in large-scale distributed scenarios, making the product possess high Expansion capabilities can support 100PB or even larger customer needs in the future. It is worth mentioning that the logical cluster can organically unify different business loads such as ODS, data warehouse, data mart, and self-service analysis, effectively isolate and share effectively.
(2) Fast: GaussDB (DWS) has a multi-level fully parallel computing engine. Supports parallel computing of multiple physical nodes. Within a physical node, it supports parallel computing of multiple CPU cores. In the instruction sequence of a CPU core, SIMD instructions are supported to realize one instruction to operate multiple data at the same time. Maximize the parallel capabilities and provide the ultimate performance for the business. In addition, Multi-Cores technology enables the performance on Kunpeng to increase by more than 30% compared to the same generation of x86 chips.
(3) Stability: GaussDB (DWS) has multi-level disaster tolerance capabilities, which can smoothly handle the abnormalities of software and hardware in AZ, clusters, nodes, and processes. In addition, the Server-side Multi-Retries technology greatly reduces the business perception of failures; secondly, GaussDB (DWS) also has a complete detection and processing mechanism for difficult sub-health issues; finally, offline expansion, semi-online expansion, and online expansion technology Able to calmly respond to customers' different expansion needs.
The core of Huawei Cloud GaussDB (DWS) data warehouse technology is a distributed architecture. In the past ten years, it has built competitiveness around distributed. In the future, the GaussDB (DWS) data warehouse will continue to evolve based on a distributed architecture, and build a next-generation open, all-scenario analytical database around cloud, big data, 5G/IoT, and artificial intelligence.
Peng Guiping said that GaussDB (DWS) data warehouse implements the "platform + ecology" strategy and adheres to the ecological concept of open cooperation. Currently, it has formed close cooperation with 500+ partners and welcomes more partners to join the Huawei Cloud GaussDB data warehouse ecological family , Provide competitive solutions for customers in various industries.
Click to follow and learn about Huawei Cloud's fresh technology for the first time~