Since its official release on May 15, 2019, Huawei's GaussDB database has received extensive attention from the industry and has become one of the "net celebrities " with hard-core technology.
Today, the editor of Tengke Education will bring you a fan interaction special to get a close look at the "true face of Lushan" in the GaussDB database. First throw ten hot issues to quench your thirst.
What is the meaning of the name GaussDB?
GaussDB is the brand name of Huawei's database products, intended to pay tribute to the mathematician Gauss. GaussDB series database products include GaussDB OLTP database and GaussDB OLAP database, which are widely used in finance, government, telecommunications and other industries, and have entered the core system to meet the needs of customers for real-time processing of high-concurrency transactions and efficient analysis of massive data in the intelligent era.
Is the GaussDB series of databases independently developed?
The GaussDB OLTP database is a distributed database independently developed by Huawei. It is based on a comprehensive transformation of the self-developed memory database developed by Huawei in 2007 and commercialized in the telecom billing field. It supports x86 and Huawei Kunpeng hardware architecture and is based on an innovative database kernel. , Provides real-time processing capabilities of high concurrent transactions, high availability of financial-level and distributed high-scalability in the three centers in two places, and is used to support core and key systems in industries such as finance, government, and telecommunications. Currently, mainstream deployment methods such as stand-alone, active-standby, and distributed are supported.
GaussDB OLAP database is a distributed database with analysis and mixed load capabilities. Starting in 2011, it is independently developed on the basis of PostgreSQL 9.2.4, supports x86 and Huawei Kunpeng hardware architecture, supports row storage and column storage, and provides PB (Petabyte)-level data analysis capabilities, multi-mode analysis capabilities and real-time processing capabilities, used in data warehouses, data marts, real-time analysis, real-time decision-making, and mixed load scenarios, and are widely used in core systems in industries such as finance, government, and telecommunications.
What is the development history of GaussDB OLTP database?
The GaussDB OLTP database has a 12-year history of research and development. In 2007, in the field of telecommunications real-time billing projects, Huawei began to organize manpower to develop memory databases. In 2010, the Huawei database R&D team began to refactor the 2007 version and wrote the first line of code of the refactored version, the definition of the database object: "typedef struct st_database{...}database_t;"
Starting from this version, the positioning of Huawei's database is no longer limited to in-memory databases, but is gradually transforming to general-purpose relational databases. During the reconstruction process, a large number of features of non-memory databases have begun to be incorporated. This is the predecessor of Gauss OLTP database. . The GaussDB OLTP database is based on Huawei’s powerful R&D platform and has a complete set of standard processes and R&D support systems. After more than 10 years of accumulation, it has been successfully launched in the core systems of the telecommunications and financial industries. Its high performance and stability have gained financial support. Recognition by telecommunications customers.
What are the characteristics of the GaussDB OLTP database?
GaussDB OLTP database is a fully self-developed distributed database, mainly for OLTP scenarios. Product features include:
● High availability: failover time <10s, support flashback
● High performance: Based on the Kunpeng 920 processor, the performance surpasses other TOP commercial databases in the industry by 30%
● High expansion: Distributed strong consistency, TPC-C expansion ratio>0.8
● Compatibility: support a series of standard common grammars such as SQL-92, SQL:1999, SQL:2003, compatible with SQL grammar commonly used by other TOP commercial databases in the industry, and support offline/online migration
Recently, the CICC Guosheng Certification Center has tested it according to the financial industry standard "Distributed Database Technology Financial Application Specification (Draft)" and CICC Guosheng Enterprise Standard "Distributed Database Technology Financial Application Testing Specification (Trial)", based on Huawei Kunpeng The Huawei GaussDB database of processors and general-purpose CPUs all passed this test, and all 82 test items were "compliant." The test mainly covers key capability items required by financial-level databases such as environment construction, environment monitoring, syntax support, security support, expansion, performance, and disaster tolerance.
What is the current market usage of GaussDB OLTP database?
The GaussDB OLTP database is currently commercialized in many industries such as telecommunications, finance, large enterprises, and government. For example, the GaussDB OLTP database was successfully launched in the core system of the telecommunications industry; the GaussDB OLTP database was tested in the 16-node TPC-C standard test based on Huawei's Kunpeng hardware architecture, and its performance reached tens of millions of tpmC.
In 2017, Huawei and China Merchants Bank established a "distributed database" joint innovation laboratory for the first time, and achieved fruitful cooperation results in the past two years. Financial-level reliability has been commercially verified during the joint creation process: Huawei GaussDB has leading performance in key failure recovery indicators, with RTO within AZ<10s, which meets the requirements for high database availability in financial scenarios, and the system has been running stably for more than 500 days. .
Currently, Huawei's GaussDB series database products have shipped more than 30,000 sets worldwide.
What is the development history of GaussDB OLAP data?
The GaussDB OLAP database began pre-research in 2011, and then was fully rebuilt based on PostgreSQL 9.2.4. After 8 years of continuous R&D investment, it has formed its own complete kernel. GaussDB OLAP has evolved into a massively parallel processing distributed database that supports mixed storage and threading of rows and columns, and can support a cluster size of up to 2048 nodes (it has passed the 512 node certification of the Institute of Information and Communications Technology). Among the three major engines of the database kernel, the optimizer (including SQL parsing and SQL optimization), execution engine, and storage engine, except for the SQL parsing part, have been refactored.
GaussDB OLAP rebuilds the execution engine from multiple dimensions through a new construction of distributed execution, MPP communication framework, vectorization engine, and compilation execution engine, and rebuilds the storage engine through column storage, adaptive compression, and distributed transactions. Since SQL parser, JDBC, ODBC, etc. are important parts of the database ecology and part of the ecological strategy of GaussDB OLAP, a lot of enhancements have been made in this area.
In addition to the earth-shaking changes in the database kernel, the GaussDB OLAP database has also been greatly enhanced in terms of cluster management, high availability and database security, and has applied for a number of patents. As an enterprise-level distributed database product, GaussDB OLAP database also provides five complete toolsets including operation and maintenance management, development tools, migration tools, and data replication tools.
In 2014, Huawei incubated the first product version of the Gauss OLAP database (also known as FusionInsight MPPDB or FusionInsight LibrA in the early days). In 2015, Huawei and ICBC jointly innovated and incubated multiple innovative technologies including TCP multi-streaming and logical clustering. The two parties entered into practice and application from joint innovation. Finally, in 2019, they successfully completed the replacement and evolution of the core data warehouse system GaussDB OLAP database to the international top database products.
What are the characteristics of GaussDB OLAP database?
GaussDB OLAP database is mainly oriented to OLAP scenarios and supports MPP (Massively Parallel Processing) distributed deployment. Product features include:
● High availability: automatic query retry in case of failure, dual-cluster disaster recovery in the same city/remote place
● High performance: In the core enterprise data warehouse scenario, the analysis performance is the same as that of other mainstream analytical databases in the industry. Based on the Kunpeng 920 processor chip, compared with the general-purpose chip, the performance of TPC-H/TPC-DS is improved by 30%, and it supports GPU heterogeneous multi-dimensional Hardware acceleration (100 billion image comparison of 100,000 cameras responds in seconds)
● High scalability: a single cluster supports a maximum of 2048 nodes, online expansion, and redistribution is transparent to the business
● Data fusion: SQL on Anywhere, supporting interconnection with heterogeneous/homogeneous data sources and FusionInsight large databases
● Computing integration: Supports intelligent scheduling of x86/Huawei Kunpeng CPU, GPU and other heterogeneous computing chips to achieve optimal computing power
● Data security: data transparent encryption, support national secret algorithm SM4, row-level fine-grained authority control
What is the current market usage of GaussDB OLAP database?
As of May 2019, Huawei's GaussDB database and FusionInsight big data platform have been used in 60 countries and regions around the world, serving more than 1,500 customers, having more than 500 business partners, and being widely used in finance, operators, governments, Energy, medical, manufacturing, transportation and other industries.
Recently, in a distributed analytical database test initiated by the China Academy of Information and Communications Technology and the Data Center Alliance, Huawei's GaussDB OLAP database took the lead in passing the 512-node cluster scale capability evaluation. At the same time, the Industrial and Commercial Bank of China has also completed the complete replacement of top foreign data warehouse products with Huawei GaussDB OLAP database.
Currently, Huawei's GaussDB series database products have shipped more than 30,000 sets worldwide.
Does GaussDB have all-in-one database products?
Huawei GaussDB database will also launch an all-in-one database based on Huawei's Kunpeng hardware architecture, which is divided into GaussDB OLTP and GaussDB OLAP series. The all-in-one form includes all the features of the GaussDB database software form. It also has the unique advantages of pre-integration, pre-tuning, high performance, high security, and high reliability brought by the deep integration of software and hardware, which enriches finance, government, telecommunications, and large enterprises. The choice of customer database system construction in other industries.
If you want to learn GaussDB series database products, what channels are there?
There are multiple channels to learn about Huawei GaussDB's series of database products:
● Follow the official account of "Huawei IT Product Solutions" and keep abreast of the developments of GaussDB database products
● Visit Huawei official website to obtain product information
● GaussDB developer community provides services such as development tools, interactive communities, development guides, security centers, etc.