On September 21, at the 2023 OSCAR Open Source Industry Conference held by the China Academy of Information and Communications Technology, the "Open Source Database Ecosystem Development Research Report" was officially unveiled. The report sorts out the development status of MySQL database in terms of current development status, technological innovation, and industrial application , and provides an outlook for China's open source database industry based on the MySQL technology route.
In October 2023, the life cycle of version 5.7 of the MySQL open source database is about to end. The report analyzes the development of open source databases based on MySQL technology in my country, and is also conducive to providing valuable reference for database users in the process of database replacement and migration selection.
Interpretation of the core content of the report
MySQL database has wide application range
Among the world's mainstream databases, MySQL has always been the most popular open source database with a wide audience. In the DB-Engines popularity ranking, MySQL has been in the top two in popularity for several consecutive years. The 2022 global relational database market size data from the Slintel website shows that MySQL has the highest market share, reaching 43.04%. It is in fact the most widely influential open source database in the world (Oracle, which ranks second, is only 16.76%).
Looking at the country, based on the continuous deepening of technological development based on massive scenarios, a number of outstanding open source communities based on MySQL technology lines have emerged in China, such as PolarDB-X, GreatSQL, StoneDB, TenDBCluster-TenDB, and AliSQL .
In terms of industrial applications, the MySQL open source database is widely used in my country due to its excellent performance, low usage cost, ease of use, strong portability, and suitability for more users. The total size of China's database market will reach 28.68 billion yuan in 2021, of which MySQL database installed capacity accounts for 42.6%.
With the continuous deepening of informatization construction and the enhancement of domestic open source database technology, the domestic MySQL technical route open source database will carry out technological innovation from the following five dimensions to create an open source database that best meets the needs of domestic users .
-
First, group replication (MGR) technology enhances data consistency;
-
Second, MySQL active-active architecture achieves database high availability;
-
The third is to promote database OLTP and OLAP performance optimization and break through the MySQL performance bottleneck;
-
The fourth is to build a strong data security defense line through password restriction enhancement and cascading permission recovery capabilities;
-
The fifth is to create a variety of database migration solutions to help MySQL migrate to the cloud.
Through this survey, we learned that issues such as security and open source service support stability have also increased users’ concerns.
In order to understand the current application status of MySQL database industry in China, the Cloud Computing Open Source Industry Alliance under the China Academy of Information and Communications Technology conducted a full survey and in-depth analysis of more than 20 domestic users in key industries such as finance, telecommunications, and energy, and presented the MySQL and other open source database industries . Application status and future development path of MySQL.
1. Financial industry
The financial industry is actively exploring the use of open source databases, with a wide range of application scenarios. This survey shows that among the companies in the financial industry that use open source databases, banks account for more than 60%, and insurance companies also account for nearly 30%.
The financial industry has rich business scenarios, and open source databases are widely used in office management, tools, financial investment, business analysis and other systems. It can support financial needs, meet regulatory requirements, improve controllability, and reasonably control system construction costs.
According to research, MySQL version 5.7 is widely used among financial companies that use the MySQL open source database. Among all financial enterprises that deploy MySQL, nearly 60% choose MySQL 5.7 version as their operating version, and nearly 30% of enterprises use MySQL 5.7 version, accounting for more than 80% of their total MySQL deployments.
In the financial industry, technical personnel lack the ability to operate and maintain MySQL, and more than 60% of companies need to purchase external technical services.
In the financial industry, nearly 80% of enterprises believe that the open source version of MySQL can reduce enterprise usage costs. Over 50% of companies believe that the MySQL ecosystem is relatively complete and easy to learn and use. The introduction and improvement of domestic open source policies in recent years have also increased the financial industry's willingness to use MySQL databases.
Performance bottlenecks, security vulnerabilities, closed source and product life cycle risks restrict the further application of MySQL in financial scenarios. In the financial industry, more than 60% of companies believe that MySQL currently has security vulnerabilities, defects, and performance bottlenecks. Nearly 60% of companies believe that MySQL's closed source and product life cycle risks will also restrict their further use.
2. Telecommunications industry
The telecommunications industry has a high degree of application concentration, and open source databases are mainly used in the field of mobile communications .
In the telecommunications industry, a relatively high proportion of enterprises deploy MySQL for more than 50% of the total number of databases, and some enterprises exceed 80%. In terms of the number of open source database applications, the number of MySQL deployed by provincial subsidiaries of telecom companies is generally 100-200, and some provincial subsidiaries of telecom companies have deployed as many as 500.
Among all telecom companies that deploy MySQL, most choose MySQL 5.7 version as their running version, and the deployment volume accounts for more than half of their total MySQL deployment volume. In the telecommunications industry, enterprises lack the ability to operate and maintain the MySQL open source database and mostly use external technical services.
3. Energy industry
The open source database in the energy industry is gradually used in business scenarios such as power monitoring, power marketing management, and terminal time series data storage in the fields of electric power, steel, etc., to provide support for real-time data processing and bring high-value output. In the energy industry, companies mostly use internal personnel to operate and maintain the MySQL open source database.
Facing the attitude of " MySQL5.7 end of life cycle "
Among the users in this survey, various industries have different levels of understanding and willingness to migrate databases regarding the end of the life cycle of MySQL 5.7 version, which is coming in October 2023.
1. Financial industry
The life cycle of MySQL 5.7 version has ended. Due to the lack of follow-up open source community technical support, it has had an impact on the financial industry. More than 50% of enterprises are considering migrating to domestic databases with technical service guarantees. In the financial industry, 71% of companies are aware of the end-of-life event of MySQL version 5.7, and 88% of them have made response plans. Among all response plans, more than 50% of enterprises hope to migrate to domestic databases, and about one-third of enterprises will migrate to MySQL 8.0 version. Enterprises believe that domestic databases should further improve product performance and improve product ecology.
When choosing MySQL 5.7 version as a replacement, migration difficulty and transformation costs are the primary considerations for financial companies. More than 70% of enterprises will consider the difficulty of product migration and the cost of transformation when choosing MySQL5.7 as an alternative database. Over 50% of enterprises will consider migrating databases to ensure reliability, availability and serviceability. In addition, database security, compatibility and product performance are also important considerations for enterprises when replacing.
2. Telecommunications industry
The telecommunications industry's awareness of MySQL5.7 end-of-life events needs to be improved. In the telecommunications industry, some companies were unaware of the incident. In response to the end of the life cycle of MySQL 5.7, some companies will migrate to MySQL 8.0 version, and some companies said they will continue to use MySQL 5.7 version. When choosing to replace MySQL 5.7, migration difficulty, transformation costs and compatibility are important factors that telecom companies consider. The company believes that domestic databases should improve product business processing capabilities, further improve product stability, security, transaction processing efficiency, etc., and help customers replace MySQL.
3. Energy industry
In the energy industry, companies have a strong awareness of the MySQL 5.7 end-of-life event. Most companies have a relatively clear understanding of this incident. In response to end-of-life-cycle actions, most companies hope to migrate to domestic open source databases. When choosing to replace MySQL 5.7, migration difficulty and transformation costs are also important factors that energy companies consider. Enterprises believe that domestic open source databases should further improve product compatibility so that the database can adapt to multiple platforms, so as to better provide products and services and promote the digital transformation of enterprises.
Domestic open source databases are booming
GreatSQL alternative has outstanding advantages
In recent years, domestic open source databases represented by GreatSQL, PolarDB-X, StoneDB, TenDBCluster-TenDB, AliSQL, etc. have initially built an open source community ecosystem with multi-party participation. Each community continues to improve around its own characteristics in terms of application implementation, community activity, and code contribution, and actively explores the future ecological development direction of domestic open source database communities.
Among them, the ecological construction achievements of the GreatSQL community are relatively outstanding. The GreatSQL open source database has a relatively rich number of application cases and industrial application scenarios. It performs well in terms of code contribution, activity, update frequency, technological innovation, etc., and the community vitality continues to increase.
01. Code contribution level
The composition of GreatSQL community contributors is diversified and growing steadily year by year. At the same time, community issue interaction and pull requests are very active;
02. Activity
The GreatSQL database community is highly active, has outstanding community response capabilities, provides timely feedback on community issues and PR, and continues to enhance community vitality;
03. Update frequency
The GreatSQL database community updates frequently and continuously improves its own community and product construction to better meet the needs of different business scenarios;
04. Technological innovation
GreatSQL has made a lot of in-depth source code level optimizations for MGR, added multiple enterprise-level practical features such as geographical tags, arbitration nodes, read-write nodes that can be bound to dynamic VIPs, intelligent master selection, fast single-master mode, etc., and repaired a large number of serious fault scenarios. Stability and reliability issues under the conditions, suitable for financial-level applications;
05. Performance optimization
As an OLTP database, GreatSQL has made a lot of optimizations in terms of kernel transaction throughput performance, and can meet the needs of enterprise transaction processing (OLTP) and analytical processing (OLAP) at the same time. A large number of lock disassembly and lock-free optimization improvements have been made in terms of OLTP performance. In terms of OLAP, each InnoDB subtree is optimized from the perspective of parallel execution. In the TPC-H scenario, the optimized GreatSQL can improve query efficiency by up to 40 times;
06. Security
GreatSQL database has added support for table space national secret algorithms to further enhance database security. Based on the original keyring architecture of open source MySQL, the security of the architecture is enhanced through the national secret algorithm, thereby improving the overall security of the database.
Domestic open source database industry outlook
Finally, regarding the development of the open source database industry based on China's MySQL technology route, the report makes the following outlook:
1. The development of open source databases should comply with the requirements of open source ecological construction and industry leadership, and actively participate in improving open source industry governance;
2. Strengthen relevant parties’ understanding of open source protocols and use open source protocols legally and compliantly;
3. Utilize the existing domestic MySQL technology ecosystem and combine it with industry needs to strengthen the ability to independently evolve open source branches;
4. Vigorously promote the standardized and intelligent development of open source database technology.