CNNC Wuhan x Tapdata: How old state-owned enterprises in the energy sector can unleash the power of data and promote refined management

insert image description here

Data islands have always been a long-standing problem. I was looking for related products and solutions before, but they were either too heavy or difficult to implement, until I saw Tapdata by chance
. This is a small and beautiful product that focuses on the field of real-time data development. Its ability to synchronize heterogeneous data in real time allows us to focus more on business-level development without having to care about data-level issues.
—— Yi Jihu, Architect of Wuhan System Technology Department, CNNC

In recent years, a new round of technological revolution characterized by informatization and intelligence is booming. The global economy is in an unprecedented period of transformation. Digital technologies continue to emerge, and the digital economy has become the core driving force of economic growth.

The era calls for the digital upgrade of traditional enterprises.

As the backbone of national economic development, state-owned enterprises need to give full play to the leading role of the state-owned economy, actively grasp and lead the new generation of information technology reform trends, and lead and drive my country's economy to occupy the commanding heights of international competition in this round of transformation and reform. The State-owned Assets Supervision and Administration Commission of the State Council officially issued the "Notice on Accelerating the Digital Transformation of State-owned Enterprises" in 2020, actively guiding state-owned enterprises to play their exemplary and leading role on the road to digital transformation.

On the road to fully realize the digital transformation of central enterprises and state-owned enterprises, there is such a recognized boulder in the way-data islands. In the process of accelerating transformation and optimization with many relevant enterprise users, Tapdata has also been working hard to provide new ideas for enterprises to break the situation with low cost, and fulfill the mission of "terminator" of data islands.

If you want to know what kind of problems Tapdata solves and how it can be used, you might as well learn how CNNC Wuhan put it into practice.

1. CNNC Wuhan, a demonstration of technological reform

"Stuck neck" data islands, data chimneys that are difficult to remove

CNNC Wuhan, a demonstration enterprise of scientific and technological reform, was jointly invested and established by the Institute of Nuclear Power Operation, Qinshan Nuclear Power Company, Wuhan Yuanyi Technology Investment Co., Ltd., and Shanghai Nuclear Engineering Research and Design Institute. Advantages in assets, market, and management and operation, "live on this, be good at it, and be committed to ensuring the safe, reliable, and economical operation of nuclear facilities" is currently the largest and most powerful nuclear power operation technical service professional in China chemical company.

While providing informatization services to different state-owned enterprises and central enterprises, CNNC Wuhan also discovered a common problem: isolated data islands. Due to the diversity of the system - different external procurement and internal structures, organizational differentiation, and various business scenarios... resulting in frequent obstacles when connecting to business data, it often takes a lot of human resources to do non-business side development work. During development, it is necessary to coordinate with people from different organizational departments, apply for corresponding data permissions, and spend time and cost to understand the business meaning of the data dictionary.

However, common ETL tools are not reusable. Every time there is a new requirement or the requirement is changed, the synchronization process needs to be rerun. A large number of ETL development can only "fix the symptoms but not the root cause", and there is no way to break the data from the root. barrier. In addition, CNNC Wuhan is still using Java code to realize data query between different data centers, and the workload is also very heavy, which will still bring resource investment that deviates from the core task.

As a result, the project landing cycle is inevitably prolonged, so that it cannot focus on business development. CNNC Wuhan urgently needs to liberate the creativity that has been "kidnapped" by the data layer, and bring the development focus back to the business side. Specialize in specialization, each has its own strengths, and jointly contribute to the high-quality development of the nuclear industry.

2. Tapdata: Small and beautiful real-time data exchange platform

Because of focus, so more professional

Facing the contradiction between the increasing demand for data connection and the constraints of the traditional architecture, Tapdata provides a new idea: a full-link real-time data service platform of "real-time synchronization + real-time processing + real-time publishing", while retaining the original system , build a highly consistent data mirror, and adopt master data management technology to form a complete, accurate, credible and serviceable master data service system.

In order to quickly meet the needs of CNNC Wuhan to shorten the project cycle and optimize resource allocation, Tapdata gave full play to the platform's low-code visual configuration operation and real-time synchronization of heterogeneous data and other functional features, quickly opened up CNNC Wuhan's data centers, and achieved local and cloud data connectivity ——Realize rapid development and quick query, greatly optimize the development of human resources, and successfully use the pioneering "small and beautiful" to break through the "big and difficult" of the Shenyang style.

At the same time, taking into account CNNC Wuhan's central enterprise attributes, Tapdata also has the advantages of "purely domestic self-research", has the advantage of independent intellectual property rights, and is more friendly to domestic databases. From the perspective of long-term international competition, the technology is more controllable.

Diagram of Architecture Deployment

  1. Synchronize full instance data from pre-production instances to public data center instances
  2. The public data center instance synchronizes the modified public data to different business data center instances through specific logic and rules, and records the number of synchronized data and whether it is successful (with logs)
  3. The R&D domain of the public data center forms a wide table through data synchronization and post-processing, and synchronizes the global query data to the R&D domain ES of the public data center!

Why choose Tapdata?

Faced with the refined management needs of state-owned enterprises and the localization process on the road to technological breakthroughs, Tapdata has demonstrated the following advantages:

  • The purely domestic self-developed
    Tapdata has inherent advantages of independent intellectual property rights, and the technology is more controllable.

  • Out-of-the-box and low-code visual operation
    insert image description here
    Tapdata is easy to deploy, and supports no-code and low-code visual operations, and can quickly create tasks in drag and drop, without coding or even SQL to write conversion rules.

  • Built-in 60+ data connectors, stable real-time collection and transmission capabilities
    insert image description here
    Collect or synchronize the latest data changes from various data sources in a real-time manner, including databases, APIs, queues, Internet of Things and other data providers. Support bi-directional synchronization of multi-source heterogeneous data, and automatically map relational to non-relational. Based on the self-developed CDC log analysis technology, zero-intrusion real-time data collection, almost no impact on the source database, one-click real-time capture, update within milliseconds. It has built-in 60+ connectors and is constantly expanding, covering most of the mainstream databases and types, and supports custom data sources, has a highly scalable PDK architecture, and can quickly connect to the SaaS API system within 4 hours; quickly connect to the database system within 16 hours .

  • Real-time data computing capability with second-level response
    insert image description here
    Full-link real-time, based on Pipeline streaming data processing, to meet the real-time processing requirements based on a single data record, such as database CDC, messages, IoT events, etc. Different from traditional ETL, every new piece of data generated and entered into the platform will be responded, calculated, processed and written into the target table within seconds. At the same time, it provides statistical analysis capabilities based on time windows, which is suitable for real-time analysis scenarios.

  • Stable and easy-to-use data real-time service capability
    insert image description here

It supports low-code visualization to develop and configure the Data API required by the business, and can provide real-time interactive data access capabilities with millisecond-level delay and large concurrency, so as to truly support TP-type business. It has complete and configurable data access rights, supports access monitoring and analysis capabilities, and can provide authority-based self-service master data access services and mechanisms for data demand departments. It has a high-availability and scalable architecture design, which is enough to deal with large concurrency and large traffic access.

  • Classification of data and tasks allows data to flow across departments.
    insert image description here
    Supports task classification, and can customize labels according to different projects, which is convenient for quick screening and search, and is helpful for collaborative management and follow-up maintenance of all tasks.

  • Platform-level data verification
    insert image description here
    insert image description here
    Through a variety of self-developed technologies, the high consistency between the target data and the source data is guaranteed. It supports various verification methods such as bar number verification, primary key verification, row-level verification, and advanced data verification, and completes consistency with different verification cycles such as timing verification, polling verification, and minute-level dynamic verification. Calibration to ensure production requirements. At the same time, it supports the secondary verification of wrong data and the repair of wrong data to jointly provide guarantee for data consistency.

  • Visual task operation monitoring and alarming
    insert image description here
    Contains 20+ observability indicators, including full synchronization progress, incremental synchronization delay, etc. It can monitor the latest running status and log information of running tasks in real time, and supports task alarms. Enter the Tapdata console kanban to see the running status of tasks at a glance.

3. More hand in hand: when refined management is in progress

Driven by innovation, improving efficiency and enhancing vitality

As the Institute of Nuclear Power Operation passed through the important node of the 40th anniversary of its establishment, CNNC Wuhan also entered the "Year of Fine Management", focusing on the four requirements of China's nuclear power in terms of intensive operation, quality improvement and efficiency improvement, precise policy implementation, and digital innovation. Actively plan and carry out the special work of refined management improvement with the theme of "innovation-driven, efficiency-enhancing, and vitality-enhancing", with a view to further consolidating the cornerstone of management and empowering high-quality development.

Facing the development needs of the new era, CNNC Wuhan will establish a refined management, differentiated assessment, and precise incentive system for scientific research and production projects centered on value creation. Tapdata is a real-time data service platform that integrates real-time synchronization, visual ETL and data development, data governance, and low-code API publishing. Against this background of demand, there are more application scenarios waiting to be discovered.

  • Provide data basis for performance appraisal optimization: At present, the connection to the workflow library of CNNC Wuhan Business Data Center has been realized, and the performance of relevant personnel in the workflow work can be analyzed through indicators.
  • Provide data basis for the real-time monitoring and analysis platform of visualized projects: Tapdata can be used to complete data acquisition synchronization, wide table construction, statistical aggregation calculation, and provide data solidification view for the data visualization platform developed by CNNC Wuhan, with sub-second performance for these The visualization platform provides data, surpassing the dependence of traditional visualization solutions on SQL and logical views, and it is more real-time and smoother.
  • ……

Break the curse of data silos and chimney growth, return the manpower and time cost of data development to technology and business innovation, and accelerate the digital transformation and upgrading of enterprises-focused and professional, the whole industry is blooming in multiple fields, challenging and breaking the situation , Practice, Tapdata never stops.

Recommended reading

Original link: https://tapdata.net/tapdata-enabling-refined-management.html

Guess you like

Origin blog.csdn.net/weixin_58202160/article/details/130155131