Metadata management is the description information of the whole data life cycle such as data collection, storage, processing and presentation, and helps users understand data relationships and related attributes. Metadata management tools can understand the distribution and generation process of data assets. Realize the definition and storage of metadata models, package them into various metadata functions at the functional layer, and finally provide external applications and presentations; provide metadata classification and modeling, blood relationship and impact analysis, and facilitate data tracking and backtracking.
Here Xiaoyi recommends EsPowerMeta, the Yixin Huachen metadata management platform. This platform is dedicated to processing technical metadata, business metadata, and management metadata. It helps various industries through strong technical expansion, strong business integration, and strong ease of use. Users in various industries gain more data insight, and then dig out the value hidden in resources to achieve strong business empowerment.
1. Application value
- For technicians, the metadata management platform realizes the structuring of information description and classification by describing, locating, retrieving, evaluating, and analyzing resource information that will be dispersed and has a large difference in storage structure, thereby creating a new environment for machine processing. It is possible to greatly reduce the labor cost of data governance. Because of this, metadata has become the core of many large data governance projects.
- For business personnel, the metadata management platform assists business personnel in understanding business meanings, industry terms and rules, business Indicators take data caliber and scope of influence, etc.
2. Main features
1. Metadata collection service
It can adapt to heterogeneous environments and supports the collection of full metadata from traditional relational databases and big data platforms, from data generation systems to data processing systems to data application reporting systems, including data entities in the process (systems, libraries, tables, field description) and the logic in the process of data entity processing;
Yixin Huachen metadata management platform has built-in multiple acquisition adapters, which support automatic acquisition of metadata in various storage formats, such as: databases, reporting tools, ETL tools, file systems, etc. At the same time, metadata that cannot be automatically acquired is provided. The customizable metadata collection template completes the batch import of metadata.
2. Customizable metamodel management
Customize and expand the meta-model, and the application of metadata to meet different management needs is based on the meta-model. The metamodel in the EsPowerMeta data management platform (EsPowerMeta) supports the CWM (Common Warehouse Metamodel) specification, and at the same time provides a set of convenient custom management interface functions, which can be fully customized and extended to meet the rapid implementation of metadata management It can adapt to different management needs of users in different periods.
3. Comprehensive metadata monitoring
Perfect metadata management, tracking business operation The EsPowerMeta data management platform (EsPowerMeta) provides comprehensive metamodel and metadata maintenance functions, and simplifies the complexity of metadata maintenance in various ways. The system supports automatic acquisition of metadata and time scheduling management, supports manual creation and modification of metadata, and cooperates with version management to completely store the dynamics and changes in the entire life cycle of metadata, which is convenient for users to track historical data of business operations.
4. Convenient full-text search
Full-text search engine, search at any time, convenient business EsPowerMeta has a built-in full-text search engine, so that users at all levels can quickly locate the metadata they care about. EsPowerMeta supports search based on name, basic attribute, and relationship between metadata, and also supports full-text search. Through the fuzzy query of multiple combined conditions, the required metadata can be retrieved at any time in the entire metadata environment.
5. Field-level metadata analysis
Rich metadata analysis applications, enabling business Yixin Huachen metadata management platform provides a wealth of analysis applications, including: blood relationship analysis, impact analysis, full chain analysis, correlation analysis, attribute difference analysis, metadata comparison analysis, Repeat metadata analysis, metadata comparative analysis, repeat metadata analysis, and support the export and collection of analysis results.
- Typical application case
- Government affairs: Metadata management platform of government affairs service data management bureau in a district of Foshan
(1) Construction content
The Government Service Data Management Bureau collects and manages the data of various government departments in the region, provides unified data services and applications for each department, and realizes the overall data development and operation mechanism of "using data to make decisions, use data to supervise, and use data to start a business". Through the metadata management platform, this project sorts out various data sources, realizes the automatic collection of metadata of various government departments such as the Health and Family Planning Commission, the Bureau of Industry and Commerce, and the Stream Management Bureau, sorts out the existing data transfer process and data structure, and based on its Construct a new set of data architecture, provide data lineage analysis, impact analysis, etc., and finally form a government data map of the whole region.
(2) Project value
Help the data administration to determine the data source and data structure, lay a solid foundation for subsequent data standard construction and data quality management, and provide support for government resource catalogs, self-reporting systems, paperless education and other applications.
- Bank: a bank metadata management platform
(1) Construction content
Establish a bank-level data warehouse for the five major business themes of "off-site supervision", "risk", "credit", "interest rate" and "foreign exchange", comprehensively carry out metadata management work, and sort out the existing data of various business systems of the bank , determine the data source of each business theme of the data warehouse, clarify the data dictionary and association relationship, and realize the same source, isomorphism and unified data caliber of data.
(2) Project value
Help banks understand existing data, clarify the ins and outs of data, and determine a unified source of data for applications. Support the construction of data warehouses, and provide blood relationship analysis of various data, especially regulatory submission data, to quickly locate the source of data problems.