Author: Zen and the Art of Computer Programming
In enterprise-level applications, metadata is crucial to business operations and data analysis. For example, metadata-based reporting, search, and recommendation functions all rely on metadata information. With the increasing number of Internet applications, more and more enterprises spend more resources on storing metadata, how to improve metadata performance and ensure its maintainability has become an important issue.
2. Explanation of basic concepts and terms
2.1 Definition and classification of metadata
Metadata is data that describes data. In computer science, metadata is a data structure used to describe data about data . It provides data about data.
Metadata can be divided into the following categories:
- Data Modeling: Information describing data structures, data constraints, and other data characteristics. Database objects defined by metadata generally include tables, fields, views, relationships, indexes, and so on.
- Data Dictionary (Data Dictionary): Describes related information such as data fields, names, types, descriptions, and examples.
- Data Coding Rules (Data Coding Rules): Describe the standardized form of data, the range of valid values, the way it can be recognized and understood, and the conversion method.
- Data Subject Matter Experts: Describes information about people, institutions, or organizations related to a data subject.
- Data Flow Diagram: Describes the data integration process, showing the starting point, ending point, direction, format and other information of each data integration.
2.2 Metadata specification definition
Metadata Standardization refers to the process of unifying metadata generated by different data sources under the same standard. The unified metadata should conform to the system