The road to Saber platform construction
Standardized indicator output, universal indicator model design
HBase table stores indicator detail data
RowKey design guidelines:
rowkey=index column + time column + storage granularity
Indicator column: Provides flexible assembly rules, which are mainly composed of indicator ID+dimension 1+dimension 2... and the quality of streaming data reported for the mobile APP buried points can be divided into: indicator ID, dimension enumeration value, and streaming data ID , Client version number. PS: The value range of the dimension enumeration value is (length is 2): 01. Consistency, 02. Completeness, 03. Uniqueness, 04. Accuracy, 05. Normative, 06 to 99. Custom.
Time column: This column uses the default format, which is "YYYYMMDD"
Storage granularity: This column uses enumerated values, 1: day granularity, 2: hour granularity, 3: minute granularity.
Column family design
Column families are classified according to storage granularity. For example, there is only one column for day granularity, 24 columns for hour granularity, and 1440 columns for minute granularity.