Author: Zen and the Art of Computer Programming
1 Introduction
Overview
HBase is a high-performance distributed column store database. It is an open source project developed and maintained by developers at the Apache Software Foundation. Based on Hadoop, HBase provides low-latency data access and can store massive amounts of structured, semi-structured and unstructured data. It is suitable for data warehouse, data analysis, real-time query and other scenarios. At the same time, HBase supports row-level transaction processing to ensure data consistency. HBase has a flexible architectural design and supports custom permission management mechanisms.
The main uses of HBase in Didi include real-time computing, real-time report statistics, real-time business monitoring, offline data analysis, etc. Depending on the size of the data, HBase can be deployed on a single node or scaled through a distributed cluster. Currently, in Didi, HBase stores more than 30 billion records every day and responds to billions of read and write requests every second.
This series of tutorials will introduce how to use HBase in an actual production environment to improve the overall performance of the system, and delve into the data storage architecture, data models and applications based on HBase. At the same time, the specific operation mode and key parameter settings of HBase in Didi will also be explained in detail. This article aims to help readers more fully understand the application of HBase in Didi, and quickly understand how to build reliable and efficient distributed data services based on HBase.
About the Author
I am a senior programmer and software architect. I have worked as a senior technical expert at Alibaba Group and as an architect at a top domestic Internet company. Proficient in Java language, have a deep understanding of Hadoop ecology, distributed systems, etc., have good programming habits and communication skills. Joined Didi Chuxing in 2014 and engaged in big data platform related work. He has led the research and development and architecture design of Didi Chuxing's intelligent parking platform, open platform, public opinion analysis system and other products.