Cloud HBase X-Pack is based on Apache HBase, Phoenix, Spark depth extension, retrieval Solr fusion technology to support stop mass data storage, retrieval and analysis. Converged Cloud kafka + cloud HBase X-Pack can build an integrated data processing platform to support risk control, recommendation, search, portrait, social, networking, space, form query, the number of warehouses and other off-line scene, help enterprise data intelligent.
Below is the industry's big data sets widely used in architecture, which HBase & Spark select cloud HBase X-Pack product-related user documentation , purchase page :
- Message inflow: binlog Flume, Logstash, or an online library inflow messaging middleware Kafka
- Real-time calculation: The X-Pack Spark Streaming real-time consumption of Kafka's message, written in the cloud HBase provide external online inquiry
- Real-time storage and retrieval: HBase cloud integration solr and phoenix sql layer capable of providing mass storage, real-time, and online query
- Batch processing, warehouse and several algorithms: online storage HBase data can be automatically archived to X-Pack Spark number of positions. The full amount of precipitation data warehouse to Spark number (HiveMeta), do complex calculations batch processing, algorithm analysis, the results back to the online library provide external inquiries.
Practice of the operation of the scheme may be set with reference to the article , while cloud HBase & Spark sample code library can refer to