Detailed explanation of the principles of Spark, HDFS, YARN, Zookeeper, Kafka, Hive, HBase, etc.
Article content | link |
---|---|
Basic Principles of Distributed File System HDFS | Basic Principles of Distributed File System HDFS |
The basic principle of the calculation engine Spark | The basic principle of the calculation engine Spark |
The principle of distributed coordination service ZooKeeper | The principle of distributed coordination service ZooKeeper |
The principle of distributed message queue Kafka | The principle of distributed message queue Kafka |
Detailed explanation of the principles of Hive and Spark SQL | Detailed explanation of the principles of Hive and Spark SQL |
Detailed explanation of the principle of distributed column cluster storage system HBase | Detailed explanation of the principle of distributed column cluster storage system HBase |
Spark job division stage and Spark parameter setting tuning | Spark job division stage and Spark parameter setting tuning |