[Basic knowledge] Brief introduction to big data component YARN

YARN is a distributed resource management system.
YARN is the core component of the Hadoop system. Its main functions include resource management in the Hadoop cluster, scheduling, running and monitoring of jobs.
Please add image description

ResourceManager

Responsible for cluster resource management and scheduling, allocating resources for various types of jobs running on YARN.
The non-HA cluster is deployed on the Master node of EMR, and the HA cluster is deployed on multiple Master nodes of EMR to ensure high availability.

NodeManager

Responsible for node resource management, monitoring and job running.
Deployed on the Core or Task node of EMR.

Reference documentation

What is the resource management system YARN_Open source big data platform E-MapReduce-Alibaba Cloud Help Center

おすすめ

転載: blog.csdn.net/weixin_44325637/article/details/135090445