About yarn

Yarn popular Introduction

Hadoop YARN the Apache ( Yet Another Resource Negotiator , another resource coordinator) is a new Hadoop Explorer, it is a common resource management and scheduling platform for the upper application to provide a unified resource management and scheduling, it the introduction of the cluster in terms of utilization of resources unified management and data sharing has brought great benefits.

Can the yarn be understood as the equivalent of a distributed operating system platform, mapreduce and other operational procedures is equivalent applications running on top of the operating system, the Yarn provide the resources needed operation (memory, these programs the CPU ).

 

 

 

L the Yarn is not clear operating mechanism of the program submitted by users

L yarn only provide scheduling computing resources (the user program to the yarn application resources, yarn is responsible for allocating resources)

L the Yarn director roles called ResourceManager

L the Yarn specific role of providing computing resources called NodeManager

L yarn running user program is completely decoupled, meaning yarn on distributed computing can run various types of programs, such as MapReduce , Storm , Spark , the TEz ......

L the Spark , Storm and other operations can be integrated into the framework of yarn on the run, as long as there is compliance with their respective frameworks yarn resource request mechanism can be standardized

L the Yarn become a common resource scheduling platform . Enterprises in various operations previously existing cluster can be integrated on a single physical cluster, improve resource utilization, and facilitate data sharing

to sum up:

        It is a common resource management and task scheduling system!

 

 



Guess you like

Origin www.cnblogs.com/TiePiHeTao/p/b7a3d99e971662f78583bb99f3205af0.html