Fine-grained and coarse-grained resource application resource application

  • Coarse-grained resource application (Spark)

    • Before Application execution, all of the resource request is completed, when the resource application is successful, the task will be scheduled when all the task execution is completed, it will release some of the resources

    • Pros: Before Application execution, all of the resources you sign up, each task directly using the resources on it, do not need to perform the task in front of their own resources to apply, task start on the fast, faster task execution, stage executed soon up, job on the fast, application execution on the fast

    • Cons: resource until the last task to complete before the release of resources to implement, can not make full use of cluster

  • Fine-grained resource application (MapReduce)

    • Application do not need to go to apply before execution resources, but directly executed, so that each job before executing a task themselves to apply resources to complete the task execution on the release of resources

    • Advantages: resource cluster can take full advantage

    • Drawback: task themselves to apply resources, task start slow, Application running on the corresponding slower

Guess you like

Origin www.cnblogs.com/xiangyuguan/p/11228320.html