MAP/REDUCE TASK作业状态转移图

Task Attempt

Table of contents:

Finite State Machine

Hadoop (MapReduce): Task Attempt - Finite State Machine

NEW => UNASSIGNED [TA_SCHEDULE]

Hadoop (MapReduce): Task Attempt - NEW => UNASSIGNED - TA_SCHEDULE

UNASSIGNED => ASSIGNED [TA_ASSIGNED]

Hadoop (MapReduce): Task Attempt - UNASSIGNED => ASSIGNED - TA_ASSIGNED

ASSIGNED => RUNNING [TA_CONTAINER_LAUNCHED]

Hadoop (MapReduce): Task Attempt - ASSIGNED => RUNNING - TA_CONTAINER_LAUNCHED

RUNNING => SUCCESS_CONTAINER_CLEANUP [TA_DONE], COMMIT_PENDING => SUCCESS_CONTAINER_CLEANUP [TA_DONE]

Hadoop (MapReduce): Task Attempt - RUNNING => SUCCESS_CONTAINER_CLEANUP - TA_DONE - COMMIT_PENDING => SUCCESS_CONTAINER_CLEANUP

SUCCESS_CONTAINER_CLEANUP => SUCCEEDEED [TA_CONTAINER_CLEANED]

Hadoop (MapReduce): Task Attempt - SUCCESS_CONTAINER_CLEANUP => SUCCEEDEED - TA_CONTAINER_CLEANED

MapTask

 

Table of contents:

Startup

Hadoop (MapReduce): MapTask - Startup

Execution

Hadoop (MapReduce): MapTask - Execution

Post Execution - Shuffle

Hadoop (MapReduce): MapTask - ShuffleHadoop (MapReduce): MapTask - Shuffle (2)

 

ReduceTask

Table of contents:

Startup

Hadoop (MapReduce): ReduceTask - Startup

Shuffle

Hadoop (MapReduce): ReduceTask - Shuffle

Local Fetcher

Hadoop (MapReduce): ReduceTask - Local Fetcher

Fetcher

Hadoop (MapReduce): ReduceTask - Fetcher

Shuffle - Merge

Hadoop (MapReduce): ReduceTask - Shuffle MergeHadoop (MapReduce): ReduceTask - Shuffle Merge (2)

Execution

Hadoop (MapReduce): ReduceTask - Execution

 

 

 

Merger

 

Hadoop (MapReduce): Merger

猜你喜欢

转载自zhangxiong0301.iteye.com/blog/2205413
今日推荐