Mapreduce use and errors in Combiner

combine operation is understood to reduce the map in the combined operation of the output end of a single map data task
effects:
reduce the amount of data transmitted to Reduce in. It is mainly to reduce output Mapper thereby reducing the load on network bandwidth and Reducer
disadvantages:
combine optimization as a means of options, not all are suitable for MR procedures combine
the appropriate scene: for example seeking maximum, sum, for example, an intermediate value not seek

Published 273 original articles · won praise 1 · views 4681

Guess you like

Origin blog.csdn.net/wj1298250240/article/details/103965231