Hadoop之mrbench

需求:

需要测试机器mr的执行性能,那么可以通过mrbench进行测试

语法:

bin/hadoop jar share/hadoop/mapreduceX/hadoop-test-XXX.jar mrbench
[-baseDir <base DFS path for output/input, default is /benchmarks/MRBench>]
[-jar <local path to job jar file containing Mapper and Reducer implementations, default is current jar file>] 
[-numRuns <number of times to run the job, default is 1>]
[-maps <number of maps for each run, default is 2>] 
[-reduces <number of reduces for each run, default is 1>] 
[-inputLines <number of input lines to generate, default is 1>] 
[-inputType <type of input to generate, one of ascending (default), descending, random>]
[-verbose]

需求:

生成每个文件100000行,1000个mapper,200个reducer,执行200次:

bin/hadoop jar share/hadoop/mapreduceX/hadoop-test-XXX.jar mrbench -numRuns 200 -inputLines 100000 -maps 1000 -reduces 200

汇总信息:

DataLines       Maps    Reduces AvgTime (milliseconds)
100000          1000      200      28522

猜你喜欢

转载自snv.iteye.com/blog/2045916
今日推荐