Yarn-HDFS read and write test

HDFS read and write test

1.hdfs writing test

yarn jar /usr/local/service/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.8.5.jar  TestDFSIO -write -nrFiles 10 -size 100MB

Parameter description:
-write: test writing
-nrFiles 10: write 10 files
-size 10MB: 10MB for each file
– view the generated test data
hdfs dfs -ls /benchmarks/TestDFSIO/io_data

2.hdfs read test

yarn jar /usr/local/service/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.8.5.jar  TestDFSIO -read -nrFiles 10 -size 1MB