HDFS under replicated blocks

under replicated blocks 
to solve: 
find no copy of the Block: 
HDFS fsck / | grep ' Under replicated ' | awk -F ' : '  ' {1} Print $ ' >> / tmp / under_replicated_files 
then repair cycle: 
for hdfsfile in `CAT / tmp / under_replicated_files`; do echo " Fixing $ hdfsfile: " ; Hadoop FS -setrep . 3 $ hdfsfile; DONE 
output as follows: 
Fixing /user/hdfs/.staging/job_1547173493660_0405/ job.jar: 
the Replication . 3  SET: /user/hdfs/.staging/job_1547173493660_0405/job.jar
Fixing /user/hdfs/.staging/job_1547173493660_0405/job.split :
Replication 3 set: /user/hdfs/.staging/job_1547173493660_0405/job.split
Fixing /user/hdfs/.staging/job_1547173493660_0481/job.jar :
Replication 3 set: /user/hdfs/.staging/job_1547173493660_0481/job.jar
Fixing /user/hdfs/.staging/job_1547173493660_0481/job.split :
Replication 3 set: /user/hdfs/.staging/job_1547173493660_0481/job.split
Fixing /user/hdfs/.staging/job_1547173493660_0483/job.jar :
Replication 3 set: /user/hdfs/.staging/job_1547173493660_0483/job.jar
Fixing /user/hdfs/.staging/job_1547173493660_0483/job.split :
Replication 3 set: /user/hdfs/.staging/job_1547173493660_0483/job.split
Fixing /user/hdfs/.staging/job_1547197402450_0021/job.jar :
Replication 3 set: /user/hdfs/.staging/job_1547197402450_0021/job.jar
Fixing /user/hdfs/.staging/job_1547197402450_0021/job.split :
Replication 3 set: /user/hdfs/.staging/job_1547197402450_0021/job.split

 

Guess you like

Origin www.cnblogs.com/shanhua-fu/p/11344790.html