Linux shell awk/wget download batch files and rename

Example input from web (processed by sed/awk already)

"http://v.leleketang.com/dat/ps/la/k/video/aha/26428.mp4" "唐前诗" "唐前诗歌概述"

"http://v.leleketang.com/dat/ps/la/k/video/aha/25305.mp4" "唐前诗" "《诗经》简介"
"http://v.leleketang.com/dat/ps/la/k/video/aha/25306.mp4" "唐前诗" "《诗经·硕鼠》赏析"
"http://v.leleketang.com/dat/ps/la/k/video/aha/25307.mp4" "唐前诗" "《诗经·硕人》赏析"
"http://v.leleketang.com/dat/ps/la/k/video/aha/25308.mp4" "唐前诗" "《诗经·蒹葭》赏析"
"http://v.leleketang.com/dat/ps/la/k/video/aha/25309.mp4" "唐前诗" "《诗经·关雎》赏析"
"http://v.leleketang.com/dat/ps/la/k/video/aha/25311.mp4" "唐前诗" "屈原及其创作"
"http://v.leleketang.com/dat/ps/la/k/video/aha/25312.mp4" "唐前诗" "《离骚》经典片段赏析"
"http://v.leleketang.com/dat/ps/la/k/video/aha/25314.mp4" "唐前诗" "汉乐府简介"
"http://v.leleketang.com/dat/ps/la/k/video/aha/25313.mp4" "唐前诗" "《妇病行》赏析"
"http://v.leleketang.com/dat/ps/la/k/video/aha/25315.mp4" "唐前诗" "《十五从军征》赏析"
"http://v.leleketang.com/dat/ps/la/k/video/aha/25316.mp4" "唐前诗" "《长歌行》赏析"
"http://v.leleketang.com/dat/ps/la/k/video/aha/25319.mp4" "唐前诗" "曹操及其创作"
"http://v.leleketang.com/dat/ps/la/k/video/aha/25320.mp4" "唐前诗" "曹操《蒿里行》赏析"
"http://v.leleketang.com/dat/ps/la/k/video/aha/25321.mp4" "唐前诗" "曹操《观沧海》赏析"
"http://v.leleketang.com/dat/ps/la/k/video/aha/25322.mp4" "唐前诗" "曹操《龟虽寿》赏析"
"http://v.leleketang.com/dat/ps/la/k/video/aha/25324.mp4" "唐前诗" "陶渊明及其创作"
"http://v.leleketang.com/dat/ps/la/k/video/aha/25325.mp4" "唐前诗" "陶渊明《归园田居・其一》赏析"
"http://v.leleketang.com/dat/ps/la/k/video/aha/25326.mp4" "唐前诗" "陶渊明《归园田居・其三》赏析"
"http://v.leleketang.com/dat/ps/la/k/video/aha/25327.mp4" "唐前诗" "陶渊明《饮酒・其五》赏析"
"http://v.leleketang.com/dat/ps/la/k/video/aha/25328.mp4" "唐前诗" "陶渊明《桃花源记》赏析"
"http://v.leleketang.com/dat/ps/la/k/video/aha/25329.mp4" "唐前诗" "魏晋风度与竹林七贤"
"http://v.leleketang.com/dat/ps/la/k/video/aha/25330.mp4" "唐前诗" "阮籍《咏怀诗・其一》赏析"
"http://v.leleketang.com/dat/ps/la/k/video/aha/25331.mp4" "唐前诗" "嵇康《赠秀才从军・其九》赏析"
"http://v.leleketang.com/dat/ps/la/k/video/aha/25332.mp4" "唐前诗" "南北朝民歌简介"
"http://v.leleketang.com/dat/ps/la/k/video/aha/25333.mp4" "唐前诗" "《木兰辞》赏析"
"http://v.leleketang.com/dat/ps/la/k/video/aha/26425.mp4" "唐诗" "唐朝的诗歌概况"
"http://v.leleketang.com/dat/ps/la/k/video/aha/25049.mp4" "唐诗" "王勃的创作风格、代表作品"

"http://v.leleketang.com/dat/ps/la/k/video/aha/25050.mp4" "唐诗" "王勃《送杜少府之任蜀州》赏析"



..........



Shell script for wget download


#!/bin/bash
linenumber=0;
catalog=0;
subtype=0;
d2_old="";
filename="";
newfilename="";


## Note compare Chinese characters 
###export LANG=zh_CN.UTF-8


cat list.txt | while read line; 
do 
   linenumber=`expr $linenumber + 1`; 
 
   d1=`echo $line| awk '{print $1 }'  |awk -F "\""   '{print $2}' `
   d2=`echo $line| awk '{print $2 }'  |awk -F "\""   '{print $2}'  `




   if [[ $d2 =~ $d2_old ]]; then
     subtype=`expr $subtype + 1`
   else
     catalog=`expr $catalog + 1` 
     subtype=0;
   fi 


   #echo $linenumber  ":" $catalog"  and  "$subtype
   d2_old=$d2;
   d3=`echo $line| awk '{print $3 }' |awk -F "\""   '{print $2}'  `


    filename=`echo $d1| awk -F '/' '{print $NF }' `
    newfilename=$catalog$d2"_"$subtype$d3.mp4;
   #echo $linenumber  ":" $filename " save as "$newfilename    
   echo "wget  $d1   -q -c   -O $newfilename"
   wget  $d1   -q -c   -O $newfilename
   sleep  5 


done 




## Restore to US 
####export LANG=en_US.UTF-8

猜你喜欢

转载自blog.csdn.net/hushui/article/details/80899338