spark Learning Day 1

1. Change directory to / data / directory, create named edu1 directory

1. cd / data /  
2. mkdir /data/edu1  

2. Change directory to / data / edu1 directory using wget command download webmagic reptiles project depends lib package

1. cd /data/edu1  
2. wget http://192.168.1.100:60000/allfiles/second/edu1/webmagic-0.7-libs.tar.gz 

 

The webmagic-0.7-libs.tar.gz archive, unzip.

1. tar -xzvf WEBMagic-0.7-libs.tar.gz  

3. Open the eclipse development tools

 

Create the Java Project , named pachong1

 

 

Click on the project name pachong1 , create a new directory named libs , and /data/edu1/webmagic-0.7-libs under all the jar packages, copied to the libs directory. And select all the jar packages, right-click on the "Build Path" => "Add to Build Path"

 

 

 

Change directory to /data/edu1/rexian.beijing.gov.cn , review the situation data