hadoop source code reading environment eclipse

A. Preparations

1.hadoop source download

https://archive.apache.org/dist/hadoop/common/   

hadoop version 2.9.2 is used herein,

2. Install the JDK

3. Install mvn

4. Installation Protocal Buffers

https://github.com/protocolbuffers/protobuf/releases/tag/v2.5.0

download

 

Extracting protoc-2.5.0-win32.zip to the specified directory, for example: E: \ protoc-2.5.0- win32, the path configuration to the PATH system variable.

Protoc --version to verify whether the implementation of variable configuration is successful, as shown:

 

 II. Creating source project

1. Install plug-in

You can modify the source before installing the plug-in download repository, increase download speed, Specifically, the following:

Found apache-maven-xxx / conf / settings.xml configuration file, the following image

   <mirror>
        <id>nexus-aliyun</id>
        <mirrorOf>*</mirrorOf>
        <name>Nexus aliyun</name>
        <url>http://maven.aliyun.com/nexus/content/groups/public</url>
   </mirror>  

Was added to <mirrors> </ mirrors> in. This step is optional, it can not be modified.

(2) entering .. \ hadoop-2.9.2-src \ hadoop-maven-plugins directory, execute

mvn install

Hadoop-maven-plugins installed plug, after successful as:

 

 3. Generate eclipse project files

Back to .. \ hadoop-2.9.2-src directory and execute

mvn eclipse:eclipse -DskipTests

Generate eclipse project file, as shown success:

 

  II. Problem Solving

Compiling hadoop amazon missing dependencies encountered when webservice: DynamoDBLocal-1.11.86.jar. Compiler does not pass, then the need to download dynamodb_local_latest.tar.gz amazon provided, after decompression, in which the package DynamoDBLocal-1.11.86.jar /com/amazonaws/DynamoDBLocal/1.11.86 copied to the directory / mavenspace / directory under, and named DynamoDBLocal-1.11.86.jar. Then compile to be successful.



Guess you like

Origin www.cnblogs.com/gongzixiaobaibcy/p/11900863.html