Rain woods Big Data java practice

Due to the loss of screenshots, recording memories alone.

Code from: "Appendix A: woods rain - Big Data course experiment answers"

Ten exercises HDFS, MapReduce achieve a topic of K-means

 

K-means code is borrowed address https://blog.csdn.net/qq_35488275/article/details/66473942

1. The eclipse-Hadoop-plugin package hadoop into eclipse with the dedicated plug-in package addresses, create MapReduce engineering environment
2. Configuring address and port hadoop native and clients, the new hadoop item, enter the local node native hdfs address: port as 1SPC38 and 9000, two addresses are filled the same, I did not get to know why it is, but try it did succeed

In java file need to fill part of the conf fill hdfs: // 1SPC38: 9000 (specific conditions) in some places is localhost, where in fact it has just replaced it configured 1SPC38

And then modified according to the specific tutorial code on it, the answer is wrong in some places, the need to amend its own, very simple, if you want to achieve more prompts, add a Scanner function just fine.

 

This is the first program I have been learning from the successful implementation of java, all understand and have their own changes, great help learning java, and a powerful personal experience hadoop cluster, then could use it for all data excavation work. Code upload next week or the week after next.