Spark study notes for learning spark process

purpose

Regarding big data, I had a little plan to learn in 14 years, but it was delayed until 18 years. I have deeply realized the importance of data in most of the year. Data is the precious wealth of an enterprise, so I want to engage in big data. , Do analysis. So now you have to learn a technology for yourself in the history of the flag, and learn from Spark now.

 

learning process

I bought a copy of "Spark Best Practices" at the beginning, and after reading it, I basically talked about the basics of spark with very little practice. This can be regarded as an introductory book. Since the current salary has nothing to do with data analysis, I didn't have a deep understanding after reading it.

I accidentally found a course "Spark Programming Fundamentals" in NetEase Cloud Classroom , which was taught by a teacher at Xiamen University, and it was pretty good. Each lesson is relatively short, and I always say it is a boon to those who are eager to finish the lesson. It's too long and it's scared. Now that I have read the basics of spark, I haven't read the scala syntax yet. Several examples are also written in it. Have a better understanding of spark overall.

Now I think the most lacking is an opportunity to practice hands. Now I want to find a practical example to practice.

 

Record of learning achievement

2018-10-23 Now I can run several rdd examples in idea.

 

 

Guess you like

Origin blog.csdn.net/samz5906/article/details/83315943