The foundation spark

1, the core is the most basic function of spark sparkCore

2, sparkcore mainly includes: sparkContext, calculation engine, storage systems, deployment model

3, RDD: distributed data sets, is spark the most basic data abstraction. It represents an immutable, can partition the set of internal elements of parallel computing.

4, sparkCore basic code Function:

1, wordCount (word count)

2, boradCast (broadcast variable)

3, accumulator (counter)

4, partion (partition)

Click on the specific code:  sparkCore

 
  

 

 

 

Guess you like

Origin blog.csdn.net/weixin_40126236/article/details/87869352