spark precompiled installation

1. Download:

  http://mirrors.tuna.tsinghua.edu.cn/apache/spark/spark-3.0.0-preview/spark-3.0.0-preview-bin-hadoop2.7.tgz

Upload a virtual machine or server

2. Unzip the file

  tar -xzvf spark-3.0.0-preview-bin-hadoop2.7.tgz

3. Set Environment Variables

  vi / etc / profile 

  

 

 

  source /etc/profile

4. Start spark 

spark-shell local[4]

local [n] n is the number of threads that can be added from time to see the scene plus

 

 

sprk RDD operation

 

 

 

 

 

 

 

 

 

Guess you like

Origin www.cnblogs.com/YuanWeiBlogger/p/11923558.html