1. Requirements for Mac
Name |
Description |
Installation Guide |
---|---|---|
Brew |
The package installation soft for mac. Very helpful for this installation and in life in general. |
|
Anaconda |
A distribution of python, with packaged modules and libraries. Note: we recommend installing Anaconda 2 (for python 2.7) |
|
JDK 8 |
Java Development Kit, used in both Hadoop and Spark. |
|
在安装brew的时候如果出现报错:
curl: (7) Failed to connect to raw.githubusercontent.com port 443: Connection refused
解决方案:如果能打开这个网页,https://raw.githubusercontent.com/Homebrew/install/master/install,将网页保存为brew_install.rb后,命令行进去该文件路径输入如下命令即可完成安装。
ruby brew_install.rb
2. 安装scala
brew install scala
3.安装spark
brew install apache-spark
4.启动
spark-shell