Mac搭建Spark

1. Requirements for Mac

Name

                                                Description

Installation                   Guide

Brew

The package installation soft for mac. Very helpful for this installation and in life in general.

brew install

Anaconda

A distribution of python, with packaged modules and libraries. Note: we recommend installing Anaconda 2 (for python 2.7)

anaconda install

JDK 8

Java Development Kit, used in both Hadoop and Spark.

brew cask install java

在安装brew的时候如果出现报错:

curl: (7) Failed to connect to raw.githubusercontent.com port 443: Connection refused

解决方案:如果能打开这个网页,https://raw.githubusercontent.com/Homebrew/install/master/install,将网页保存为brew_install.rb后,命令行进去该文件路径输入如下命令即可完成安装。

ruby brew_install.rb

2. 安装scala 

brew install scala

3.安装spark

brew install apache-spark

 4.启动

spark-shell
发布了26 篇原创文章 · 获赞 13 · 访问量 7292

猜你喜欢

转载自blog.csdn.net/original_recipe/article/details/102856399