Mac installation and configuration of Hadoop

1. SSH login permission setting_
SSH: secure shell, secure shell. It is a network service program that transmits data safely and efficiently. Hadoop is a cluster. If ssh is not installed, the servers cannot be accessed.
(1) Open remote login and allow all users to access.

Insert picture description here
(2) Enter "ssh-keygen -t rsa -P """
"cat ~/.ssh/id_rsa.pub >> ~/.ssh/authorized_keys" in the terminal
(3) Enter "ssh localhost".
(4) If you can log in without entering a password, the SSH password-free login setting is successful.

Insert picture description here
Two, install stand-alone Hadoop
(1), install Hamebrew (Mac OS package manager)

Insert picture description here
Insert picture description here
(2) Use Homebrew and enter "brew install hadoop" in the terminal to automatically install Hadoop. And check the version:
Insert picture description here
Third, pseudo-distributed installation
(1), modify core-site.xml
Insert picture description here
(2), modify hdfs-site.xml
Insert picture description here
(3), initialize the file system hadoop namenode -format.

Insert picture description here
(4), start all processes, start-all.sh
Insert picture description here
(5), enter jps, view all java processes
Insert picture description here
(6), browser input: localhost:9870, view hadoop information.
Insert picture description here

Guess you like

Origin blog.csdn.net/qq_43259354/article/details/109446137