Big Data Hadoop cluster installed the third week --Hadoop

Big Data Week 3:

1. perfect CentOS7 minimal installation version

Check whether access to the Internet, the system update, the update command: sudo yum update

 

2. Use a remote server method

No GUI installation, it is commonly used in server systems, but the machine is not very easy to operate, usually remote server is used. If the remote used on linux or mac system, use ssh remote landing directly on it; if it is windows, no corresponding module, requires third-party software, such as: putty, xshell and so on.

Putty is a green software, no installation, download address: https: //www.chiark.greenend.org.uk/~sgtatham/putty/latest.html

It can be run directly open interface is as follows:

If you want to modify the font size, the appearance at the window, there is the option. In the "Host Name (or IP address)" Enter the host name or ip address bar, you can remote login, if you enter the host name, domain name resolution must first deal with the problem.

DNS file: hosts, no matter wondows or linux, all the files.

As the putty is used in windows, the windows now solve DNS problem, edit the hosts file windows, location: c: \ windows \ system32 \ drivers \ etc. Again file added: ip string corresponds with the host name, for example: 10.0.0.11 slave0

3. Modify the computer name

hostname in edit / etc in the content, delete all the original content, enter the name of the computer you want to restart the virtual machine is complete.

Command: sudo vi / etc / hostname.

After editing: sudo reboot.

 

4. The preparation of the third node

Third node to the second node is a direct copy of the past, must be performed before sudo poweroff copy, turn off the virtual machine. The entire second node to copy the file copy form. Then vmware home page, click on the "open virtual machine", modify the virtual machine name.

The third node boot, modify ip address and host name.

5. Modify the name of the node NameNode

Edit / etc / hostname, will replace the contents of master (be careful not to use blank lines)

 

6. periodic summary

NameNode node: computer name master, ip address 10.0.0.10

DataNode1 node: computer name slave0, ip address 10.0.0.11

DataNode2 node: computer name slave1, ip address 10.0.0.12

DataNode3 node: computer name slave2, ip address 10.0.0.13

Each node must complete the system update, the update command: sudo yum update.

 

7. DNS file

Location in / etc, hosts file. Edit this file, you can not delete the original file contents can only be added at the end, for example:

10.0.0.10 master

10.0.0.11 slave0

10.0.0.12 slave1

10.0.0.13 slave2

Three nodes have the same operation.

After the operation is completed, the computer name of the remote landing tests, respectively, in different nodes, landing another two virtual machines using ssh command, if it is normal, you can enter the next step. Use the command: ssh slave0, ssh slave1, ssh master

Specifies the user name for the remote login: ssh username @ip

 

8. Turn off the firewall

Check the firewall status: systemctl status firewalld service

Turn off the firewall: systemctl stop firewlld.service

Disable Firewall: systemctl disable firewlld.service

Disable the firewall if you do not perform, the next start, the firewall will start.

Three nodes restart, after restarting, firewall status were examined using three nodes systemctl status firewalld service orders to see inactive (dead) prompt.

Guess you like

Origin www.cnblogs.com/caiyishuai/p/12509150.html