给自己的提醒
顺序：主机名 主机配置文件 yum源 时间同步 ssh 禁用transparent huge pages jdk 安装ambari-server 数据库 配置ambari-server ambari-agent
1、修改主机名 注意：在IAAS平台上搭建的云主机，即使表面上看起来主机名是正确的，但是其实有.nova的后缀，所以我们需要重新去修改hostname。
master：
[root@master ~]# hostnamectl set-hostname master
[root@master ~]# hostname
master
slaver：
[root@slaver ~]# hostnamectl set-hostname slaver
[root@slaver ~]# hostname
slaver
2、修改/etc/hosts文件，2.2版本采用的是FQDN格式。
master：
[root@master ~]# vim /etc/hosts
#10.0.0.108 master.hadoop master
#10.0.0.109 slaver.hadoop
slaver：
[root@slaver ~]# vim /etc/hosts
#10.0.0.108 master.hadoop
#10.0.0.109 slaver.hadoop slaver
2.1、在master和slaver节点上测试。
[root@master ~]# ping slaver.hadoop
PING slaver.hadoop (10.0.0.109) 56(84) bytes of data.
64 bytes from slaver.hadoop (10.0.0.109): icmp_seq=1 ttl=64 time=0.851 ms
64 bytes from slaver.hadoop (10.0.0.109): icmp_seq=2 ttl=64 time=0.747 ms
64 bytes from slaver.hadoop (10.0.0.109): icmp_seq=3 ttl=64 time=0.784
[root@slaver ~]# ping master.hadoop
PING master.hadoop (10.0.0.108) 56(84) bytes of data.
64 bytes from master.hadoop (10.0.0.108): icmp_seq=1 ttl=64 time=0.780 ms
64 bytes from master.hadoop (10.0.0.108): icmp_seq=2 ttl=64 time=0.786 ms
64 bytes from master.hadoop (10.0.0.108): icmp_seq=3 ttl=64 time=0.732
3、配置Yum源，首先把镜像以块的形式挂载到/mnt目录下，并把ambari-2.6.0.0复制到/opt目录下，在master节点配置ftp服务，为slaver的yum提供服务。
[root@master ~]# mount -o loop XianDian-BigData-v2.2.iso /mnt/
mount: /dev/loop0 is write-protected, mounting read-only
[root@master ~]# df -Th
Filesystem Type Size Used Avail Use% Mounted on
/dev/vda1 xfs 80G 28G 53G 35% /
devtmpfs devtmpfs 3.9G 0 3.9G 0% /dev
tmpfs tmpfs 3.9G 12K 3.9G 1% /dev/shm
tmpfs tmpfs 3.9G 17M 3.9G 1% /run
tmpfs tmpfs 3.9G 0 3.9G 0% /sys/fs/cgroup
/dev/loop0 iso9660 7.8G 7.8G 0 100% /mnt
3.1、挂载完成后，将所有内容复制到/opt目录下。
[root@master mnt]# ll
total 396868
drwxr-xr-x 5 root root 2048 Jan 30 2018 ambari-2.6.0.0
-rw-r–r-- 1 root root 225014400 Feb 2 2018 apache-nutch-1.12-bin.tar.gz
drwxr-xr-x 37 root root 6144 Jan 29 2018 HDP-2.6.1.0
drwxr-xr-x 20 root root 4096 Jan 29 2018 HDP-UTILS-1.1.0.21
-rw-r–r-- 1 root root 181365687 Jan 29 2018 jdk-8u77-linux-x64.tar.gz
[root@master mnt]# cp -rvf ./ /opt*
3.2、现在开始配置我们的Yum仓库。192.168.200.10为控制节点的IP地址，是Centos7的Yum源。
[root@master opt]# cd /etc/yum.repos.d/
[root@master yum.repos.d]# vim ambari.repo
[centos]
name=centos
baseurl=ftp://192.168.200.10/centos
enbale=1
gpgcheck=0
[ambari]
name=ambari
baseurl=file:///opt/ambari-2.6.0.0
enable=1
gpgcheck=0
3.3、master节点安装vsftpd服务，修改配置文件，设置共享目录为/opt。启动vsftpd服务，并设置为开机自启。
[root@master ~]# yum -y install vsftpd
[root@master ~]# vim /etc/vsftpd/vsftpd.conf #在配置文件内增加一行
anon_root=/opt
[root@master ~]# systmectl start vsftpd
[root@master ~]# systemctl enable vsftpd
3.4、配置slaver节点的Yum仓库。
[root@slaver ~]# cd /etc/yum.repos.d/
[root@slaver yum.repos.d]# vim ambari.repo
[centos]
name=centos
baseurl=ftp://192.168.200.10/centos
enbale=1
gpgcheck=0
[ambari]
name=ambari
baseurl=ftp://192.168.200.104/ambari-2.6.0.0
enable=1
gpgcheck=0
3.5、master节点安装httpd服务，将/opt目录下面的HDP-2.6.1.0和HDP-UTILS-1.1.0.21两个文件夹拷贝到/var/www/html/目录下。启动httpd服务，并设置为开机自启。
[root@master ~]# yum -y install httpd
[root@master ~]# cd /opt
[root@master opt]# cp HDP-2.6.1.0/ HDP-UTILS-1.1.0.21/ /var/www/html/
[root@master opt]# systemctl start httpd
[root@master opt]# systemctl enable httpd
[root@master opt]# systemctl status httpd
httpd.service - The Apache HTTP Server
Loaded: loaded (/usr/lib/systemd/system/httpd.service; enabled)
Active: active (running) since Tue 2020-01-14 08:43:07 UTC; 25min ago
Docs: man:httpd(8)
man:apachectl(8)
Main PID: 811 (httpd)
Status: “Total requests: 0; Current requests/sec: 0; Current traffic: 0 B/sec”
CGroup: /system.slice/httpd.service
├─ 811 /usr/sbin/httpd -DFOREGROUND
├─1179 /usr/sbin/httpd -DFOREGROUND
├─1180 /usr/sbin/httpd -DFOREGROUND
├─1181 /usr/sbin/httpd -DFOREGROUND
├─1182 /usr/sbin/httpd -DFOREGROUND
└─1183 /usr/sbin/httpd -DFOREGROUND
Jan 14 08:43:03 master systemd[1]: Starting The Apache HTTP Server…
Jan 14 08:43:07 master systemd[1]: Started The Apache HTTP Server.
Jan 14 09:07:57 master systemd[1]: Started The Apache HTTP Server.
4.1、master节点安装ntp服务，注意开机自启和开启服务的是ntpd不是ntp。slaver节点安装的是ntpdate，启动的也是ntpdate服务。
[root@master ~]# yum -y install ntp
删除以下四行
server 0.centos.pool.ntp.org iburst
server 1.centos.pool.ntp.org iburst
server 2.centos.pool.ntp.org iburst
server 3.centos.pool.ntp.org iburst
添加以下两行
server 127.17.1.0
fudge 127.127.1.0 stratum 10
[root@master ~]# systemctl enable ntpd
[root@master ~]# systemctl start ntpd
4.2、slaver节点
[root@slaver yum.repos.d]# yum -y install ntpdate
[root@slaver yum.repos.d]# ntpdate master.hadoop
14 Jan 09:18:00 ntpdate[6262]: step time server 10.0.0.108 offset 13.570844 sec
[root@slaver yum.repos.d]# systemctl enable ntpdate
5、master和slaver节点都配置SSH无密码公钥认证的操作。
[root@master ~]# yum -y install openssh-clients
[root@master ~]# ssh-keygen #一直回车
[root@master ~]# ssh-copy-id slaver.hadoop
[root@slaver ~]# yum -y install openssh-clients
[root@slaver ~]# ssh-keygen
[root@slaver ~]# ssh-copy-id master.hadoop
验证操作是否成功
[root@master ~]# ssh slaver.hadoop
Last login: Tue Jan 14 08:43:08 2020 from 192.168.200.1
#########################Welcome to XianDian
#########################
[root@slaver ~]#
slaver节点
[root@slaver ~]# ssh master.hadoop
Last login: Tue Jan 14 08:43:19 2020 from 192.168.200.1
#########################Welcome to XianDian
#########################
[root@master ~]#
6、禁用Trabsparent Huge Pages，master和slaver节点同样的操作，注意！！重启后会失效，需要重新配置。
master节点
[root@master ~]# cat /sys/kernel/mm/transparent_hugepage/enabled
[always] madvise never
[root@master ~]# echo never > /sys/kernel/mm/transparent_hugepage/enabled
[root@master ~]# echo never > /sys/kernel/mm/transparent_hugepage/defrag
[root@master ~]# cat /sys/kernel/mm/transparent_hugepage/enabled
always madvise [never]
slaver节点
[root@slaver ~]# cat /sys/kernel/mm/transparent_hugepage/enabled
[always] madvise never
[root@slaver ~]# echo never > /sys/kernel/mm/transparent_hugepage/enabled
[root@slaver ~]# echo never > /sys/kernel/mm/transparent_hugepage/defrag
[root@slaver ~]# cat /sys/kernel/mm/transparent_hugepage/enabled
always madvise [never]
7、master和slaver节点都需要安装jdk。
master节点
[root@master opt]# mkdir /usr/jdk64/
[root@master opt]# tar -zxvf jdk-8u77-linux-x64.tar.gz -C /usr/jdk64/
[root@master opt]# vim /etc/profile
[root@master jdk64]# source /etc/profile
[root@master jdk64]# java -version
java version “1.8.0_77”
Java™ SE Runtime Environment (build 1.8.0_77-b03)
Java HotSpot™ 64-Bit Server VM (build 25.77-b03, mixed mode)
把jdk文件在master节点上使用scp命令复制到slaver节点上
[root@master opt]# scp jdk-8u77-linux-x64.tar.gz 192.168.200.105:/media/
jdk-8u77-linux-x64.tar.gz 100% 173MB 43.2MB/s 00:04
slaver节点
[root@slaver ~]# mkdir /usr/jdk64
[root@slaver ~]# cd /media/
[root@slaver media]# tar -zxvf jdk-8u77-linux-x64.tar.gz -C /usr/jdk64/
[root@slaver media]# vim /etc/profile
[root@slaver media]# source /etc/profile
[root@slaver media]# java -version
java version “1.8.0_77”
Java™ SE Runtime Environment (build 1.8.0_77-b03)
Java HotSpot™ 64-Bit Server VM (build 25.77-b03, mixed mode)
8、master节点安装ambari-server。
[root@master ~]# yum -y install ambari-server
9、master节点安装数据库并对数据库进行配置。
[root@master ~]# yum -y install mariadb mariadb-server mysql-connector-java
[root@master ~]# systemctl start mariadb
[root@master ~]# systemctl enable mariadb
[root@master ~]# systemctl status mariadb
mariadb.service - MariaDB database server
Loaded: loaded (/usr/lib/systemd/system/mariadb.service; enabled)
Active: active (running) since Tue 2020-01-14 08:43:13 UTC; 1h 19min ago
Main PID: 957 (mysqld_safe)
CGroup: /system.slice/mariadb.service
├─ 957 /bin/sh /usr/bin/mysqld_safe --basedir=/usr
└─1121 /usr/libexec/mysqld --basedir=/usr --datadir=/var/lib/mysql --plugin-dir=/usr/lib64/mysql/plugin --log-error=/var/log/mar…
Jan 14 08:43:05 master mysqld_safe[957]: 200114 08:43:05 mysqld_safe Logging to ‘/var/log/mariadb/mariadb.log’.
Jan 14 08:43:05 master mysqld_safe[957]: 200114 08:43:05 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql
Jan 14 08:43:13 master systemd[1]: Started MariaDB database server.
9.1、在使用mysql_secure_installation命令之前，需要保证数据库处于正常启动的状态，否则命令会报错，第二数据库的密码必须设置为bigdata，否则后面的ambari-setup会报错。
[root@master ~]# mysql_secure_installation
按enter确认后设置数据库root密码，我们这里设置为“bigdata”
Remove anonymous users? [Y/n] y
Disallow root login remotely? [Y/n] n
Remove test database and access to it? [Y/n] y
Reload privilege tables now? [Y/n] y
9.2、创建ambari数据库
[root@master ~]# mysql -uroot -pbigdata
MariaDB [(none)]> create database ambari; #创建ambari数据库
MariaDB [(none)]>grant all privileges on ambari.* to ambari@‘localhost’ identified by ‘bigdata’; #授权给本地
MariaDB [(none)]>grant all privileges on ambari.* to ambari@’%’ identified by ‘bigdata’; #授权给所有
MariaDB [(none)]>flush privileges; #刷新权限
MariaDB [(none)]>use ambari；
MariaDB [(ambari)]> source /var/lib/ambari-server/resources/Ambari-DDL-MySQL-CREATE.sql #导入文件
MariaDB [(ambari)]> quit
10、master节点安装ambari-server
[root@master ~]# vim /etc/profile
export bulidNumber=2.6.0.0
[root@master ~]# source /etc/profile
[root@master ~]# ambari-server set-up
WARNING: SELinux is set to ‘permissive’ mode and temporarily disabled.
OK to continue [y/n] (y)?
Customize user account for ambari-server daemon [y/n] (n)? n
Checking JDK…
[1] Oracle JDK 1.8 + Java Cryptography Extension (JCE) Policy Files 8
[2] Oracle JDK 1.7 + Java Cryptography Extension (JCE) Policy Files 7
[3] Custom JDK
==============================================================================
Enter choice (1): 3
Path to JAVA_HOME: /usr/jdk64/jdk1.8.0_77 #填写JDK安装的路径
Validating JDK on Ambari Server…done.
Completing setup…
Configuring database…
Enter advanced database configuration [y/n] (n)? y
Configuring database…
====================================================================
Choose one of the following options:
[1] - PostgreSQL (Embedded)
[2] - Oracle
[3] - MySQL
[4] - PostgreSQL
[5] - Microsoft SQL Server (Tech Preview)
[6] - SQL Anywhere
====================================================================
Enter choice (1): 3
Hostname (localhost):
Port (3306):
Database name (ambari):
Username (ambari):
Enter Database Password (bigdata): #这就是数据库密码是bigdata的原因
Proceed with configuring remote database connection properties [y/n] (y)?
Ambari Server ‘setup’ completed successfully
10.1、在setup完成之后，我们需要输入一条命令，使得ambari可以和数据库连接
[root@master ~]# ambari-server setup --jdbc-db=mysql --jdbc-driver=/usr/share/java/mysql-connector-java.jar
Using python /usr/bin/python
Setup ambari-server
Copying /usr/share/java/mysql-connector-java.jar to /var/lib/ambari-server/resources
If you are updating existing jdbc driver jar for mysql with mysql-connector-java.jar. Please remove the old driver jar, from all hosts. Restarting services that need the driver, will automatically copy the new jar to the hosts.
JDBC driver was successfully initialized.
Ambari Server ‘setup’ completed successfully.
11、启动ambari-server服务。
[root@master ~]# ambari-server start
Using python /usr/bin/python
Starting ambari-server
Ambari Server running with administrator privileges.
Organizing resource files at /var/lib/ambari-server/resources…
Ambari database consistency check started…
Server PID at: /var/run/ambari-server/ambari-server.pid
Server out at: /var/log/ambari-server/ambari-server.out
Server log at: /var/log/ambari-server/ambari-server.log
Waiting for server start…
Server started listening on 8080
DB configs consistency check: no errors and warnings were found.
Ambari Server ‘start’ completed successfully.
11.1、这个时候就可以通过网页去访问ambari-server了，登录界面http://192.168.200.131:8080/，用户和密码都为admin
如果在11点上 出现了运行失败的问题 没有提示successfully 先去检查前面的配置是否出现了问题 数据库的授权 如果前面的配置都没有出现问题 我最经常使用的方法是重新setup ambari-server 然后再输入命令去让ambari和mysql连接 最好的方法当然是查看日志了
12、由于我们一会创建集群的时候是手动注册的，所以我们需要在master节点和slaver节点去安装ambari-agent。安装agent后修改文件，master节点的配置文件里面的hostname可以修改也可以不修改，但是slaver节点里面的hostname一定要修改为mater界面的hostname。
[root@master ~]# yum -y install ambari-agent
[root@master ~]# vim /etc/ambari-agent/conf/ambari-agent.ini
[server]
hostname=master.hadoop
slaver节点、
[root@slaver media]# yum -y install ambari-agent
[root@slaver media]# vim /etc/ambari-agent/conf/ambari-agent.ini
[server]
hostname=master.hadoop
图形化界面的内容截图起来太麻烦了 就不写了 下一篇大数据的简单运维题目 冲
