服务器
主机名 |
master |
slave1 |
slave2 |
slave3 |
IP |
192.168.1.40 |
192.168.1.41 |
192.168.1.42 |
192.168.1.43 |
离线包服务器： 192.168.1.50
-------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------------------------------------------------------------------------------
1.启用root账号
1)sudo passwd root
2)sudo vi /etc/ssh/sshd_config
PermitRootLogin yes
RSAAuthentication yes
PubkeyAuthentication yes
AuthorizedKeysFile %h/.ssh/authorized_keys
3)sudo service sshd restart
4)SSH免密码
所有服务器
su - root
cd ~/.ssh/
cat id_rsa.pub >> authorized_keys
master服务器
scp [email protected]:/root/.ssh/authorized_keys /root/.ssh/authorized_keys_slave1
scp [email protected]:/root/.ssh/authorized_keys /root/.ssh/authorized_keys_slave2
scp [email protected]:/root/.ssh/authorized_keys /root/.ssh/authorized_keys_slave3
cat authorized_keys_slave1 >> authorized_keys
cat authorized_keys_slave2 >> authorized_keys
cat authorized_keys_slave3 >> authorized_keys
其它服务器
scp [email protected]:/root/.ssh/authorized_keys /root/.sshauthorized_keys
5）设置文件句柄与线程限制
vi /etc/security/limits.conf
* soft nofile 204800
* hard nofile 204800
* soft nproc 204800
* hard nproc 204800
2.创建如下的几个文件放到所有服务器上
hdp.list
#VERSION_NUMBER=2.6.4.0-91
deb http://192.168.1.50/ubuntu/HDP/ubuntu16/2.6.4.0-91 HDP main
hdp.utils.list
#VERSION_NUMBER=1.1.0.22-91
deb http://192.168.1.50/ubuntu/HDP-UTILS/ HDP-UTILS main
hdp.gpl.list
#VERSION_NUMBER=2.6.4.0-91
deb http://192.168.1.50/ubuntu/HDP-GPL/ubuntu16/2.6.4.0-91 HDP-GPL main
ambari.list
#VERSION_NUMBER=2.6.1.5-3
deb http://192.168.1.50/ubuntu/ambari/ubuntu16/2.6.1.5-3 Ambari main
sudo scp zyx@master:/etc/apt/sources.list.d/hdp.list /etc/apt/sources.list.d/hdp.list
sudo scp zyx@master:/etc/apt/sources.list.d/hdp.utils.list /etc/apt/sources.list.d/hdp.utils.list
sudo scp zyx@master:/etc/apt/sources.list.d/hdp.gpl.list /etc/apt/sources.list.d/hdp.gpl.list
sudo scp zyx@master:/etc/apt/sources.list.d/ambari.list /etc/apt/sources.list.d/ambari.list
sudo apt-key adv --recv-keys --keyserver keyserver.ubuntu.com B9733A7A07513CAD
sudo apt-get update
3.安装其它JAR(jce_policy-8.zip和mysql-connector-java.jar)
1）
unzip -o -j -q jce_policy-8.zip -d /usr/lib/jvm/jdk1.8.0_171/jre/lib/security
scp -r zyx@master:/usr/lib/jvm/jdk1.8.0_171/jre/lib/security /usr/lib/jvm/jdk1.8.0_171/jre/lib/
2）将mysql-connector-java.jar放到/usr/share/java/目录下
4.安装如下的Python组件
sudo apt-get install libffi-dev
sudo apt-get install python-pip
sudo apt-get install python-pip
pip install ndg-httpsclient
pip install pyopenssl
pip install pyasn1
sudo pip install -U requests[security]
5.安装ambari-server
sudo apt-get install ambari-server
sudo ambari-server setup --jdbc-db=mysql --jdbc-driver=/usr/share/java/mysql-connector-java.jar
/var/lib/ambari-server/resources/Ambari-DDL-MySQL-CREATE.sql
sudo ambari-server setup --java-home=/usr/lib/jvm/jdk1.8.0_171
6.取消加密方式限制
vi /etc/ambari-server/conf/ambari.properties
security.server.disabled.ciphers=
7.启动服务
ambari-server start
ambari-server stop
ambari-server status
http://192.168.1.50/ubuntu/HDP/ubuntu16/2.6.4.0-91/
http://192.168.1.50/ubuntu/HDP-GPL/ubuntu16/2.6.4.0-91/
http://192.168.1.50/ubuntu/HDP-UTILS/
Admin Name : admin
Cluster Name : smartmap
Total Hosts : 4 (4 new)
Repositories:
ubuntu16 (HDP-2.6):
http://192.168.1.50/ubuntu/HDP/ubuntu16/2.6.4.0-91/
ubuntu16 (HDP-UTILS-1.1.0.22):
http://192.168.1.50/ubuntu/HDP-UTILS/
Services:
HDFS
DataNode : 3 hosts
NameNode : master
NFSGateway : 0 host
SNameNode : slave1
YARN + MapReduce2
App Timeline Server : slave1
NodeManager : 3 hosts
ResourceManager : master
Tez
Clients : 1 host
Hive
Metastore : master
HiveServer2 : master
WebHCat Server : master
Database : Existing MySQL / MariaDB Database
HBase
Master : master
RegionServer : 3 hosts
Phoenix Query Server : 1 host
Pig
Clients : 1 host
Sqoop
Clients : 1 host
ZooKeeper
Server : slave1
Storm
DRPC Server : master
Nimbus : slave1
UI Server : master
Supervisor : 1 host
Flume
Flume : 1 host
Ambari Infra
Infra Solr Instance : master
Ambari Metrics
Metrics Collector : slave2
Grafana : master
Kafka
Broker : master
SmartSense
Activity Analyzer : master
Activity Explorer : master
HST Server : master
Spark2
Livy for Spark2 Server : 1 host
History Server : master
Thrift Server : 1 host
Slider
Clients : 1 host