SLES12 SP3 offline install Cloudera Manager
SLES12 SP3 离线安装ClouderaManager
Author:Duan Yu 段誉
Mail:[email protected] [email protected]
System and software
System 系统: SLES12 SP3
Software 软件:
1. CDH-5.14.2-1.cdh5.14.2.p0.3-sles12.parcel.sha1
2. CDH-5.14.2-1.cdh5.14.2.p0.3-sles12.parcel
3. cloudera-manager-sles12-cm5.14.2_x86_64.tar.gz
5. mariadb-10.3.7-sles12 or postgresql96(sles12sp3 iso include)
6. mysql-connector-java-5.1.46
download software url 下载地址：
1. http://archive.cloudera.com/cdh5/parcels/
2. http://archive.cloudera.com/cdh5/parcels/
3. http://archive.cloudera.com/cm5/cm/5/
4. http://www.oracle.com/technetwork/java/javase/downloads/jdk8-downloads-2133151.html
5. https://www.seliy.com/mariadb-10.3.7-sles-12-x86_64-rpms.tar
6. https://cdn.mysql.com//Downloads/Connector-J/mysql-connector-java-5.1.46.tar.gz
start 开始
1. 192.168.0.170 hbase-master
2. 192.168.0.171 hbase-regionServer1
3. 192.168.0.173 hbase-regionServer2
4. 192.168.0.178 hbase-zookeeper1
5. 192.168.0.179 hbase-zookeeper2
6. 192.168.0.180 hbase-zookeeper3
7. 192.168.0.200 hadoop-monitor
operation all host 操作所有主机
#vim /etc/HOSTNAME
hostname 主机名
#vim /etc/hosts
192.168.0.170 hbase-master
192.168.0.171 hbase-regionServer1
192.168.0.173 hbase-regionServer2
192.168.0.178 hbase-zookeeper1
192.168.0.179 hbase-zookeeper2
192.168.0.180 hbase-zookeeper3
192.168.0.200 hadoop-monito
#ssh-keygen
#for i in {170,171,173,178,179,180,200};dossh-copy-id 192.168.0.$i;done
# for i in {170,171,173,178,179,180,200};doscp /etc/hosts 192.168.0.$i:/etc/;done
#rpm –ivh /home/poka/tar/jdk-8u161-linux-x64.rpm
#vim /etc/profile
export JAVA_HOME=/usr/java/jdk1.8.0_161
export PATH=$JAVA_HOME/bin:$PATH
exportCLASSPATH=.:$JAVA_HOME/lib/dt.jar:$JAVA_HOME/lib/tools.jar
#tar zxvf /home/poka/tar/cloudera-manager-sles12-cm5.14.2_x86_64.tar.gz–C /opt/
other host 其他主机
#vim /opt/cm-5.14.2/etc/cloudera-scm-agent/config.ini
server_host=hadoop-monitor server_host= “clouder Manager serverhostname”
hadoop-monitor operation host haoop-monitor 操作
#useradd --system --home=/opt/cm-5.15.0/run/cloudera-scm-server --shell=/bin/false --comment "ClouderaSCM User" cloudera-scm
#groupadd cloudera-scm
Choose Databae 选择数据库
mairadb
#tar xvf /home/poka/tar/mariadb-10.3.7-sles-12-x86_64-rpms.tar
#/home/poka/tar/mariadb-10.3.7-sles-12-x86_64-rpms/setup_repository
#zypper install -y MariaDB-server
#sudo /usr/bin/mysql_secure_installation
Follow the prompts to operate 根据提示进行操作
#vim /etc/my.cnf.d/server.cnf add 添加
key_buffer= 16M
key_buffer_size = 32M
max_allowed_packet = 32M
thread_stack = 256K
thread_cache_size = 64
query_cache_limit = 8M
query_cache_size = 64M
query_cache_type = 1
max_connections = 550
read_buffer_size = 2M
read_rnd_buffer_size = 16M
sort_buffer_size = 8M
join_buffer_size = 8M
server_id=1
binlog_format = mixed
innodb_file_per_table = 1
innodb_flush_log_at_trx_commit = 2
innodb_log_buffer_size = 64M
innodb_buffer_pool_size = 4G
innodb_thread_concurrency = 8
innodb_flush_method = O_DIRECT
innodb_log_file_size = 512M
#service mysql start
#mysql –uroot –p
MariaDB [(none)]> CREATE DATABASE scmDEFAULT CHARACTER SET utf8 DEFAULT COLLATE utf8_general_ci;
CREATE DATABASE amon DEFAULT CHARACTER SETutf8 DEFAULT COLLATE utf8_general_ci;
CREATE DATABASE rman DEFAULT CHARACTER SETutf8 DEFAULT COLLATE utf8_general_ci;
CREATE DATABASE hue DEFAULT CHARACTER SETutf8 DEFAULT COLLATE utf8_general_ci;
CREATE DATABASE metastore DEFAULT CHARACTERSET utf8 DEFAULT COLLATE utf8_general_ci;
CREATE DATABASE sentry DEFAULT CHARACTERSET utf8 DEFAULT COLLATE utf8_general_ci;
CREATE DATABASE nav DEFAULT CHARACTER SETutf8 DEFAULT COLLATE utf8_general_ci;
CREATE DATABASE navms DEFAULT CHARACTER SETutf8 DEFAULT COLLATE utf8_general_ci;
CREATE DATABASE oozie DEFAULT CHARACTER SETutf8 DEFAULT COLLATE utf8_general_ci;
MariaDB [(none)]> GRANT ALL ON *.* TOmonitor@'localhost' IDENTIFIED BY 'monitor';
postgresql96
#sudo zypper install --no-recommendspostgresql96-server
#sudo su -l postgres -c "initdb--pgdata=/var/lib/pgsql/data --encoding=UTF-8"
#
Clouder Manager
#mv/home/poka/tar/mysql-connector-java-5.1.38.jar /opt/cm-5.14.2/share/cmf/lib/
#mv /home/poka/tar/CDH-5.14.2-1.cdh5.14.2.p0.3-sles12.parcel/opt/cloudera/parcel-repo/
#mv /home/poka/tar/CDH-5.14.2-1.cdh5.14.2.p0.3-sles12.parcel.sha1/opt/cloudera/parcel-repo/CDH-5.14.2-1.cdh5.14.2.p0.3-sles12.parcel.sha
# /opt/cm-5.14.2/share/cmf/schema/scm_prepare_database.shmysql scm monitor
Enter SCM password: monitor
When you see this log entry,success
当您看到此信息条目时脚本运行成功
INFO Successfully connectedto database.
All done, your SCM database is configured correctly!
# /opt/cm-5.14.2/etc/init.d/cloudera-scm-serverstart
#tail –f /opt/cm-5.14.2/log/cloudera-scm-server/cloudera-scm-server.log
When you see this log entry, the Cloudera ManagerAdmin Console is ready:
当您看到此日志条目时，Cloudera Manager管理控制台已准备就绪
INFO WebServerImpl:com.cloudera.server.cmf.WebServerImpl:Started Jetty server.
http://hadoop-monitor/:7180or http://192.168.0.200:7180
Congratulations on your completion
祝贺你完成
Solve the errors 解决错误方式
submit your problem
提交你的问题
Reference materials 参考资料
https://www.cloudera.com/documentation/enterprise/latest/topics/installation.html
other system 其他操作系统
CDH and Clouder Manager download thedifferent，Other things are pretty much the same
除CDH和CLouder Manager下载文件不一样，操作流程基本一致
