cm cdh5 hadoop安装

今日按照官方文档,装了一下cdh5 hadoop ,分享一下经验及用到的命令

cm 官方中文版地址
http://www.cloudera.com/content/www/zh-CN/documentation/enterprise/5-3-x/topics/search_solrctl_ref.html
cdh 安装包
http://archive-primary.cloudera.com/cdh5/parcels/5.9.0.23/v
cm 安装步骤
http://www.cloudera.com/documentation/enterprise/latest/topics/cm_ig_install_path_c.html#concept_fbv_2v3_3r__section_gkr_z31_v5
http://blog.csdn.net/u010824591/article/details/51174099

cm tar 下载
http://archive-primary.cloudera.com/cm5/cm/5/
pdsh
mysql 配置中文
http://www.cloudera.com/content/www/zh-CN/documentation/enterprise/5-3-x/topics/cm_ig_mysql.html

赋予用户权限及建数据库
grant all PRIVILEGES on . to ‘root’@’localhost’ IDENTIFIED BY ‘admin’ with grant option ;
grant all PRIVILEGES on . to ‘root’@’%’ IDENTIFIED BY ‘admin’ with grant option ;
create database amon DEFAULT CHARSET utf8 COLLATE utf8_general_ci;
create database rman DEFAULT CHARSET utf8 COLLATE utf8_general_ci;
create database metastore DEFAULT CHARSET utf8 COLLATE utf8_general_ci;
create database sentry DEFAULT CHARSET utf8 COLLATE utf8_general_ci;
create database nav DEFAULT CHARSET utf8 COLLATE utf8_general_ci;
create database hue DEFAULT CHARSET utf8 COLLATE utf8_general_ci;
create database oozie DEFAULT CHARSET utf8 COLLATE utf8_general_ci;
grant all PRIVILEGES on . to ‘scm’@’localhost’ IDENTIFIED BY ‘scm_abc’ with grant option ;
grant all PRIVILEGES on . to ‘scm’@’%’ IDENTIFIED BY ‘scm_abc’ with grant option ;
grant all PRIVILEGES on . to ‘amon’@’localhost’ IDENTIFIED BY ‘amon_abc’ with grant option ;
grant all PRIVILEGES on . to ‘amon’@’%’ IDENTIFIED BY ‘amon_abc’ with grant option ;
grant all PRIVILEGES on . to ‘rman’@’localhost’ IDENTIFIED BY ‘rman_abc’ with grant option ;
grant all PRIVILEGES on . to ‘rman’@’%’ IDENTIFIED BY ‘rman_abc’ with grant option ;
grant all PRIVILEGES on . to ‘hive’@’localhost’ IDENTIFIED BY ‘hive_abc’ with grant option ;
grant all PRIVILEGES on . to ‘hive’@’%’ IDENTIFIED BY ‘hive_abc’ with grant option ;
grant all PRIVILEGES on . to ‘sentry’@’localhost’ IDENTIFIED BY ‘sentry_abc’ with grant option ;
grant all PRIVILEGES on . to ‘sentry’@’%’ IDENTIFIED BY ‘sentry_abc’ with grant option ;
grant all PRIVILEGES on . to ‘nav’@’localhost’ IDENTIFIED BY ‘nav_abc’ with grant option ;
grant all PRIVILEGES on . to ‘nav’@’%’ IDENTIFIED BY ‘nav_abc’ with grant option ;
grant all PRIVILEGES on . to ‘hue’@’localhost’ IDENTIFIED BY ‘hue_abc’ with grant option ;
grant all PRIVILEGES on . to ‘hue’@’%’ IDENTIFIED BY ‘hue_abc’ with grant option ;
grant all PRIVILEGES on . to ‘oozie’@’localhost’ IDENTIFIED BY ‘oozie_abc’ with grant option ;
grant all PRIVILEGES on . to ‘oozie’@’%’ IDENTIFIED BY ‘oozie_abc’ with grant option ;

mysql> flush privileges;

创建文件目录 ,更改权限
mkdir -p /var/log/cloudera-scm-agent
mkdir -p /var/log/cloudera-scm-alertpublisher
mkdir -p /var/log/cloudera-scm-eventserver
mkdir -p /var/log/cloudera-scm-firehose
mkdir -p /var/log/cloudera-scm-headlamp
mkdir -p /var/log/cloudera-scm-server
mkdir -p /var/lib/cloudera-scm-agent
mkdir -p /var/lib/cloudera-scm-alertpublisher
mkdir -p /var/lib/cloudera-scm-eventserver
mkdir -p /var/lib/cloudera-scm-firehose
mkdir -p /var/lib/cloudera-scm-headlamp
mkdir -p /var/lib/cloudera-scm-server
mkdir -p /var/lib/cloudera-host-monitor
mkdir -p /var/lib/cloudera-service-monitor
chown -R cloudera-scm:cloudera-scm /var/log/cloudera-scm-agent
chown -R cloudera-scm:cloudera-scm /var/log/cloudera-scm-alertpublisher
chown -R cloudera-scm:cloudera-scm /var/log/cloudera-scm-eventserver
chown -R cloudera-scm:cloudera-scm /var/log/cloudera-scm-firehose
chown -R cloudera-scm:cloudera-scm /var/log/cloudera-scm-headlamp
chown -R cloudera-scm:cloudera-scm /var/log/cloudera-scm-server
chown -R cloudera-scm:cloudera-scm /var/lib/cloudera-scm-agent
chown -R cloudera-scm:cloudera-scm /var/lib/cloudera-scm-alertpublisher
chown -R cloudera-scm:cloudera-scm /var/lib/cloudera-scm-eventserver
chown -R cloudera-scm:cloudera-scm /var/lib/cloudera-scm-firehose
chown -R cloudera-scm:cloudera-scm /var/lib/cloudera-scm-headlamp
chown -R cloudera-scm:cloudera-scm /var/lib/cloudera-scm-server
chown -R cloudera-scm:cloudera-scm /var/lib/cloudera-host-monitor
chown -R cloudera-scm:cloudera-scm /var/lib/cloudera-service-monitor

设置自动启动
CM5服务器端:
cp /opt/cloudera-manager/cm-5.0/etc/init.d/cloudera-scm-server /etc/init.d/cloudera-scm-server
chkconfig cloudera-scm-server on
CM5客户端:
pdsh -R ssh -w root@hadoop00[7-9]
pdsh> cp /opt/cloudera-manager/cm-5.0/etc/init.d/cloudera-scm-agent /etc/init.d/cloudera-scm-agent
pdsh> chkconfig cloudera-scm-agent on

服务端:
service cloudera-scm-server start
客户端:
pdsh可以批量执行命令,使用pdsh->
pdsh -R ssh -w root@hadoop00[7-9]
pdsh-> service cloudera-scm-agent start
http://doc.okbase.net/1421929/archive/161829.html

Guess you like

Origin blog.csdn.net/qq_27474277/article/details/74910301