大数据基础学习笔记(安装CDH)

版权声明:本文为博主原创文章,未经博主允许不得转载。 https://blog.csdn.net/madongyu1259892936/article/details/85342078

CM安装
1.安装Cloudera manager server,agent
      mkdir /opt/cloudera-manager
      tar -zxvf cloudera-manager*.tar.gz /opt/cloudera-manager

2.创建用户cloudera-scm
useradd --system --home=/opt/cm-5.14.0/run/cloudera-scm-server/ --no-create-home --shell=/bin/false --comment "Cloudera SCM User" cloudera-scm

useradd --system --no-create-home --shell=/bin/false --comment "Cloudera SCM User" cloudera-scm

3.配置CM Agent
修改/opt/cm-5.14.0/etc/cloudera-scm-agent/config.ini中的server_host为主节点的主机名。
同步Agent到其他节点

4.配置CM Server数据库
首先需要去MySql的官网下载JDBC驱动,http://dev.mysql.com/downloads/connector/j/,解压后,
找到mysql-connector-java-5.1.45-bin.jar,放到/opt/cm-5.14.0/share/cmf/lib/和/usr/share/java中。并改名字mysql-connector-java.jar

设置mysql jar权限
chmod 777 mysql-connector-java.jar

登录mysql执行下面的语句
去看我的《学习hadoop遇到的问题(安装mysql时,密码找不到)》去添加其他ip的访问权限
cd /opt/cloudera-manager/cm-5.14.0/share/cmf/schema/

./scm_prepare_database.sh mysql -node1 -uroot -p123456 --scm-host node1 scm root 123456

格式:数据库类型,数据库,数据库服务器,用户名,密码,cm server服务器

5.创建parcel用户
  server节点
      mkdir -p /opt/cloudera/parcel-repo/
      chown cloudera-scm:cloudera-scm /opt/cloudera/parcel-repo
      mkdir /var/cloudera-scm-server, /var/lib/cloudera-scm-server
      chown cloudera-scm:cloudera-scm /var/cloudera-scm-server
  agent节点
      mkdir -p /opt/cloudera/parcels
      chown cloudera-scm:cloudera-scm /opt/cloudera/parcels

  6.制作CDH本地源
   下载好文件CDH-5.14.0-1.cdh5.14.0.p0.24-el7.parcel,CDH-5.11.1-1.cdh5.11.1.p0.18-el5.parcel.sha1,manifest放到server节点/opt/cloudera/parcel-repo/下
    注意:其中CDH-5.11.1-1.cdh5.11.1.p0.18-el5.parcel.sha1 后缀要把1去掉

7.启动CM server,agent
 cd /opt/cloudera-manager/cm-5.14.0/etc/init.d/
 ./cloudera-scm-server start
 ./cloudera-scm-agent start

也可以参考这个网址https://www.cnblogs.com/henyu/p/9025975.html

猜你喜欢

转载自blog.csdn.net/madongyu1259892936/article/details/85342078