本文只涉及hadoop集群的安装,安装后初始化及启动脚本后续更新,也会继续完善此篇博文,使其可以安装完成后自动初始化及启动,今天时间紧张,只发了安装的,请大家继续关注,谢谢!
环境:三台虚拟机,server01/server02/server03
mkdir -p /etc/ansible/roles/hadoop/files
#将下载好的hadoop包上传至/etc/ansible/roles/hadoop/files
cd /etc/ansible/roles/hadoop
vim hosts
[hadoop_servers]
server01
server02
server03
vim hadoop.yml
- hosts: all
roles:
- hadoop
mkdir tasks
cd tasks
vim main.yml
---
- name: copy hadoop tar
unarchive: src=hadoop-2.6.0-cdh5.11.0.tar.gz dest=/root
- name: set hadoop env
lineinfile: dest={{env_file}} insertafter="{{item.position}}" line="{{item.value}}" state=present
with_items:
- {position: EOF, value: "\n"}
- {position: EOF, value: "# Hadoop environment"}
- {position: EOF, value: "export HADOOP_HOME=/root/hadoop-2.6.5"}
- {position: EOF, value: "export PATH=$PATH:${HADOOP_HOME}/bin:${HADOOP_HOME}/sbin"}
- name: enforce env
shell: source {{env_file}}
- name: install configuration file hadoop-env.sh for hadoop
template: src=hadoop-env.sh dest=/root/hadoop-2.6.5/etc/hadoop/hadoop-env.sh
- name: install configuration file core-site.xml for hadoop
template: src=core-site.xml dest=/root/hadoop-2.6.5/etc/hadoop/core-site.xml
- name: install configuration file hdfs-site.xml for hadoop
template: src=hdfs-site.xml dest=/root/hadoop-2.6.5/etc/hadoop/hdfs-site.xml
- name: install configuration file mapred-site.xml for hadoop
template: src=mapred-site.xml dest=/root/hadoop-2.6.5/etc/hadoop/mapred-site.xml
- name: install configuration file yarn-site.xml for hadoop
template: src=yarn-site.xml dest=/root/hadoop-2.6.5/etc/hadoop/yarn-site.xml
- name: install configuration file slaves for hadoop
template: src=slaves dest=/root/hadoop-2.6.5/etc/hadoop/slaves
- name: mkdir data
file: name=/root/hadoop-2.6.5/data/ state=directory
- name: mkdir journal
file: name=/root/hadoop-2.6.5/journaldata/ state=directory
cd ..
mkdir templates
cd templates
#将更改好的配置文件上传至此文件夹
core-site.xml hadoop-env.sh hdfs-site.xml mapred-site.xml slaves yarn-site.xml
cd ..
mkdir vars
cd vars
vim main.yml
env_file: /etc/profile
JAVA_HOME: /root/jdk1.8.0_171
ansible-playbook -i hosts hadoop.yml
安装完成!亲测无坑,如果此篇博文对您有一点点的帮助,请您继续关注并可以给一个赞嘛~~~
敬请期待后续更新!!!