使用Ansible安装hadoop

本文只涉及hadoop集群的安装,安装后初始化及启动脚本后续更新,也会继续完善此篇博文,使其可以安装完成后自动初始化及启动,今天时间紧张,只发了安装的,请大家继续关注,谢谢!

环境:三台虚拟机,server01/server02/server03

mkdir -p /etc/ansible/roles/hadoop/files

#将下载好的hadoop包上传至/etc/ansible/roles/hadoop/files

cd /etc/ansible/roles/hadoop

vim hosts

[hadoop_servers]

server01

server02

server03

vim hadoop.yml

- hosts: all

roles:

- hadoop

mkdir tasks

cd tasks

vim main.yml

---

- name: copy hadoop tar

unarchive: src=hadoop-2.6.0-cdh5.11.0.tar.gz dest=/root

- name: set hadoop env

lineinfile: dest={{env_file}} insertafter="{{item.position}}" line="{{item.value}}" state=present

with_items:

- {position: EOF, value: "\n"}

- {position: EOF, value: "# Hadoop environment"}

- {position: EOF, value: "export HADOOP_HOME=/root/hadoop-2.6.5"}

- {position: EOF, value: "export PATH=$PATH:${HADOOP_HOME}/bin:${HADOOP_HOME}/sbin"}

- name: enforce env

shell: source {{env_file}}

- name: install configuration file hadoop-env.sh for hadoop

template: src=hadoop-env.sh dest=/root/hadoop-2.6.5/etc/hadoop/hadoop-env.sh

- name: install configuration file core-site.xml for hadoop

template: src=core-site.xml dest=/root/hadoop-2.6.5/etc/hadoop/core-site.xml

- name: install configuration file hdfs-site.xml for hadoop

template: src=hdfs-site.xml dest=/root/hadoop-2.6.5/etc/hadoop/hdfs-site.xml

- name: install configuration file mapred-site.xml for hadoop

template: src=mapred-site.xml dest=/root/hadoop-2.6.5/etc/hadoop/mapred-site.xml

- name: install configuration file yarn-site.xml for hadoop

template: src=yarn-site.xml dest=/root/hadoop-2.6.5/etc/hadoop/yarn-site.xml

- name: install configuration file slaves for hadoop

template: src=slaves dest=/root/hadoop-2.6.5/etc/hadoop/slaves

- name: mkdir data

file: name=/root/hadoop-2.6.5/data/ state=directory

- name: mkdir journal

file: name=/root/hadoop-2.6.5/journaldata/ state=directory

cd ..

mkdir templates

cd templates

#将更改好的配置文件上传至此文件夹

core-site.xml hadoop-env.sh hdfs-site.xml mapred-site.xml slaves yarn-site.xml

cd ..

mkdir vars

cd vars

vim main.yml

env_file: /etc/profile

JAVA_HOME: /root/jdk1.8.0_171

ansible-playbook -i hosts hadoop.yml

安装完成!亲测无坑,如果此篇博文对您有一点点的帮助,请您继续关注并可以给一个赞嘛~~~

敬请期待后续更新!!!

发布了21 篇原创文章 · 获赞 5 · 访问量 407

猜你喜欢

转载自blog.csdn.net/weixin_41762839/article/details/105001867