docker搭建hadoop集群

镜像包内容：

1、安装包下载：
hadoop下载链接
hbase下载链接
2、制作Dockerfile，
Dockerfile文件内容：

FROM centos:8
#环境配置
RUN yum install -y openssh openssh-clients openssh-server which net-tools
RUN ssh-keygen -t rsa -P '' -f ~/.ssh/id_rsa && cat ~/.ssh/id_rsa.pub >> ~/.ssh/authorized_keys && chmod 0600 ~/.ssh/authorized_keys
RUN yum install -y java-1.8.0-openjdk-devel

#安装Hadoop
COPY ./hadoop-3.2.1.tar.gz /tmp/tar/hadoop-3.2.1.tar.gz
RUN cd /tmp/tar/ && tar -zxf hadoop-3.2.1.tar.gz -C /opt && rm -f hadoop-3.2.1.tar.gz
COPY ./.bashrc /root/.bashrc
COPY ./core-site.xml /opt/hadoop-3.2.1/etc/hadoop/core-site.xml
COPY ./hdfs-site.xml /opt/hadoop-3.2.1/etc/hadoop/hdfs-site.xml
COPY ./mapred-site.xml /opt/hadoop-3.2.1/etc/hadoop/mapred-site.xml
COPY ./yarn-site.xml /opt/hadoop-3.2.1/etc/hadoop/yarn-site.xml

#安装HBase
COPY ./hbase-2.3.1-bin.tar.gz /tmp/tar/hbase-2.3.1-bin.tar.gz
RUN cd /tmp/tar/ && tar -zxf hbase-2.3.1-bin.tar.gz -C /opt && rm -f hbase-2.3.1-bin.tar.gz
COPY ./hbase-env.sh /opt/hbase-2.3.1/conf/hbase-env.sh

#安装PostgreSQL
RUN yum install -y @postgresql:12

WORKDIR /opt

.bashrc文件内容：

# .bashrc

# User specific aliases and functions

alias rm='rm -i'
alias cp='cp -i'
alias mv='mv -i'

# Source global definitions
if [ -f /etc/bashrc ]; then
	. /etc/bashrc
fi
export JAVA_HOME=/usr/lib/jvm/java-1.8.0-openjdk/jre
export JRE_HOME=${JAVA_HOME}
export CLASSPAT=.:${JAVA_HOME}/lib:${JRE_HOME}/lib
export PATH=${JAVA_HOME}/bin:$PATH
export HDFS_NAMENODE_USER=root
export HDFS_SECONDARYNAMENODE_USER=root
export HDFS_DATANODE_USER=root
export YARN_RESOURCEMANAGER_USER=root
export YARN_NODEMANAGER_USER=root

entrypoint.sh文件内容：

#!/bin/bash
systemctl start sshd
tail -f /dev/null

hbase-env.sh文件内容：

#!/usr/bin/env bash
#修改了jre环境变量
export JAVA_HOME=/usr/lib/jvm/java-1.8.0-openjdk/jre

2、创建镜像：docker build -t hadoop .
3、查看镜像：docker images

4、docker镜像导出，tar镜像包可以拷贝到其他机器docker环境中加载：docker save hadoop -o hadoop.tar
5、将tar镜像包（hadoop.tar）拷贝到需要安装的服务器/容器上，然后：docker load -i hadoop.tar

6、运行镜像：docker run -itd --privileged --name hadoop -p 9000:9000 hadoop /usr/sbin/init
7、创建完成后: 使用以下命令进入容器
docker exec -it hadoop bash
安装完成！