Hadoop2.7安装环境准备

一、设置主机名

vim /etc/sysconfig/network

重启网络service network restart

二、配置host

vim /etc/hosts

三、关闭防火墙

关闭:chkconfig iptables off

验证:chkconfig --list | grepiptables

四、SSH免密码登录

机器有5台:s100,s101,s102,s103,s104

s100为主节点,s101,s102,s103,s104为从节点,s100可以访问其他节点,其他节点不可以访问s100;

1、各节点

删除之前生成的秘钥

rm -rf ~/.ssh/

生成秘钥

ssh-keygen -t rsa

本机将公钥复制自己,自己可以访问自己

cat ~/.ssh/id_rsa.pub >> ~/.ssh/authorized_keys

rm -rf ~/.ssh/

ssh-keygen -t rsa

cat ~/.ssh/id_rsa.pub >> ~/.ssh/authorized_keys

 

2、s100节点

 ssh-copy-id -i~/.ssh/id_rsa.pub root@s101

 ssh-copy-id -i~/.ssh/id_rsa.pub root@s102

 ssh-copy-id -i~/.ssh/id_rsa.pub root@s103

 ssh-copy-id -i~/.ssh/id_rsa.pub root@s104

 

五、安装jdk

 

六、xsync

循环复制文件到所有节点的相同目录下

rsync -rvl 被复制的文件 远端用户名@机器名:路径

rsync -rvl /root/Download/data/hello.txtroot@yla131:/home/root/Download/data

创建/usr/local/bin/xsync,并授予执行权限chmod a+x xsync

 

#!/bin/sh

pcount=$#

if(( pcount<1 )); then

     echo no args;

     exit;

fi

 

#获取名称

p1=$1;

fname=`basename $p1`;

echo fname=$fname;

 

#获取上级目录的绝对路径

pdir=`cd -P $(dirname $p1) ; pwd`

echo pdir=$pdir ;

 

#获取当前用户

cuser=`whoami`

echo cuser=$cuser

 

#循环

for((host=101;host<105;host=host+1)) ; do

   echo ------------------ s$host ----------------------

   rsync -rvl $pdir/$fname $cuser@s$host:$pdir

done

 

 

 

八、xcall

创建/usr/local/bin/xcall,并授予执行权限chmod a+x xcall

 

#!/bin/sh

pcount=$#

if(( pcount<1 )); then

     echo no args;

     exit;

fi

 

#循环

------------------ s$host ----------------------

$@

 

for((host=101;host<105;host=host+1)) ; do

   echo ------------------ s$host ----------------------

   ssh s$host $@

done

 

 

xcall cat /etc/environment

 

 

此时xcall jps有问题,需要vim  /etc/environment,

添加PATH="/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/usr/java/jdk/bin",

然后在s100分发xsync /etc/environment,

然后重启各节点。

注意:/usr/java/jdk/bin,jdk的路径不要弄错,记得软连接ln -s jdk路径 别名,xcall ln -s /usr/java/jdk1.7.0_80/ /usr/java/jdk


猜你喜欢

转载自blog.csdn.net/luxiangzhou/article/details/79649379
今日推荐