hadoop+hive+mysql 环境搭建

hadoop和hive公司内有rpm包,安装很方便,MySQL安装也不麻烦

hadoop安装
http://wiki.aliyun-inc.com/projects/apsara/wiki/yunti1sqa/users
1、在线安装rpm包,也可下载rpm包本地安装
sudo yum install -y yunti-hadoop

2、修改hosts,jb和namenode地址
机器的/etc/hosts里追加hdpsqann和hdpsqajt的解析。如果没有权限,请联系机器的PE
10.97.180.201   hdpsqann
10.97.180.202   hdpsqajt

3、配置环境变量
环境变量配置,在${HOME}/.bashrc里追加如下配置
export JAVA_HOME="/home/yunti/java-current/"
export HADOOP_HOME="/home/yunti/hadoop-current/"
export HADOOP_CONF_DIR="${HOME}/hadoop-conf"
export PATH=${PATH}:${JAVA_HOME}/bin:${HADOOP_HOME}/bin

最后让配置生效
source ${HOME}/.bashrc
4、在${HOME}/hadoop-conf下创建hadoop-site.xml配置文件
具体需要配置jobtracker和namenode地址,用户名和密码

hive安装
http://baike.corp.taobao.com/index.php/Hive_%E5%AE%89%E8%A3%85%E9%83%A8%E7%BD%B2
过程基本类似


mysql安装
1. 安装mysql
    1.1 执行安装
          $sudo yum -y install mysql-server
    1.2 注意
          mysql和mysql-server有区别,只需作为client,执行yum install mysql.
 
2. 服务和配置
    2.1 开机启动
          $ sudo /sbin/chkconfig --add mysqld
          $ sudo /sbin/chkconfig mysqld on   
          $ sudo /sbin/service mysqld start
    2.2 设置root密码
          $sudo mysqladmin -u root password 'crm2data'
 
3. 连接mysql
    $mysql -h localhost -uroot -p x
x

猜你喜欢

转载自songpo-ath-taobao-com.iteye.com/blog/1997687