linux下安装hadoop

在hadoop安装(解压)目录下

查看的Hadoop的版本: bin/下 hadoop version

java环境

export JAVA_HOME=/opt/user/java/jdk8
export PATH=$PATH:$JAVA_HOME/bin:$HADOOP_HOME/bin
export CLASSPATH=.:$JAVA_HOME/lib/dt.jar:$JAVA_HOME/lib/tools.jar
export HADOOP_HOME=/opt/user/hadoop/hadoop

1.vim $HADOOP_HOME/etc/hadoop/hadoop-env.sh

添加 export JAVA_HOME=/usr/local/software/jdk1.8.0_111

2.vim $HADOOP_HOME/etc/hadoop/core-site.xml

<configuration>
    <property>
        <name>fs.default.name</name>
        <value>hdfs://localhost:9000</value>
    </property>
</configuration>

3. vim  $HADOOP_HOME/etc/hadoop/hdfs-site.xml

<configuration>
    <property>
        <name>dfs.replication</name>
        <value>1</value>
    </property>
</configuration>
4.vim  $HADOOP_HOME/etc/hadoop/yarn-site.xml

<configuration>
    <property>
    <name>yarn.nodemanager.aux-services</name>
    <value>mapreduce.shuffle</value>
    </property>
</configuration>
 

第一次启动时要初始化,格式化的NameNode

初始化hadoop,bin/:./hdfs namenode –format

sbin/: ./start-all.sh

[root@localhost hadoop]# cd sbin
[root@localhost sbin]# ./start-all.sh
This script is Deprecated. Instead use start-dfs.sh and start-yarn.sh
Starting namenodes on [localhost]
root@localhost's password: 
localhost: starting namenode, logging to /opt/user/hadoop/hadoop/logs/hadoop-root-namenode-localhost.localdomain.out
root@localhost's password: 
localhost: starting datanode, logging to /opt/user/hadoop/hadoop/logs/hadoop-root-datanode-localhost.localdomain.out
Starting secondary namenodes [0.0.0.0]
[email protected]'s password: 
0.0.0.0: starting secondarynamenode, logging to /opt/user/hadoop/hadoop/logs/hadoop-root-secondarynamenode-localhost.localdomain.out
starting yarn daemons
starting resourcemanager, logging to /opt/user/hadoop/hadoop/logs/yarn-guest-resourcemanager-localhost.localdomain.out
root@localhost's password: 
localhost: starting nodemanager, logging to /opt/user/hadoop/hadoop/logs/yarn-root-nodemanager-localhost.localdomain.out
[root@localhost sbin]# 

CentOS 7.0默认使用的是firewall作为防火墙

查看防火墙状态

firewall-cmd --state
  • 停止firewall
systemctl stop firewalld.service
  • 禁止firewall开机启动
systemctl disable firewalld.service 

1、HDFS页面:50070

2、YARN的管理界面:8088

3、HistoryServer的管理界面:19888

4、Zookeeper的服务端口号:2181

5、Mysql的服务端口号:3306

6、Hive.server1=10000

7、Kafka的服务端口号:9092

8、azkaban界面:8443

9、Hbase界面:16010,60010

10、Spark的界面:8080

11、Spark的URL:7077

发布了296 篇原创文章 · 获赞 70 · 访问量 55万+

猜你喜欢

转载自blog.csdn.net/feicongcong/article/details/86238873
今日推荐