在hadoop安装(解压)目录下
查看的Hadoop的版本: bin/下 hadoop version
java环境
export JAVA_HOME=/opt/user/java/jdk8
export PATH=$PATH:$JAVA_HOME/bin:$HADOOP_HOME/bin
export CLASSPATH=.:$JAVA_HOME/lib/dt.jar:$JAVA_HOME/lib/tools.jar
export HADOOP_HOME=/opt/user/hadoop/hadoop
1.vim $HADOOP_HOME/etc/hadoop/hadoop-env.sh
添加 export JAVA_HOME=/usr/local/software/jdk1.8.0_111
2.vim $HADOOP_HOME/etc/hadoop/core-site.xml
<configuration>
<property>
<name>fs.default.name</name>
<value>hdfs://localhost:9000</value>
</property>
</configuration>
3. vim $HADOOP_HOME/etc/hadoop/hdfs-site.xml
<configuration>
<property>
<name>dfs.replication</name>
<value>1</value>
</property>
</configuration>
4.vim $HADOOP_HOME/etc/hadoop/yarn-site.xml
<configuration>
<property>
<name>yarn.nodemanager.aux-services</name>
<value>mapreduce.shuffle</value>
</property>
</configuration>
第一次启动时要初始化,格式化的NameNode
初始化hadoop,bin/:./hdfs namenode –format
sbin/: ./start-all.sh
[root@localhost hadoop]# cd sbin
[root@localhost sbin]# ./start-all.sh
This script is Deprecated. Instead use start-dfs.sh and start-yarn.sh
Starting namenodes on [localhost]
root@localhost's password:
localhost: starting namenode, logging to /opt/user/hadoop/hadoop/logs/hadoop-root-namenode-localhost.localdomain.out
root@localhost's password:
localhost: starting datanode, logging to /opt/user/hadoop/hadoop/logs/hadoop-root-datanode-localhost.localdomain.out
Starting secondary namenodes [0.0.0.0]
[email protected]'s password:
0.0.0.0: starting secondarynamenode, logging to /opt/user/hadoop/hadoop/logs/hadoop-root-secondarynamenode-localhost.localdomain.out
starting yarn daemons
starting resourcemanager, logging to /opt/user/hadoop/hadoop/logs/yarn-guest-resourcemanager-localhost.localdomain.out
root@localhost's password:
localhost: starting nodemanager, logging to /opt/user/hadoop/hadoop/logs/yarn-root-nodemanager-localhost.localdomain.out
[root@localhost sbin]#
CentOS 7.0默认使用的是firewall作为防火墙
查看防火墙状态
firewall-cmd --state
- 停止firewall
systemctl stop firewalld.service
- 禁止firewall开机启动
systemctl disable firewalld.service
1、HDFS页面:50070
2、YARN的管理界面:8088
3、HistoryServer的管理界面:19888
4、Zookeeper的服务端口号:2181
5、Mysql的服务端口号:3306
6、Hive.server1=10000
7、Kafka的服务端口号:9092
8、azkaban界面:8443
9、Hbase界面:16010,60010
10、Spark的界面:8080
11、Spark的URL:7077