yarn配置
单一节点至多启动一个节点
1.vim yarn-env.sh
export JAVA_HOME=/opt/module/jdk1.8.0_221
2.vim yarn-site.xml
<property>
<name>yarn.nodemanager.aux-services</name>
<value>mapreduce_shuffle</value>
</property>
<property>
<name>yarn.resourcemanager.hostname</name>//指定yarn的resourceManager的地址
<value>hadoop101</value>
</property>
-
vim mapred-env.sh
export JAVA_HOME=/opt/module/jdk1.8.0_221
-
//mapred-site.xml里面是空的,把mapred-site.xml.template文件copy给mapred-site.xml
cp mapred-site.xml.template mapred-site.xml
ll
vim mapred-site.xml
<property>
<name>mapreduce.framework.name</name>//指定MR运行在yarn上
<value>yarn</value>
</property>
5.启动yarn(hadoop-2.7.2目录)
yarn-daemon.sh start resourcemanager
yarn-daemon.sh start nodemanager
jps后出现 NodeManager NameNode DataNode jps ResourceManager
http://hadoop101:8088/cluster
6.在hdfs和Yarn上的MapReduce程序
hadoop fs -put wcinput / #在网页上Utilities中有wcinput
hadoop jar share/hadoop/mapreduce/hadoop-mapreduce-examples-2.7.2.jar wordcount /wcinput /wcoutput
在网页上Utilities中有wcinput、wcoutput、tmp
7.hadoop fs -cat /wcoutput/*
atguigu 2
hadoop 2
mapreduce 1
yarn 1