阿里云虚拟机外网访问yarn 8088 hdfs 50070

1.修改yarn-site.xml 中vlaue ip为0.0.0.0
slaves里仍然为主机名“zs”
hosts里面为内网ip
访问时为外网ip
在这里插入图片描述

<configuration>

    <property>
        <name>yarn.resourcemanager.hostname</name>
        <value>zs</value>
    </property>
    <property>
        <name>yarn.resourcemanager.address</name>
        <value>0.0.0.0:18040</value>
    </property>
    <property>
        <name>yarn.resourcemanager.scheduler.address</name>
        <value>0.0.0.0:18030</value>
    </property>
    <property>
        <name>yarn.resourcemanager.resource-tracker.address</name>
        <value>0.0.0.0:18025</value>
    </property>
    <property>
        <name>yarn.resourcemanager.admin.address</name>
        <value>0.0.0.0:18141</value>
    </property>
    <property>
        <name>yarn.resourcemanager.webapp.address</name>
        <value>0.0.0.0:8088</value>
    </property>
    <property>
        <name>yarn.nodemanager.aux-services</name>
        <value>mapreduce_shuffle</value>
    </property>
    <property>
        <name>yarn.nodemanager.auxservices.mapreduce.shuffle.class</name>
        <value>org.apache.hadoop.mapred.ShuffleHandler</value>
    </property>
    <property>
        <name>yarn.nodemanager.local-dirs</name>
        <value>file:///home/zzh/data/nm</value>
    </property>
        <!-- 新增加的配置 -->
    <property>
        <name>yarn.log.server.url</name>
        <value>http://zs:19888/jobhistory/logs/</value>
    </property>
    <property>
        <name>yarn.log-aggregation-enable</name>
        <value>true</value>
    </property>
    <property>
        <name>yarn.web-proxy.address</name>
        <value>0.0.0.0:20000</value>
    </property>
    <property>
        <name>yarn.log-aggregation.retain-seconds</name>
        <value>-1</value>
    </property>
    <property>
        <name>yarn.nodemanager.remote-app-log-dir</name>
        <value>/logs</value>
    </property>
    <property>
        <name>yarn.nodemanager.pmem-check-enabled</name>
        <value>false</value>
    </property>
    <property>
        <name>yarn.nodemanager.vmem-check-enabled</name>
        <value>false</value>
    </property>
</configuration>


2.放开阿里云端口

在这里插入图片描述

查看java端口

 netstat -tpnl | grep java

在这里插入图片描述

如果修改了还不行建议
.格式化HDFS集群,该操作只进行一次,并且只在主节点上执行(第二次需要把data下文件夹删除):

hdfs namenode -format
发布了14 篇原创文章 · 获赞 1 · 访问量 2248

猜你喜欢

转载自blog.csdn.net/weixin_42458562/article/details/104853146