Ali cloud virtual machine outside the network access yarn 8088 hdfs 50070

1. Modify the yarn-site.xml in vlaue ip is 0.0.0.0
slaves there still is the host name "ZS"
hosts within the network ip inside
when access to the external network ip
Here Insert Picture Description

<configuration>

    <property>
        <name>yarn.resourcemanager.hostname</name>
        <value>zs</value>
    </property>
    <property>
        <name>yarn.resourcemanager.address</name>
        <value>0.0.0.0:18040</value>
    </property>
    <property>
        <name>yarn.resourcemanager.scheduler.address</name>
        <value>0.0.0.0:18030</value>
    </property>
    <property>
        <name>yarn.resourcemanager.resource-tracker.address</name>
        <value>0.0.0.0:18025</value>
    </property>
    <property>
        <name>yarn.resourcemanager.admin.address</name>
        <value>0.0.0.0:18141</value>
    </property>
    <property>
        <name>yarn.resourcemanager.webapp.address</name>
        <value>0.0.0.0:8088</value>
    </property>
    <property>
        <name>yarn.nodemanager.aux-services</name>
        <value>mapreduce_shuffle</value>
    </property>
    <property>
        <name>yarn.nodemanager.auxservices.mapreduce.shuffle.class</name>
        <value>org.apache.hadoop.mapred.ShuffleHandler</value>
    </property>
    <property>
        <name>yarn.nodemanager.local-dirs</name>
        <value>file:///home/zzh/data/nm</value>
    </property>
        <!-- 新增加的配置 -->
    <property>
        <name>yarn.log.server.url</name>
        <value>http://zs:19888/jobhistory/logs/</value>
    </property>
    <property>
        <name>yarn.log-aggregation-enable</name>
        <value>true</value>
    </property>
    <property>
        <name>yarn.web-proxy.address</name>
        <value>0.0.0.0:20000</value>
    </property>
    <property>
        <name>yarn.log-aggregation.retain-seconds</name>
        <value>-1</value>
    </property>
    <property>
        <name>yarn.nodemanager.remote-app-log-dir</name>
        <value>/logs</value>
    </property>
    <property>
        <name>yarn.nodemanager.pmem-check-enabled</name>
        <value>false</value>
    </property>
    <property>
        <name>yarn.nodemanager.vmem-check-enabled</name>
        <value>false</value>
    </property>
</configuration>


2. Release the cloud Ali port

Here Insert Picture Description

View java port

 netstat -tpnl | grep java

Here Insert Picture Description

If you modify the recommendation is not enough
to format HDFS cluster, the operation is performed only once, and only execution (second need to delete the data folder) on the primary node:

hdfs namenode -format
Published 14 original articles · won praise 1 · views 2248

Guess you like

Origin blog.csdn.net/weixin_42458562/article/details/104853146