[Yarn] job log view

One, shell command view

#The user must be consistent with the user who submitted the task

yarn application -list -appStates ALL

yarn logs -applicationId application_1605576784861_0041

Two, web UI view

yarn-site.xml add properties

<property>
    <name>yarn.log-aggregation-enable</name>
    <value>true</value>
</property>
<!-- resourceManager  保存最大的任务完成个数 -->
<property>
        <name>yarn.resourcemanager.max-completed-applications</name>
        <value>1000</value>
</property>
<property>
        <name>yarn.log.server.url</name>
        <value>http://agent:19888/jobhistory/logs</value>
</property>

Restart yarn

stop-yarn.sh

start-yarn.sh

Open jobhistory

mr-jobhistory-daemon.sh start historyserver

View log

Go to the yarn web page IP: 8088

 Em...Look at a failed mission