HDFS two ways to view the log: HDFS installation directory logs and on the HDFS WEB UI
HDFS seen the installation logs in the log directory
We were in the master, slave1 and installed on HDFS slave2, but each role installed on the machine just not the same.
Is installed in the master and NameNode SecondaryNameNode, corresponding log is:
This is the ## corresponding log NameNode /home/hadoop-twq/bigdata/hadoop-2.7.5/logs/hadoop-hadoop-twq-namenode-master.log ## corresponding to this log is SecondaryNameNode / home / hadoop-twq /bigdata/hadoop-2.7.5/logs/hadoop-hadoop-twq-secondarynamenode-master.log
Are DataNode role in slave1 and slave2 installation, DataNode corresponding log file:
DataNode on ## slave1 log file /home/hadoop-twq/bigdata/hadoop-2.7.5/logs/hadoop-hadoop-twq-datanode-slave1.log DataNode on ## slave2 log files / home / hadoop -twq / bigdata / hadoop-2.7.5 / logs / hadoop-hadoop-twq-datanode-slave2.log
NameNode DataNode path and corresponding default log at $ HADOOP_HOME / logs, i.e. logs directory under the directory Hadoop installation, where the log can be stored in $ HADOOP_HOME / etc / hadoop / hadoop-env.sh configuration HADOOP_LOG_DIR be modified, as shown below:
You can modify the log storage directory with the following configuration:
## The logs are placed in / home / hadoop-twq / hadoop / cus / logs directory containing the file export HADOOP_LOG_DIR = / home / hadoop- twq / hadoop / cus / logs
HDFS WEB UI View Log on
HDFS this way can only view a log of NameNode and SecondaryNameNode
We can http: // master: 50070 to access HDFS clusters. Then click on the figure below
Then we go to the next map
- The first is at the HDFS log NameNode
- At 2 is the log of HDFS SecondaryNameNode
- Yarn is at the third of ResourceManager log, you can not read this if you are okay
When we click at the first time, you can see the following:
This is NameNode log