HDFS Web UI 1


Apart from Command Line Interface, Hadoop also provides Web User Interface to both HDFS and YARN Resource Manager. Both HDFS Web User interface and Yarn Interfaces are useful in pseudo-distributed mode and are critical tools when you have a fully distributed setup.

HDFS Web UI

Enter the URL as http://localhost:50070/ in web browser and to point to port number 50070 on localhost host name in pseudo-distributed mode. In Fully distributed mode, replace the ‘localhost’ with actual host name of machine on cluster.

HDFS Web UI 1

1. Summary of the HDFS file system is listed on the overview page as shown in below:

Web Ui Summary

2. Name Node status and storage information will also be displayed at the bottom.

Web UI Name Node

3. Data Nodes information will be displayed on Datanodes tab as shown below:

Web UI Datanodes

4. Snap shot summary can accessed as shown below.

Web UI Snapshot

5. We can also browse through HDFS file system and view list of directories and file contents.

Note:By Default HDFS Web UI is read only, and files or directories can’t be created/modified.

We can browse file system from Utilities menu on screen.

Web UI FSAll the directories and files in root folder ‘/’ are listed above.

We can browse through each directory by clicking on each directory name as shown below for /user directory.

Web UI FS 2

Web UI FS 3

As shown in above screen, for each file, owner, group, size, replication factor, block size are listed in the table.

We can have a look at the block information of each and download the files by clicking on each file.

As all our files size is less than block size (128 MB), each file will have only block with number Block 0.

Web UI FS 4

6. Browse Log files generated from various events like running map reduce jobs, running HDFS or YARN daemons. We can select these logs from Utilities menu on screen.

Web UI Logs

We can go through the contents of each log file and for example below is the snapshot of hadoop-siva-namenode-siva-desktop.log

Web UI Logs 2

For browsing YARN Resource Manager with Web UI, Please refer this post.


Profile photo of Siva

About Siva

Senior Hadoop developer with 4 years of experience in designing and architecture solutions for the Big Data domain and has been involved with several complex engagements. Technical strengths include Hadoop, YARN, Mapreduce, Hive, Sqoop, Flume, Pig, HBase, Phoenix, Oozie, Falcon, Kafka, Storm, Spark, MySQL and Java.

Leave a comment

Your email address will not be published. Required fields are marked *


Review Comments
default image

I am a plsql developer. Intrested to move into bigdata.

Neetika Singh ITA Hadoop in Dec/2016 December 22, 2016

.