Open Hadoop HDFS NameNode WebUI
Determine if TCP port 50070 and 50470 for Hadoop/HDFS NameNode WebUI service is open to the public
While some ports such as HTTP and HTTPS are required to be open to the public to function properly, more sensitive services such as Hadoop/HDFS should be restricted to known IP addresses.
Recommended Actions
Follow the appropriate remediation steps below to resolve the issue.
-
Log in to the Microsoft Azure Management Console.
-
Click the search bar at the top and search for Network security groups.
-
Select the “Network security group” that needs to be verified.
-
Click on the “Name” of the selected “Network security group” to access the port configurations.
-
In the “Overview” tab scroll down the page and check the “Inbound security rules” under the “Settings”.
-
If the “Hadoop/HDFS” for port 50070 and 50470 with the protocol “TCP” is showing as “Allow” under “Action” column for all “Source” and “Destination” then the selected “Network security group” has TCP port 50070 and 50470 for Hadoop/HDFS open to the public.
-
Repeat steps number 2 - 6 to verify other “Network security groups”.
-
Navigate to the “Network security group” and select the security group that needs to be modified for restricting the “TCP” port for “Hadoop/HDFS” on port 50070 and 50470 to specific IP Address.
-
Scroll down the left navigation panel and choose “Inbound security rules” under “Settings”.
-
Click on the “Hadoop” protocol in the “Name” column and in the right pane under “Source” select the “IP Addresses” from the dropdown menu and enter the “Source IP addresses/CIDR ranges” as per the requirement, select the required Protocol and Action, and then click on the “Save” option at the top of the pane.
-
Repeat steps number 8 - 10 to restrict TCP port 50070 and 50470 for Hadoop/HDFS to known IP addresses.