Open Hadoop HDFS NameNode Metadata Service
Determine if TCP port 8020 for HDFS NameNode metadata service is open to the public.
While some ports such as HTTP and HTTPS are required to be open to the public to function properly, more sensitive services such as Hadoop/HDFS should be restricted to known IP addresses.
Recommended Actions
Follow the appropriate remediation steps below to resolve the issue.
-
Log in to the Microsoft Azure Management Console.
-
Click the search bar at the top and search for Network security groups.
-
Select the “Network security group” that needs to be verified.
-
Click on the “Name” of the selected “Network security group” to access the port configurations.
-
In the “Overview” tab scroll down the page and check the “Inbound security rules” under the “Settings”.
-
If the “Hadoop/HDFS” for port 8020 with the protocol “TCP” is showing as “Allow” in column “Action” for all “Source” and “Destination” then the selected “Network security group” has TCP port 8020 for Hadoop/HDFS open to the public.
-
Repeat steps number 2 - 6 to verify other “Network security groups”.
-
Navigate to the “Network security group” and select the security group that needs to modified for restricting the “TCP” port for “Hadoop/HDFS” on port 8020 to specific IP Address.
-
Scroll down the left navigation panel and choose “Inbound security rules” under “Settings.”
-
Click on the “Hadoop” protocol in the “Name” column and in the right pane under “Source” select the “IP Addresses” from the dropdown menu and enter the “Source IP addresses/CIDR ranges” as per the requirement, select the required Protocol and Action and click on the “Save” option at the top of the pane.
-
Repeat step number 8 - 10 to restrict TCP port 8020 for Hadoop/HDFS to known IP addresses.