Hadoop Secure Mode Enabled
Ensure that all Dataproc clusters have hadoop secure mode enabled.
Enabling Hadoop secure mode will allow multi-tenancy with security features like isolation, encryption, and user authentication within the cluster. It also enforces all Hadoop services and users to be authenticated via Kerberos Key distribution.
Recommended Actions
Follow the appropriate remediation steps below to resolve the issue.
-
Log into the Google Cloud Platform Console.
-
Scroll down the left navigation panel and choose “Dataproc” to select the “Clusters” option.
-
On the “Clusters” page, select the cluster which needs to be verified whether it has Hadoop Secure Mode enabled or not by clicking on its name.
-
On the “Cluster details” page, click on the “Configuration” tab.
-
Scroll down and check the value of “Advanced security”. If “Advanced security” is “disabled” then the cluster does not have Hadoop Secure Mode enabled.
-
Repeat step number 2 - 5 to verify other “Clusters” in the project.
-
Navigate to “Dataproc” and choose “Clusters”, and click on the name of the “Cluster” that needs to have Hadoop Secure Mode enabled to go to the “Cluster details” page.
-
From the “Cluster details” page, collect all the configuration information for the cluster.
-
Go back to the “Clusters” page and click the “Create Cluster” button at top.
-
On the “Create Cluster” page, add all the configuration information of the old cluster and then click on “Manage Security” tab on the left-side.
-
Under “Kerberos and Hadoop Secure Mode”, click on the slider next to “Enable” to enable Hadoop Secure Mode for the cluster.
-
Click the “Create” button on left side to create a new dataproc cluster with Hadoop Secure Mode enabled.
-
Once the new “Cluster” is created, delete the old cluster by clicking on the checkbox next to its name and then clicking on the “Delete” button at the top.
-
Confirm the deleteion by clicking on the “Confirm” button in the “Confirm deletion” popup.
-
Repeat steps number 7 - 14 to recreate all the Dataproc “Clusters” in the project with Hadoop Secure Mode enabled.