Skip to main content

Install HDFS IDP

  1. Locate and copy the executable file DgSecureHDFSIDP-<x.x.x.x>-linux-x64-installer.run to the machine on which you will install the IDP.

  2. Run DgSecureHDFSIDP-<x.x.x.x>-linux-x64-installer.run.

  3. Accept the license agreement.

  4. Install the IDP in the default directory or enter a different location.

  5. Select the type of distribution System.

    1. In case the user selects option [1] i.e., MapR, then provide the details as depicted in the screenshot below:

    2. In case the user selects option [2] i.e., Cloudera, then provide the details as depicted in the screenshot below:

    3. In case the user selects option [3] i.e., Hortonworks, then provide the details as depicted in the screenshot below:



      *Note: For Hortonworks version 2.3 or higher, select option [1] and enter the actual version in the HDP Version field.

    4. In case the user selects option [4] i.e., Pivotal, then provide the details as depicted in the screenshot below:

    5. In case the user selects option [5] i.e., EMR, then provide the details as depicted in the screenshot below:

    6. In case the user selects option [6] i.e., Spark, then choose the Spark version.

      1. If you select option [1], then provide the details as depicted in the screenshot below:

      2. If you select option [2], then provide the details as depicted in the screenshot below:

      3. If you select option [3], then provide the details as depicted in the screenshot below:

  6. An SSL certificate enhances the security by allowing you to run PK Protect in a secure environment. Enter “Y” to configure the SSL certificate and select option for SSL i.e., Self Signed or Trusted, else move to Install AzureData IDP.

    1. Enter Y if you want to configure Client Auth.

    2. if you choose option [1] in step 6 i.e., Self-Signed, then provide the configuration details displayed in the following screenshot:

    3. If you choose option [2] in step 6 i.e., Trusted, provide the configuration details displayed in the following screenshot:

    4. If you have specified “Y” in step 6(a) for client authentication, then provide the Truststore Path and Password as depicted in the screenshot below:

  7. Installation will begin.

If security mechanisms i.e., Ranger, KMS, Kerberos etc. are enabled on the cluster, then replace the Hadoop Jars in HDFSAgent/expandedArchive/WEB-INF/lib folder with the Jars present in the cluster.

  1. Remove the below mentioned jar files from the following location: ‘/opt/Dataguise/DgSecure/Agents/HDFSAgent/expandedArchive/WEB-INF/lib’

    1. hadoop-annotations-<JarVersion><HDPVersion>.jar

    2. hadoop-yarn-client-<JarVersion><HDPVersion>.jar

    3. hadoop-auth-<JarVersion><HDPVersion>.jar

    4. hadoop-mapreduce-client-core-<JarVersion><HDPVersion>.jar

    5. hadoop-yarn-common-<JarVersion><HDPVersion>.jar

    6. hadoop-common-<JarVersion><HDPVersion>.jar

    7. hadoop-yarn-server-common-<JarVersion><HDPVersion>.jar

    8. hadoop-hdfs-<JarVersion><HDPVersion>.jar

    9. hadoop-mapreduce-client-shuffle-<JarVersion><HDPVersion>.jar

    10. hadoop-mapreduce-client-app-<JarVersion><HDPVersion>.jar

    11. hadoop-yarn-api-<JarVersion><HDPVersion>.jar

  2. Use ‘rm -rf’ command to remove the jar files.
    For example,
    rm-rf /opt/Dataguise/DgSecure/Agents/HDFSAgent/expandedArchive/WEB-INF/lib/hadoop-annotations-2.7.3.2.6.3.0-235.jar

  3. Copy the below mentioned jar files to the following location: ‘/opt/Dataguise/DgSecure/Agents/HDFSAgent/expandedArchive/WEB-INF/lib’

    1. hadoop-yarn/hadoop-yarn-common-<JarVersion><HDPVersion>.jar

    2. hadoop-yarn/hadoop-yarn-client-<JarVersion><HDPVersion>.jar

    3. hadoop-yarn/hadoop-yarn-api-<JarVersion><HDPVersion>.jar

    4. hadoop-mapreduce/hadoop-mapreduce-client-shuffle-<JarVersion><HDPVersion>.jar

    5. hadoop-mapreduce/hadoop-mapreduce-client-core-<JarVersion><HDPVersion>.jar

    6. hadoop-mapreduce/hadoop-mapreduce-client-app-<JarVersion><HDPVersion>.jar

    7. hadoop-hdfs/hadoop-hdfs-<JarVersion><HDPVersion>.jar

    8. hadoop/hadoop-common-<JarVersion><HDPVersion>.jar

    9. hadoop/hadoop-auth-<JarVersion><HDPVersion>.jar

    10. hadoop/hadoop-annotations-<JarVersion><HDPVersion>.jar

  4. Use ‘cp’ command to copy the jar files.
    For example,
    cp /usr/hdp/2.6.3.0-235/hadoop-yarn/hadoop-yarn-server-common-2.7.3.2.6.3.0-235.jar /opt/Dataguise/DgSecure/Agents/HDFSAgent/expandedArchive/WEB-INF/lib

JavaScript errors detected

Please note, these errors can depend on your browser setup.

If this problem persists, please contact our support.