Skip to main content

Configure Cluster

Perform the following steps to configure a cluster:

  1. Click Configure New Cluster.

  2. The Add/Edit Configuration dialog box will appear.


    The fields are described below:

    1. Compute Cluster Name: Enter the name you want to provide to the cluster.

    2. S3 Cloud IDP: Select the S3 Cloud IDP.

    3. DgWalker IDP: Select the DgWalker IDP.

    4. Instance Type: Select the Instance Type. Each Instance Type comprise of varying CPU, memory, and storage capabilities. The options are displayed in the below screenshot:

    5. Subnet Id: Define the sub network TCP/IP address. Specify this value when the cluster is created on a specific subnet.

    6. Instance Count: Specify the number of nodes in the cluster. The min and max value are 1 and 10.

    7. Use Default Roles: Check the Use Default Roles checkbox to use the default AWS roles.

    8. Service Role: Specify the Service Role to connect with different services. AWS services require that you use roles to allow the service to access resources in other services.

    9. Instance Role: Specify the Instance Role to establish connectivity between the Master and the Slave node.

    10. Master Security Group: Specify the security group you want to link with the Master node in the cluster.

    11. Additional Master Security Groups: You can link another security group with the Master node in case you want to provide them access to the Master node.

    12. Slave Security Group: Specify the security group you want to link with the Slave node in the cluster.

    13. Additional Slave Security Groups: You can link another security group with the Slave node in case you want to provide them access to the Master node.

    14. EMR Security Configuration: Specify the name of the security configuration that you have configured on the AWS console.

    15. Log URI: Provide the location of EMR logs.

    16. Tags: Create labels for the machines used in the cluster.

    17. Visible To All Users: If the Visible To All Users checkbox is not selected, only the user who has created the role can see the cluster.

    18. Key Name: Specify the keypair that has been configured on AWS console to access the cluster via SSH.

    19. Release: Select the EMR version from the dropdown. Currently, EMR version upto emr-5.23.0 is supported.

    20. AMI Version: Specify the Amazon Machine Image version number.

  3. Click Save.

IMDSv2 and IMDSv1 metadata service is now supported in LFA-S3 and HDFS-S3.

JavaScript errors detected

Please note, these errors can depend on your browser setup.

If this problem persists, please contact our support.