Perform the following steps to configure a cluster:
Click Configure New Cluster.
The Add/Edit Configuration dialog box will appear.
The fields are described below:
Compute Cluster Name: Enter the name you want to provide to the cluster.
S3 Cloud IDP: Select the S3 Cloud IDP.
DgWalker IDP: Select the DgWalker IDP.
Instance Type: Select the Instance Type. Each Instance Type comprise of varying CPU, memory, and storage capabilities. The options are displayed in the below screenshot:
Subnet Id: Define the sub network TCP/IP address. Specify this value when the cluster is created on a specific subnet.
Instance Count: Specify the number of nodes in the cluster. The min and max value are 1 and 10.
Use Default Roles: Check the Use Default Roles checkbox to use the default AWS roles.
Service Role: Specify the Service Role to connect with different services. AWS services require that you use roles to allow the service to access resources in other services.
Instance Role: Specify the Instance Role to establish connectivity between the Master and the Slave node.
Master Security Group: Specify the security group you want to link with the Master node in the cluster.
Additional Master Security Groups: You can link another security group with the Master node in case you want to provide them access to the Master node.
Slave Security Group: Specify the security group you want to link with the Slave node in the cluster.
Additional Slave Security Groups: You can link another security group with the Slave node in case you want to provide them access to the Master node.
EMR Security Configuration: Specify the name of the security configuration that you have configured on the AWS console.
Log URI: Provide the location of EMR logs.
Tags: Create labels for the machines used in the cluster.
Visible To All Users: If the Visible To All Users checkbox is not selected, only the user who has created the role can see the cluster.
Key Name: Specify the keypair that has been configured on AWS console to access the cluster via SSH.
Release: Select the EMR version from the dropdown. Currently, EMR version upto emr-5.23.0 is supported.
AMI Version: Specify the Amazon Machine Image version number.
IMDSv2 and IMDSv1 metadata service is now supported in LFA-S3 and HDFS-S3.