Metadata Discovery scans the source system to provide information about the type of data available on the source system. Following additional options can be set for Metadata Discovery:
Skip Files with No Extension: Check this checkbox to skip the scanning of the files which have no extension. Once the task has been executed successfully, the result can be seen under the Skipped Files tab of the By Task screen for the Results module. The reason for skipping the file will be cited as File Name without extension under the Skipped Reason column.
Recursion Levels: Select number of recursions levels to be scanned. This option is available only for Metadata Discovery.
All: This option will scan all the files.
Custom: This option lets you customize the recursion levels that need to be scanned. You can define the recursion levels in the Custom textbox.
To proceed further for remaining steps, refer to step 4 of Create a HDFS task.