Skip to main content

BigQuery - Create a Task

For BigQuery, go to Google Cloud > BigQuery > Tasks. This will display the Task Definition screen. Select cluster from the Select Cluster drop-down to populate the screen. IDP Status can be seen on the top right corner of this tab (Active/Inactive).

Click the Add New Task Definition tab. The following screenshot shows the user interface for creating a task.

  1. Enter a meaningful task name in the Task Name field and a description in the Task Description field. The task name must be unique to the task. It can be up to 256 characters and consist of letters, numbers, certain symbols (! @ # $ _), without any spaces. The definition can be if the task name and contain any combination of numbers, letters, and symbols.

  2. Choose the Task Type from the given options in the drop-down. There are two types of task user can create.

    1. Detection

    2. Protection

  3. Select Policy panel displays the list of all available policies. You can view all Pre-Defined and User Defined policies in this panel. To add a new policy, click + Add Policy button. To know more, refer section Policy. To select one or more policies, check the checkbox(s) available with the policy name.

  4. Pre-Defined And Custom Sensitive Types panel displays the list of all Pre-defined and Custom Sensitive types available with the selected policy in Select Policy panel. To select a sensitive type, check the checkbox available with the sensitive type names. To add a sensitive data type, click + Add New Sensitive Data Type button.


    In case Protection is selected as the Task Type, the panel name changes to Sensitive Data Types. Also, the Protection Option and Consistent columns appear in addition, giving description of the sensitive data types associated with the selected policy. For details about all the masking options available, refer to Masking Options.

  5. The Select DB/Table panel along with Select Columns for Table panel displays the list of all the databases or table names that are available in the selected cluster along with their column names, respectively. The options in this panel will change as per the selected task type. Select the project from the Project ID drop-down to populate the screens.

    1. For Detection:

      1. Check the checkbox for the respective database and/or tables in the Select DB/Table panel. This will select the entire table for scanning. Selecting entire database does not allow you to select the columns of your choice. To update the information in the panel, click Refresh button.  

      2. The Filter by Table name textbox allows you to search the name of the table. 

      3. To display all available columns of the selected table, click table name in the Select DB/Table panel. This populates the Select Columns for Table panel with the list of all columns associated. This panel also displays the datatype of the column.

      4. To select one or multiple columns in the table, check the checkbox(s) available with the column name(s). This will add the selected columns in the Selected Columns panel.

    2. For Protection:

      1. Select database and table in Select DB/Table panel. On selecting, it will display the list of all columns for the selected table in Select Columns for Table panel. To update the information in the panel, click Refresh button.

      2. The Filter by Table name textbox allows you to search the name of the table.

      3. The Select Columns for Table panel displays list of all column names for the selected table. This panel also displays the datatype of columns. Select the sensitive type from the Select Sensitive Type drop-down for each column name that needs to be masked. On selecting columns for masking, data will be displayed in Selected Columns panel.

  6. The Selected Columns panel displays the list of all selected column names with their table and the dataset name when selected in the Select DB/Table panel. It also displays the Project ID to which that dataset belongs. To delete any entry from the panel, check the checkbox(s) available with the Dataset Name and click the Delete Selected button displayed in the top right corner of the panel under 3 Dot icon.

    Alternatively, you can delete any selected dataset detail by clicking  Trash button in the Actions column.

     For detection, if you have selected an entire database or table, then the Table Name and/or Column Name columns will display * (star) next to that dataset. If you’ve selectively made choices for the columns in any table, then the column names will be displayed in the Column Name.

    For protection, this panel will display additional information about the sensitive types that need to be masked in the selected table. It will also display details about the domain to which it is associated, along with the datatype of the column.

  7. Click Save button to save the task. To execute the task instantly after saving, click Save and Execute button. Click Save As button, if you want to save the task with the same configuration but with different name. 

    To edit an existing task, select the task from the Task List panel on the Tasks Definition screen. Click Pen icon under the Actions button.

JavaScript errors detected

Please note, these errors can depend on your browser setup.

If this problem persists, please contact our support.