Column Browser Panel

Through the Column Browser, you can use data quality bars and data type information to perform basic review of data across many columns. You can use these tools to select data of interest for display in the data grid or Column Details views or to prompt for suggestions of recipe steps.

  • You can also use the Column Browser to toggle the display of individual columns.
  • To open the Column Browser, click the Column View icon in the Transformer bar for the Transformer page.

Figure: Column Browser

You can select one or more columns in the browser and then perform actions on them.

Locate Columns

You can apply one or more filters to limit the set of columns displayed in the browser. Click the Filter icon in the Transformer toolbar.

NOTE: Filters are additive and persist between the column browser and the data grid.

For more information, see Filter Panel.

Select Columns

In the browser, you can manually select one or more columns or apply one of the predefined selections.

  • To select a range of columns, click a column, press SHIFT and then click the ending column.
  • To select multiple discrete columns, press CTRL/COMMAND and click additional columns.
  • To toggle selection of a column, click it again.

Cut, Copy and Paste

In the Column Browser, you can cut, copy, and paste one or more columns.

  1. Select the column(s).
  2. Right-click on the columns. In the context menu, select Cut or Copy.

    NOTE: If you cut columns and the cut again, the originally cut columns are left untouched.

  3. Select the column where you wish to move the columns or paste the values.

    NOTE: Do not select multiple columns for multi-column pasting. You must select only one column. Multi-column operations are applied to the columns to the bottom/right of the selection.

  4. From the context menu, select Paste:
    1. Paste before: Paste cut or copied columns before the selected one.
    2. Paste after: Paste column(s) after the selected one.
    3. Paste values: Replace values in the selected column(s) with the values from the column(s) in the clipboard. The number of selected columns on the clipboard and in the selected target area must match. Data types do not have to match.

Transformer Toolbar

At the top of the column browser, you can use the toolbar to quickly build common transformations, filter the display, and other operations.

For more information on the Target menu in the Transformer toolbar, see below.

See Transformer Toolbar.

Column Actions

For any individual column:

  • Click the Eye icon to hide/show of the column in the Transformer page. See Visible Columns Panel.

    NOTE: Hidden columns are only removed from view in the Transformer page. They still appear in any generated output.

  • Hover over the color bars in the data quality bar to review counts. See Data Quality Bars.
  • Right-click a column to display a list of actions in the context menu. Column actions apply only to the selected column and depend on its data type.
    • For multiple selected columns, you can choose an action from the Action menu an option that apply to all of the selected columns.
    • See Column Menus.

Target Schema Matching

You can associate a target schema with a recipe. A target schema is information about the column names, data types, and order of the target dataset for which you are trying to build your recipe. For more information, see Overview of Target Matching.

Actions taken based on the target schema are rendered as new steps in your recipe at the current location.

Figure: Target Matching Panel in Column Browser

In the Target Matching panel, a target schema that has been associated with your recipe is displayed as an extra set of columns on the left side:

SideDescription
LeftColumn from target
RightColumn from source (current recipe)

Schema Tags:

Between the two sets of fields are a set of tags that describe the matching between the two columns in the order listed in each dataset. Each tag describes the match found for the corresponding target or source column.

  • Matches by position are arrows.
  • Matches by data type are green in color.
  • Red color indicates no match at all.

Tip: Mouse over tags that are not solid green to learn the nature of the column mismatch. You can then click the tag to insert steps in your recipe to match the two columns.

Match by NameMatch by Data TypeMatch by PositionIconDescription
No--Square - red outline

Target column has no identifiable name match in source. Column appears to be missing from source.

Tip: Click the source or target rectangle to manually assign a matching column.

YesNoNoSquare - blue outlineSource column name has a matching target column name, but is in the incorrect location.
YesYesNoSquare - green outlineSource column name and data type have a match in the target, but it is in a different position.
YesNoYesArrow - blue outlineSource column and target column match in name and position, but have different types.
YesYesYesArrow - green solidSource and target columns match in name, position, and type.

Target menu actions:

From the Transformer toolbar, you can select the following options from the Target menu:

  • Attach a new Target: Assign a target schema to the dataset.

    NOTE: After you have assigned a new target to the schema, the page may not update. Please refresh the page through your browser. This is a known issue.

  • Remove attached Target: Remove the target from assignment to the source. Target schema dataset is not deleted.
  • Fix all matches: All detected matches are automatically performed.

When you have selected one or more source columns, you can additionally perform the following action:

  • Fix columns by position: For columns that are aligned correctly with the target but are not matched by the application, you can use this option to force the application to recognize them as a match.
Was this page helpful? Let us know how we did:

Send feedback about...

Google Cloud Dataprep Documentation