How-to Guides

Cleanse Tasks

• Overview

  Cleanse tasks overview.

• Apply Conditional Transformations

  How to apply conditional logic in your steps.

• Change Column Data Type

  How to change the data type for your columns.

• Compare Values

  How to compare values of various data types.

• Copy and Paste Columns

  How to copy and paste columns and column values.

• Deduplicate Data

  How to deduplicate rows in your dataset.

• Extract Values

  How to extract values from one column into new columns.

• Format Dates

  How to format Datetime values.

• Manage String Lengths

  How to manage the lengths of strings.

• Modify String Values

  How to modify string values.

• Normalize Numeric Values

  How to normalize formatting of numeric values.

• Prepare Data for Machine Processing

  How to prepare your data for machine processing.

• Remove Data

  How to remove data from your dataset.

• Rename Columns

  How to rename one or more columns.

• Replace Values

  How to replace values in your data.

• Standardize Using Patterns

  How to standardize values using patterns.

Discovery Tasks

• Overview

  Discovery tasks overview.

• Add or Edit Recipe Steps

  How to add or edit recipe steps.

• Analyze across Multiple Columns

  How to analyze across multiple columns.

• Calculate Metrics across Columns

  How to calculate metrics across multiple columns.

• Compare Strings

  How to compare string values.

• Compute Counts

  How to compute count metrics.

• Explore Suggestions

  How to explore suggestion cards.

• Filter Data

  How to filter data in your dataset.

• Locate Outliers

  How to locate outliers in your dataset.

• Parse Fixed-Width File and Infer Columns

  How to import and parse datsets with fixed-width columns.

Enrichment Tasks

• Overview

  Enrichment tasks overview.

• Add Lookup Data

  How to look up values in another dataset.

• Add Two Columns

  How to combine or add two columns.

• Append Datasets

  How to append datasets together using union operations.

• Generate Primary Keys

  How to generate primary keys in your dataset.

• Insert Metadata

  How to insert metadata about your datasource into your dataset.

• Join Datasets

  How to join datasets using shared key columns.

Import Tasks

• Overview

  Import tasks overview.

• Change File Encoding

  How to change file encoding type.

• Connect to Data

  How to connect to data.

• Create Dataset with Parameters

  How to create a dataset with parameters.

• Disable Type Inference

  How to disable type inferencing for relational sources.

• Import Excel Data

  How to import Excel workbooks and worksheets.

• Import a File

  How to import a file.

• Import a Table

  How to import a table.

• Import from Another Flow

  How to import from another flow.

• Remove Initial Structure

  How to remove initial structuring.

Project Management Tasks

• Overview

  Project management tasks overview.

• Add Comments to Your Recipe

  How to add comments to your recipe.

• Build Sequence of Datasets

  How to build a sequence of datasets.

• Create Branching Outputs

  How to create multiple outputs from a single recipe.

• Create Target

  How to assign a target schema to your dataset.

• Diagnose Failed Jobs

  How to diagnose a failed job.

• Export Flow

  How to export a flow from the product.

• Fix Dependency Issues

  How to fix broken references in your recipe.

• Import Flow

  How to import an exported flow.

• Manage Flows with Folders

  How to organize your flows using folders.

• Optimize Job Processing

  How to optimize job processing.

• Run Job on Cloud Dataflow

  How to run a job directly on Cloud Dataflow.

• Schedule a Job

  How to schedule a job.

• Send a Copy of a Flow

  How to send a copy of a flow to another user.

• Share a Flow

  How to share a flow with another user.

• Take a Snapshot

  How to take a snapshot of your dataset.

• Track Data Changes

  How to track changes to your dataset as you work.

Publishing Tasks

• Overview

  Publishing tasks overview.

• Publish Results on Demand

  How to publish results to another datastore afrer a job has completed.

• Reuse Recipe

  How to reuse your recipes.

Structuring Tasks

• Overview

  Structuring tasks overview.

• Create Aggregations

  How to create aggregations from your dataset.

• Initial Parsing Steps

  How to review and modify steps the first steps that are automatically applied.

• Pivot Data

  How to create pivots on your data.

• Reshaping Steps

  How to reshape your dataset into new rows and columns.

• Split Column

  How to split values in a column into multiple columns.

• Working with Arrays

  How to work with arrays.

• Working with JSON

  How to work with JSON sources.

Validation Tasks

• Overview

  Validation tasks overview.

• Find Bad Data

  How to find bad data in your dataset.

• Find Missing Data

  How to find missing data in your dataset.

• Manage Null Values

  How to locate and manage null values.

• Profile Your Source Data

  How to profile your source data.

• Validate Your Data

  How to validate your dataset.