Creating a dataset using the console

To create a machine learning model you must first have a representative collection of data to train with. Use the console (or API) to create an empty dataset and import your data into the dataset. After importing data you can make modifications and start model training.

For more information about import file formats for specific data types and objectives, see the following pages:

Create a dataset and import or associate your data

Use the following instructions to create an empty dataset and either import or associate your data.

Image

  1. In the Google Cloud Console, in the Vertex AI section, go to the Datasets page.

    Go to the Datasets page

  2. Click Create to open the create dataset details page.
  3. Modify the Dataset name field to create a descriptive dataset display name.
  4. Select the tab for your data type.
    select data type
  5. After choosing the data type, select your model's objective. Objective options depend on the data type you selected.
  6. Select a region from the Region drop-down list.
  7. Click Create to create your empty dataset, and advance to the data import page.
  8. Choose one of the following options from the Select an import method section:

    Upload data from your computer

    1. In the Select an import method section, choose to upload data from your computer.
    2. Click Select files and choose all the local files to upload to a Cloud Storage bucket.
    3. In the Select a Cloud Storage path section click Browse to choose a Cloud Storage bucket location to upload your data to.

    Upload an import file from your computer

    1. Click Upload an import file from your computer.
    2. Click Select files and choose the local import file to upload to a Cloud Storage bucket.
    3. In the Select a Cloud Storage path section click Browse to choose a Cloud Storage bucket location to upload your file to.

    Select an import file from Cloud Storage

    1. Click Select an import file from Cloud Storage.
    2. In the Select a Cloud Storage path section click Browse to choose the import file in Cloud Storage.
  9. Click Continue.

    Data import can take several hours, depending on the size of your data. You can close this tab and return to it later. You will receive an email when your data is imported.

Tabular

  1. In the Google Cloud Console, in the Vertex AI section, go to the Datasets page.

    Go to the Datasets page

  2. Click Create to open the create dataset details page.
  3. Modify the Dataset name field to create a descriptive dataset display name.
  4. Select the Tabular tab.
  5. Select your objective (model type).
  6. Select a region from the Region drop-down list.
  7. If you want to use customer-managed encryption keys (CMEK) with your dataset, open Advanced options and provide your key. (Preview)
  8. Click Create to create your empty dataset, and advance to the Source tab.
  9. Choose one of the following options, based on your data source.

    CSV files on your computer

    1. Click Upload CSV files from your computer.
    2. Click Select files and choose all the local files to upload to a Cloud Storage bucket.
    3. In the Select a Cloud Storage path section enter the path to the Cloud Storage bucket or click Browse to choose a bucket location.

    CSV files in Cloud Storage

    1. Click Select CSV files from Cloud Storage.
    2. In the Select CSV files from Cloud Storage section enter the path to the Cloud Storage bucket or click Browse to choose the location of your CSV files.

    A table or view in BigQuery

    1. Click Select a table or view from BigQuery.
    2. Enter the project, dataset, and table IDs for your input file.
  10. Click Continue.

    Your data source is associated with your dataset.

  11. For forecasting models, on the Analyze tab, specify the Time column and the Time series identifier column for this dataset.

    You can also specify these columns when you train your model, but generally a forecasting dataset (Preview) has specific Time and Time-series identifier columns, so specifying them in the dataset is a best practice.

Text

  1. In the Google Cloud Console, in the Vertex AI section, go to the Datasets page.

    Go to the Datasets page

  2. Click Create to open the create dataset details page.
  3. Modify the Dataset name field to create a descriptive dataset display name.
  4. Select the tab for your data type.
    select data type
  5. After choosing the data type, select your model's objective. Objective options depend on the data type you selected.
  6. Select a region from the Region drop-down list.
  7. Click Create to create your empty dataset, and advance to the data import page.
  8. Choose one of the following options from the Select an import method section:

    Upload data from your computer

    1. In the Select an import method section, choose to upload data from your computer.
    2. Click Select files and choose all the local files to upload to a Cloud Storage bucket.
    3. In the Select a Cloud Storage path section click Browse to choose a Cloud Storage bucket location to upload your data to.

    Upload an import file from your computer

    1. Click Upload an import file from your computer.
    2. Click Select files and choose the local import file to upload to a Cloud Storage bucket.
    3. In the Select a Cloud Storage path section click Browse to choose a Cloud Storage bucket location to upload your file to.

    Select an import file from Cloud Storage

    1. Click Select an import file from Cloud Storage.
    2. In the Select a Cloud Storage path section click Browse to choose the import file in Cloud Storage.
  9. Click Continue.

    Data import can take several hours, depending on the size of your data. You can close this tab and return to it later. You will receive an email when your data is imported.

Video

  1. In the Google Cloud Console, in the Vertex AI section, go to the Datasets page.

    Go to the Datasets page

  2. Click Create to open the create dataset details page.
  3. Modify the Dataset name field to create a descriptive dataset display name.
  4. Select the tab for your data type.
    select data type
  5. After choosing the data type, select your model's objective. Objective options depend on the data type you selected.
  6. Select a region from the Region drop-down list.
  7. Click Create to create your empty dataset, and advance to the data import page.
  8. Choose one of the following options from the Select an import method section:

    Upload data from your computer

    1. In the Select an import method section, choose to upload data from your computer.
    2. Click Select files and choose all the local files to upload to a Cloud Storage bucket.
    3. In the Select a Cloud Storage path section click Browse to choose a Cloud Storage bucket location to upload your data to.

    Upload an import file from your computer

    1. Click Upload an import file from your computer.
    2. Click Select files and choose the local import file to upload to a Cloud Storage bucket.
    3. In the Select a Cloud Storage path section click Browse to choose a Cloud Storage bucket location to upload your file to.

    Select an import file from Cloud Storage

    1. Click Select an import file from Cloud Storage.
    2. In the Select a Cloud Storage path section click Browse to choose the import file in Cloud Storage.
  9. Click Continue.

    Data import can take several hours, depending on the size of your data. You can close this tab and return to it later. You will receive an email when your data is imported.

What's next