Set up a project

Setup steps

  1. Sign in to your Google Cloud account. If you're new to Google Cloud, create an account to evaluate how our products perform in real-world scenarios. New customers also get $300 in free credits to run, test, and deploy workloads.

  2. In the Google Cloud console, on the project selector page, select or create a Google Cloud project.

    Go to project selector

  3. Make sure that billing is enabled for your Google Cloud project.

  4. Enable the Google Cloud Dataproc API.

    Enable the API

  5. Install the Google Cloud CLI.

  6. To initialize the gcloud CLI, run the following command: 

    gcloud init

  7. In the Google Cloud console, on the project selector page, select or create a Google Cloud project.

    Go to project selector

  8. Make sure that billing is enabled for your Google Cloud project.

  9. Enable the Google Cloud Dataproc API.

    Enable the API

  10. Install the Google Cloud CLI.

  11. To initialize the gcloud CLI, run the following command: 

    gcloud init

Do you Need Credentials? You need credentials only if you plan to directly call Dataproc APIs from your application or from a browser. If you plan on using the Google Cloud console or the Google Cloud CLI to create and manage clusters and to submit jobs, you only need to be logged in to the SDK with the gcloud init command.

Set up a VM (optional)

If you plan to run gcloud CLI from a Compute Engine virtual machine (VM) instance, the VM must be set up to access Google Cloud services.

To test whether your VM is set up correctly, run gcloud compute instances describe your-vm-instance-name from the command line. A service account must be listed that includes the https://www.googleapis.com/auth/cloud-platform scope. For more information on setting up a VM, see Create a VM that uses a user-managed service account.