Set up a project

Set-up steps

1. Sign in to your Google Cloud account. If you're new to Google Cloud, create an account to evaluate how our products perform in real-world scenarios. New customers also get $300 in free credits to run, test, and deploy workloads.

2. In the Google Cloud console, on the project selector page, select or create a Google Cloud project.

   Note: If you don't plan to keep the resources that you create in this procedure, create a project instead of selecting an existing project. After you finish these steps, you can delete the project, removing all resources associated with the project.

   Go to project selector

3. Make sure that billing is enabled for your Google Cloud project. Learn how to check if billing is enabled on a project.

4. Enable the Google Cloud Dataproc API.

   Enable the API

5. Install the Google Cloud CLI.

6. To initialize the gcloud CLI, run the following command:

   gcloud init

7. In the Google Cloud console, on the project selector page, select or create a Google Cloud project.

   Note: If you don't plan to keep the resources that you create in this procedure, create a project instead of selecting an existing project. After you finish these steps, you can delete the project, removing all resources associated with the project.

   Go to project selector

8. Make sure that billing is enabled for your Google Cloud project. Learn how to check if billing is enabled on a project.

9. Enable the Google Cloud Dataproc API.

   Enable the API

10. Install the Google Cloud CLI.

11. To initialize the gcloud CLI, run the following command:

    gcloud init

Do you Need Credentials? You need credentials only if you plan to directly call Cloud Dataproc APIs from your application or from a browser. If you plan on using the Google Cloud console or the gcloud CLI gcloud command-line tool to create and manage clusters and to submit jobs, you only need to be logged in to the SDK (with gcloud init as shown above); you do not need to separately obtain API credentials.

Set up a VM (optional)

If you plan to run gcloud CLI from a Compute Engine virtual machine (VM) instance, the VM must be set up to access Google Cloud services.

To test whether your VM is set up correctly, run gcloud compute instances describe your-vm-instance-name from the command line. A service account must be listed that includes the https://www.googleapis.com/auth/cloud-platform scope. If you can't find the scope, see Changing the service account and access scopes for an instance.

Use Cloud Shell to run gcloud CLI commands. As an alternative to setting up your own VM to run SDK commands, open a Cloud Shell session to automatically provision a VM with the necessary scopes, and then run gcloud CLI commands from Cloud Shell.

---

Next Step: Create a Cluster