Set up a project

Setup steps

1. Sign in to your Google Cloud account. If you're new to Google Cloud, create an account to evaluate how our products perform in real-world scenarios. New customers also get $300 in free credits to run, test, and deploy workloads.

2. In the Google Cloud console, on the project selector page, select or create a Google Cloud project.

   Note: If you don't plan to keep the resources that you create in this procedure, create a project instead of selecting an existing project. After you finish these steps, you can delete the project, removing all resources associated with the project.

   Go to project selector

3. Make sure that billing is enabled for your Google Cloud project.

4. Enable the Google Cloud Dataproc API.

   Enable the API

5. Install the Google Cloud CLI.

6. To initialize the gcloud CLI, run the following command:

   gcloud init

7. In the Google Cloud console, on the project selector page, select or create a Google Cloud project.

   Note: If you don't plan to keep the resources that you create in this procedure, create a project instead of selecting an existing project. After you finish these steps, you can delete the project, removing all resources associated with the project.

   Go to project selector

8. Make sure that billing is enabled for your Google Cloud project.

9. Enable the Google Cloud Dataproc API.

   Enable the API

10. Install the Google Cloud CLI.

11. To initialize the gcloud CLI, run the following command:

    gcloud init

Note: When you enable the Dataproc API, the Dataproc Control API is also enabled. Disabling the Dataproc API does not disable the Dataproc Control API. You must separately disable the Dataproc Control API.

Do you Need Credentials? You need credentials only if you plan to directly call Dataproc APIs from your application or from a browser. If you plan on using the Google Cloud console or the Google Cloud CLI to create and manage clusters and to submit jobs, you only need to be logged in to the SDK with the gcloud init command.

Set up a VM (optional)

If you plan to run gcloud CLI from a Compute Engine virtual machine (VM) instance, the VM must be set up to access Google Cloud services.

To test whether your VM is set up correctly, run gcloud compute instances describe your-vm-instance-name from the command line. A service account must be listed that includes the https://www.googleapis.com/auth/cloud-platform scope. For more information on setting up a VM, see Create a VM that uses a user-managed service account.

Use Cloud Shell to run gcloud CLI commands. As an alternative to setting up your own VM to run SDK commands, open a Cloud Shell session to automatically provision a VM with the necessary scopes, and then run gcloud CLI commands from Cloud Shell.

---

Next Step: Create a Cluster