Set up Cloud HPC Toolkit

To use Cloud HPC Toolkit, you need a Google Cloud project. In your project, you need to enable APIs, permissions, and grant credentials to Terraform. You also need to clone and build the Cloud HPC Toolkit repository.

Before you begin

1. Sign in to your Google Cloud account. If you're new to Google Cloud, create an account to evaluate how our products perform in real-world scenarios. New customers also get $300 in free credits to run, test, and deploy workloads.

2. In the Google Cloud console, on the project selector page, select or create a Google Cloud project.

   Note: If you don't plan to keep the resources that you create in this procedure, create a project instead of selecting an existing project. After you finish these steps, you can delete the project, removing all resources associated with the project.

   Go to project selector

3. Make sure that billing is enabled for your Google Cloud project.

4. Enable the Compute Engine, Filestore, Cloud Storage, and Service Usage APIs.

   Enable the APIs

5. In the Google Cloud console, on the project selector page, select or create a Google Cloud project.

   Note: If you don't plan to keep the resources that you create in this procedure, create a project instead of selecting an existing project. After you finish these steps, you can delete the project, removing all resources associated with the project.

   Go to project selector

6. Make sure that billing is enabled for your Google Cloud project.

7. Enable the Compute Engine, Filestore, Cloud Storage, and Service Usage APIs.

   Enable the APIs

Overview

To set up Cloud HPC Toolkit, you need to complete the following steps:

• Set up your CLI
• Set the default project
• Ensure that the default Compute Engine service account is enabled
• Grant user access credentials to Terraform
• Enable OS Login at the project-level
• Clone the Cloud HPC Toolkit GitHub repository
• Build the Cloud HPC Toolkit binary

Set up your CLI

In the Google Cloud console, activate Cloud Shell.

Activate Cloud Shell

At the bottom of the Google Cloud console, a Cloud Shell session starts and displays a command-line prompt. Cloud Shell is a shell environment with the Google Cloud CLI already installed and with values already set for your current project. It can take a few seconds for the session to initialize.

Note: If you are using a local shell, ensure that you have installed the dependencies. If you use Cloud Shell, the dependencies are already pre-installed.

Set a default project

To set a default project, run the following command:

Replace PROJECT_ID with your project ID.

gcloud config set project PROJECT_ID

Ensure that the default Compute Engine service account is enabled

Cloud HPC Toolkit requires that the default Compute Engine service account is enabled in your project and that the roles/editor IAM role is enabled on the service account. This is the default setting that is set up by Google Cloud for projects.

However, if you had disabled the default Compute Engine service account and the roles/editor IAM role in your project, complete the following steps to enable these settings:

1. Enable the default Compute Engine service account.

   gcloud iam service-accounts enable \
      --project PROJECT_ID \
      [e-mail]
   

2. Grant the roles/editor IAM role to the service account.

   gcloud projects add-iam-policy-binding PROJECT_ID \
       --member=serviceAccount:[e-mail] \
       --role=roles/editor
   

Replace the following:

• PROJECT_ID: your project ID

• PROJECT_NUMBER: the automatically generated unique identifier for your project

  For more information, see Identifying projects.

Grant user access credentials to Terraform

Note: If you are using Cloud Shell, you can skip this step.

To generate cloud credentials associated with your Google Cloud account, run the following command:

gcloud auth application-default login

This grants the Application Default Credentials (ADC) to Terraform.

Enable OS Login at the project-level

To be able to connect to a VM in your cluster by using ssh, you must enable OS Login. If OS Login is already enabled at the organization level, you do not need to enable it on your project.

gcloud compute project-info add-metadata \
     --metadata enable-oslogin=TRUE

Clone the Cloud HPC Toolkit GitHub repository

1. Clone the GitHub repository:

   git clone https://github.com/GoogleCloudPlatform/hpc-toolkit.git

2. Go to the main working directory:

   cd hpc-toolkit/

Build the Cloud HPC Toolkit binary

1. To build the Cloud HPC Toolkit binary from source, run the following command:

   make

2. To verify the build, run the following command:

   ./ghpc --version

After building the binary, you are now ready to deploy HPC clusters to run your jobs or workloads.

What's next

• Learn about HPC blueprints