Running Django on the App Engine standard environment

Django apps that run on App Engine standard environment scale dynamically according to traffic.

This tutorial assumes that you're familiar with Django web development. If you're new to Django development, it's a good idea to work through writing your first Django app before continuing. In that tutorial, the app's models represent polls that contain questions, and you can interact with the models by using the Django admin console.

This tutorial requires Python 3.7.

Before you begin

Sign in to your Google Cloud account. If you're new to Google Cloud, create an account to evaluate how our products perform in real-world scenarios. New customers also get $300 in free credits to run, test, and deploy workloads.
In the Google Cloud Console, on the project selector page, select or create a Google Cloud project.

Note: If you don't plan to keep the resources that you create in this procedure, create a project instead of selecting an existing project. After you finish these steps, you can delete the project, removing all resources associated with the project.

Go to project selector
Make sure that billing is enabled for your Cloud project. Learn how to confirm that billing is enabled for your project.
Enable the Cloud SQL Admin API.
Enable the API

Install and initialize the Cloud SDK.
Note: You can run the gcloud tool in the Cloud Console without installing the Cloud SDK. To run the gcloud tool in the Cloud Console, use Cloud Shell .

Log in to gcloud

Acquire new credentials to use the Cloud SQL Admin API:

gcloud auth application-default login

Downloading and running the app

After you've completed the prerequisites, download and deploy the Django sample app. The following sections guide you through configuring, running, and deploying the app.

Cloning the Django app

The code for the Django sample app is in the GoogleCloudPlatform/python-docs-samples repository on GitHub.

You can either download the sample as a ZIP file and extract it or clone the repository to your local machine:

git clone https://github.com/GoogleCloudPlatform/python-docs-samples.git
Go to the directory that contains the sample code:

Linux/macOS

  cd python-docs-samples/appengine/standard_python3/django

Windows

  cd python-docs-samples\appengine\standard_python3\django

Setting up your local environment

When deployed, your app uses the Cloud SQL Proxy that is built in to the App Engine environment to communicate with your Cloud SQL instance. However, to test your app locally, you must install and use a local copy of the proxy in your development environment.

Learn more about the Cloud SQL Proxy.

To perform basic admin tasks on your Cloud SQL instance, you can use the PostgreSQL client.

Installing the Cloud SQL Proxy

Download and install the Cloud SQL Proxy. The Cloud SQL Proxy connects to your Cloud SQL instance when running locally.

Linux 64-bit

Download the Cloud SQL Auth proxy:

wget https://dl.google.com/cloudsql/cloud_sql_proxy.linux.amd64 -O cloud_sql_proxy

Make the Cloud SQL Auth proxy executable:
```
chmod +x cloud_sql_proxy
```

Linux 32-bit

Download the Cloud SQL Auth proxy:

wget https://dl.google.com/cloudsql/cloud_sql_proxy.linux.386 -O cloud_sql_proxy

Make the Cloud SQL Auth proxy executable:
```
chmod +x cloud_sql_proxy
```

macOS 64-bit

Download the Cloud SQL Auth proxy:

curl -o cloud_sql_proxy https://dl.google.com/cloudsql/cloud_sql_proxy.darwin.amd64

Make the Cloud SQL Auth proxy executable:
```
chmod +x cloud_sql_proxy
```

macOS 32-bit

Download the Cloud SQL Auth proxy:

curl -o cloud_sql_proxy https://dl.google.com/cloudsql/cloud_sql_proxy.darwin.386

Make the Cloud SQL Auth proxy executable:
```
chmod +x cloud_sql_proxy
```

Windows 64-bit

Right-click https://dl.google.com/cloudsql/cloud_sql_proxy_x64.exe and select Save Link As to download the Cloud SQL Auth proxy. Rename the file to cloud_sql_proxy.exe.

Windows 32-bit

Right-click https://dl.google.com/cloudsql/cloud_sql_proxy_x86.exe and select Save Link As to download the Cloud SQL Auth proxy. Rename the file to cloud_sql_proxy.exe.

Cloud SQL Auth proxy Docker image

For convenience, the Cloud SQL team maintains several container images that contain the Cloud SQL Auth proxy for use by our customers. For more information about these images, see the Cloud SQL Auth proxy repo on GitHub. You can pull the latest image to your local machine using Docker with the following command:

docker pull gcr.io/cloudsql-docker/gce-proxy:1.19.1

Other OS

For other operating systems not included here, you can compile the Cloud SQL Auth proxy from source.

Creating a Cloud SQL instance

Create a Cloud SQL for MySQL Second Generation instance.
Name the instance polls-instance or similar. It can take a few minutes for the instance to be ready. When the instance is ready, it's visible in the instances list.

Use the Cloud SDK to run the following command where [YOUR_INSTANCE_NAME] represents the name of your Cloud SQL instance:
```
gcloud sql instances describe [YOUR_INSTANCE_NAME]
```
In the output, note the value shown for [CONNECTION_NAME].

The [CONNECTION_NAME] value is in the format [PROJECT_NAME]:[REGION_NAME]:[INSTANCE_NAME].

Initializing your Cloud SQL instance

Start the Cloud SQL Proxy by using the [CONNECTION_NAME] value from the previous step:
Linux/macOS
```
./cloud_sql_proxy -instances="[YOUR_INSTANCE_CONNECTION_NAME]"=tcp:3306
```
Windows
```
cloud_sql_proxy.exe -instances="[YOUR_INSTANCE_CONNECTION_NAME]"=tcp:3306
```
Replace [YOUR_INSTANCE_CONNECTION_NAME] with the [CONNECTION_NAME] value that you recorded in the previous step.

This step establishes a connection from your local computer to your Cloud SQL instance for local testing purposes. Keep the Cloud SQL Proxy running the entire time you test your app locally.
Create a Cloud SQL user and database:
Cloud Console
1. Create a new database by using the Cloud Console for your Cloud SQL instance polls-instance. For example, you can use the name polls.
2. Create a new user by using the Cloud Console for your Cloud SQL instance polls-instance.
MySQL client
1. In a separate command-line tab, use the MySQL client or similar program to connect to your instance. When prompted, use the root password you configured.
```
mysql --host 127.0.0.1 --user root --password
```
2. Create the required databases, users, and access permissions in your Cloud SQL database using the following commands. Replace [MYSQL_USER] and [MYSQL_PASSWORD] with the username and password you want to use.
```
CREATE DATABASE polls;
CREATE USER '[MYSQL_USER]' IDENTIFIED BY '[MYSQL_PASSWORD]';
GRANT ALL ON . TO '[MYSQL_USER]';
```

Configuring the database settings

Open mysite/settings.py for editing.
1. To help set up the connection to the database for both App Engine deployment and local testing, set <your-database-user> and <your-database-password> to the username and password you created previously in the step Creating a Cloud SQL instance.
2. Get the values for your instance:
```
gcloud sql instances describe [YOUR_INSTANCE_NAME]
```
3. From the output, copy the connectionName value for use in the next step.
4. Set <your-cloudsql-connection-string> to the connectionName from the previous step.
5. Set [YOUR-DATABASE] to the name you chose during the Initialize your Cloud SQL instance step.
Close and save settings.py.

Running the app on your local computer

To run the Django app on your local computer, set up a Python development environment, including Python, pip, and virtualenv.

Create an isolated Python environment, and install dependencies:

Linux/macOS

virtualenv env
source env/bin/activate
pip install -r requirements.txt

Windows

virtualenv env
env\scripts\activate
pip install -r requirements.txt

Run the Django migrations to set up your models:

python manage.py makemigrations
python manage.py makemigrations polls
python manage.py migrate

Start a local web server:
```
python manage.py runserver
```
In your browser, go to http://localhost:8000:
```
http://localhost:8000
```
The page displays the following text: "No polls are available." The Django web server running on your computer delivers the sample app pages.
Press Control+C to stop the local web server.

Using the Django admin console

Create a superuser. You need to define a username and password.
```
python manage.py createsuperuser
```
Start a local web server:
```
python manage.py runserver
```
In your browser, go to http://localhost:8000/admin.
```
http://localhost:8000/admin
```
Log in to the admin site using the username and password you used when you ran createsuperuser.

Deploying the app to the App Engine standard environment

Gather all the static content into one folder by moving all of the app's static files into the folder specified by STATIC_ROOT in settings.py:
```
python manage.py collectstatic
```
Upload the app by running the following command from within the python-docs-samples/appengine/standard_python3/django directory of the app where the app.yaml file is located:
```
gcloud app deploy
```
Wait for the message that notifies you that the update has completed.

Seeing the app run in Google Cloud

The following command deploys the app as described in app.yaml and sets the newly deployed version as the default version, causing it to serve all new traffic.

In your browser, enter the following URL:

https://PROJECT_ID.REGION_ID.r.appspot.com

Replace the following:
- PROJECT_ID: Your Google Cloud project ID
- REGION_ID: A code that App Engine assigns to your app

Your request is served by a web server running in the App Engine standard environment.

If you update your app, you deploy the updated version by entering the same command that you used to deploy the app. The deployment creates a new version of your app and promotes it to the default version. The earlier versions of your app remain. All of these app versions are billable resources. To reduce costs, delete the non-default versions of your app.

For information about deleting the non-default versions of your app, see Cleaning up.

Production

When you are ready to serve your content in production, in mysite/settings.py, change the DEBUG variable to False.

Understanding the code

The Django sample app was created using standard Django tooling.

The following commands create the project and the polls app:

django-admin startproject mysite

python manage.py startapp polls

The settings.py file contains the configuration for your SQL database. The code in settings.py uses the GAE_APPLICATION environment variable to determine whether the app is running on App Engine or running on your local computer:

When the app runs on App Engine, it connects to the MySQL host by using the /cloudsql Unix socket.
When the app runs on your local computer, it connects to the MySQL host by using TCP, which requires a username and password.

appengine/standard_python3/django/mysite/settings.py

View on GitHub

if os.getenv('GAE_APPLICATION', None):
    # Running on production App Engine, so connect to Google Cloud SQL using
    # the unix socket at /cloudsql/<your-cloudsql-connection string>
    DATABASES = {
        'default': {
            'ENGINE': 'django.db.backends.mysql',
            'HOST': '/cloudsql/[YOUR-CONNECTION-NAME]',
            'USER': '[YOUR-USERNAME]',
            'PASSWORD': '[YOUR-PASSWORD]',
            'NAME': '[YOUR-DATABASE]',
        }
    }
else:
    # Running locally so connect to either a local MySQL instance or connect to
    # Cloud SQL via the proxy. To start the proxy via command line:
    #
    #     $ cloud_sql_proxy -instances=[INSTANCE_CONNECTION_NAME]=tcp:3306
    #
    # See https://cloud.google.com/sql/docs/mysql-connect-proxy
    DATABASES = {
        'default': {
            'ENGINE': 'django.db.backends.mysql',
            'HOST': '127.0.0.1',
            'PORT': '3306',
            'NAME': '[YOUR-DATABASE]',
            'USER': '[YOUR-USERNAME]',
            'PASSWORD': '[YOUR-PASSWORD]',
        }
    }

The app.yaml file contains configuration information for deployment to App Engine. This app.yaml file specifies that App Engine serves static files from the static/ directory:

appengine/standard_python3/django/app.yaml

View on GitHub

runtime: python39

handlers:
# This configures Google App Engine to serve the files in the app's static
# directory.
- url: /static
  static_dir: static/

# This handler routes all requests not caught above to your main app. It is
# required when static routes are defined, but can be omitted (along with
# the entire handlers section) when there are no static files defined.
- url: /.*
  script: auto

Running Django on the App Engine standard environment

Before you begin

Log in to gcloud

Downloading and running the app

Cloning the Django app

Linux/macOS

Windows

Setting up your local environment

Installing the Cloud SQL Proxy

Linux 64-bit

Linux 32-bit

macOS 64-bit

macOS 32-bit

Windows 64-bit

Windows 32-bit

Cloud SQL Auth proxy Docker image

Other OS

Creating a Cloud SQL instance

Initializing your Cloud SQL instance

Linux/macOS

Windows

Cloud Console

MySQL client

Configuring the database settings

Running the app on your local computer

Linux/macOS

Windows

Using the Django admin console

Deploying the app to the App Engine standard environment

Seeing the app run in Google Cloud

Production

Understanding the code