Cloud SQL for PostgreSQL FAQ

About

What is Cloud SQL?
Cloud SQL is a service that delivers fully managed SQL databases in the cloud. Cloud SQL provides PostgreSQL, SQL Server, and MySQL databases.
What are the benefits of using Cloud SQL?
Cloud SQL lets you hand off to Google the mundane, but necessary and often time consuming tasks — like applying patches and updates, managing backups and configuring replications — so you can put your focus on building great applications. And because we use standard wire protocols, you can connect from just about any application, anywhere.
Which database versions are available with Cloud SQL? How are updates managed?

Cloud SQL for PostgreSQL supports PostgreSQL 9.6, 10, 11, 12, 13, 14, 15, 16 (default), and 17.

Minor version updates are deployed as part of scheduled maintenance, with no further action required on your part. For more information about updates, see Overview of maintenance on Cloud SQL instances.

To see the current version of your instance, go to the Google Cloud console, click the instance name to open the Instance details page. Or, you can use the gcloud sql instances describe command.

Does Cloud SQL support all database features?
Cloud SQL supports most common features of PostgreSQL. For a list of all differences between standard PostgreSQL and the functionality Cloud SQL provides, see Differences between Cloud SQL and standard PostgreSQL functionality.
Are there any size or QPS limits?
There are no queries per second (QPS) limits for Cloud SQL instances. For information about connection, size, and App Engine-specific limits, see Quotas and Limits.
How can I be notified when there are any changes to Cloud SQL?
You can sign up for the google-cloud-sql-announce forum where we post announcements and news about Cloud SQL.
How do I report a bug, request a feature, or ask a question?
You can report bugs and request a feature on our google-cloud-sql-discuss group. You can ask a question in Stack Overflow. For other support options, see the Cloud SQL Support page.
Back to top

Getting Started

Why does my new instance with no data show disk space used?
Cloud SQL and the database both use some space for system files and metadata when your instance is created.
Back to top

Data Storage, Replication, and Authentication

Where is my data stored?

Instance data is stored in the region where the instance resides. If you do not specify a storage location, your backups are stored in the multiregion that is geographically closest to the location of your Cloud SQL instance. For example, if your Cloud SQL instance is in us-central1, your backups are stored in the us multi-region by default. However, a default location like australia-southeast1 is outside of a multi-region. The closest multi-region is asia.

What is a zone?

A zone is an independent entity in a specific geographical location where you can run your resources. For example, a zone named us-central1-a indicates a location in the central United States.

For more information about zones, see Zone Resources in the Compute Engine documentation.

What are the limits on storage?
For information on storage limits, see Quotas and Limits.
How is my data replicated?

PostgreSQL instances provide a high availability configuration and read replicas.

What kind of read replicas can I create?

For more information about read replicas, including use cases for each type, see Replication Options.

How does Cloud SQL failover work?

For information about failover, see Overview of the High Availability Configuration.

Is my data encrypted?
Cloud SQL customer data is encrypted when stored in database tables, temporary files, and backups. External connections can be encrypted by using SSL, or by using the Cloud SQL Auth Proxy.
How is encryption managed for data at rest?

Your data is encrypted using the 256-bit Advanced Encryption Standard (AES-256), or better, with symmetric keys: that is, the same key is used to encrypt the data when it is stored, and to decrypt it when it is used. These data keys are themselves encrypted using a key stored in a secure keystore, and changed regularly.

For more details, see Encryption at Rest in Google Cloud.

How is encryption managed for data in transit?

Google encrypts and authenticates all data in transit at one or more network layers when data moves outside physical boundaries not controlled by Google or on behalf of Google. Data in transit inside a physical boundary controlled by or on behalf of Google is generally authenticated but might not be encrypted by default. If you connect to an instance using its public IP address, use SSL/TLS certificates, so the data is secure during transmission. You can choose which additional security measures to apply based on your threat model. For example, you can configure SSL for intra-zone connections to Cloud SQL.

For more details, see Encryption in Transit in Google Cloud.

Back to top

Data Migration

How are data and constraints migrated into Cloud SQL?
During the migration process, data is migrated first and the constraints (for example, primary keys, foreign keys, and indexes) are recreated on the instance later.
How can I migrate my data faster?
You can now migrate data in the tables of your database in parallel. There's a performance improvement because Cloud SQL can transfer the data with parallel processes within a database. You can set the speed that Cloud SQL transfers this data to min, optimal, or max. For more information, see Use a managed import to set up replication from external databases.
Back to top

Backup and Recovery

How do I recover an instance?

To restore to a backup you can use the Google Cloud console or the gcloud command-line tool. For more details, see Restoring an Instance.

To restore an instance to a specific point in time, you use a point-in-time recovery. For more information, see Use point-in-time recovery.

How much do backups cost?

Backups are charged at the instance storage rate.

For more information about instance storage pricing and instance rates, see Pricing.

Can I access automated backups older than seven days?

Automated backups occur every day and by default are retained for seven days. You can configure the backup retention value from one to 365 backups. At the end of retention period, the oldest backup is deleted. Automated backups are incremental. They contain only data that changed after the previous backup was taken. Your oldest backup is a similar size to your database. When the oldest backup is deleted, the size of the next oldest backup increases so that a full backup still exists.

Note that on-demand backups are not deleted until you manually remove them.

When do I use external versus cross-region replication for regional failure protection?
External replication Cross-region replication
Self managed by customer Cloud SQL managed cross region replica
Can replicate between non-Google Cloud and Google Cloud instances Can replicate only between Cloud SQL instances
To migrate to/from Google Cloud to minimize downtime or for hybrid/multi cloud data protection To migrate data between Google Cloud regions to minimize downtime
Supports cross major version replication Does not support cross major version replication
Back to top

Managing Your Instances

Which actions might cause Cloud SQL instances to restart?
Cloud SQL instances might be restarted when you or Cloud SQL takes the following actions:
  • Update
  • Create
  • Promote replica
  • Maintenance
  • Recreate replica
  • Failover
  • Restart
  • Restore instance from backup
  • Enable high availability on an existing instance (this is an update to the instance)
  • Add a database flag that requires a restart

Restarting an instance doesn't change the public or private IP addresses of the instance.

See the following section: How long are instances shut down during restart?

How long are instances shut down during restart?

When instances are restarted, the majority of them are shut down for one to two minutes. Before the instance is shut down, all connections are ended and current work is flushed from disk.

For instances with a large load, this process takes longer, and it might look like the instance is stuck. In these cases, it might take up to an hour for the instance to shut down and restart. Reasons for instances taking a long time to shut down and restart can include when the user has many write transactions or when the transactions run for a long time.

Can I make my database larger or smaller?

You can increase the amount of storage available to your instance at any time without incurring downtime. You cannot decrease the size of the storage of your instance. You can also configure your instance to automatically increase its storage capacity when space is running low. Learn more.

Can I upgrade and downgrade vCPUs?

Yes. You can change the number of vCPUs that you use on your instance. You can increase or decrease the number of cores you use as many times as you want. It typically takes less than five minutes of downtime to change the number of vCPUs. If you are increasing the number of vCPUs on your Cloud SQL Enterprise Plus edition primary instance, then the change takes effect with near-zero downtime.

Do I need to use the Google Cloud console to manage Cloud SQL?
No. All management tasks that can be done using the Console can also be done programmatically using the Cloud SQL Admin API, or scripted using the gcloud command-line tool.
How can I reclaim the space used by temporary files?
Temporary files can grow when SQL queries create many temporary tables. To reclaim the space used by temporary tables, you need to restart the database. Note that restarting the database does not reduce the provisioned disk space resulting from the growth of temporary files.
Can I import or export a specific database?
Yes. You can only import or export a specific database; you cannot import or export more than one database at a time. For more information, see Importing Data or Exporting Data.
Can I import or export a CSV file?
You can import or export a CSV file for MySQL or PostgreSQL. For more information, see Creating a CSV file.

CSV is not currently supported in Cloud SQL for SQL Server.

Do I need a Cloud Storage account to import or export data to an instance?
Cloud SQL supports importing and exporting databases using CSV or pg_dump files. For more information, see Exporting and importing using pg_dump and pg_restore or Exporting and importing using CSV files.
If I delete my instance, can I reuse the instance name?
Yes.
What level of transaction isolation does Cloud SQL provide?

PostgreSQL instances: Cloud SQL provides Read committed transaction isolation. You can change the transaction isolation level for a specific transaction, but usually the default value is preferred. For more information, see Transaction Isolation in the PostgreSQL documentation.

How can I protect my instance from accidental deletion?
You can enable deletion protection when you create an instance or at a later time. If this setting is enabled, you must disable it before deleting the instance. See Prevent deletion of an instance.
Back to top

Insights

Why can't I find the sample query plan in Insights?
We only have sample queries for getting the query plan, because of the performance impact it can have on the query. As a result, sometimes sample query plans do not appear.
Back to top

Pricing and Billing

How can I try out Cloud SQL?
The smallest instance is the db-f1-micro. You can use it to try out the service. Note that shared core instances are not covered by the SLA.
How many instances can I create in a project?
For information about the instance limit, see Quotas and Limits.
What size database instance do I need? How much RAM?
In general, you can increase the performance of your database by choosing a larger instance with more RAM and CPU. This increases the performance of many queries that involve large amounts of computation, such as those involving joins, ORDER BYs, or GROUPing, though the performance of updates affecting single rows will not be much affected. However, the bigger the size of the instance, the greater the operational latency. For more information about instance sizes and pricing, see the pricing page.
How is use of my instance calculated?

You are charged per minute for the time that your instance is on.

How is storage calculated?
Storage is calculated based on the amount of storage you have provisioned for your instance. Storage for backups is charged by how much space your backups are using. Storage is charged whether your instance is on or off.
How can I see how much I will be charged?
The Billing tab of the Google Cloud console shows you the charges your instances have incurred since the last bill was issued.
What happens when my instance reaches the allowed size?
If your instance reaches the provisioned storage size, and you do not have automatic storage increase enabled or it has reached its configured limit, future writes to the database are disallowed until you increase the storage size. Increasing the storage size does not require an instance restart or downtime.
Why is my instance suspended?
This is probably due to an issue with your Google Cloud account. You can determine your billing status by filing a Billing Support Request. After the billing issue is resolved, the instance returns to runnable status within a few hours. Note that suspended MySQL instances are deleted after 90 days.
Why was my instance deleted?
Instances that are suspended for 90 days are deleted. This applies to instances with a state of SUSPENDED. Instances that are stopped, with a state of RUNNABLE, are not deleted.
How can I cancel my Cloud SQL account?
You can deactivate Cloud SQL for a project by visiting the Google Cloud console, selecting the project, selecting the API service to open the API Dashboard. Find the Cloud SQL API and click Disable for that API.
How do I disable billing?
You can disable billing by clicking Disable billing in the Google Cloud console Billing & settings pane for a project. If you disable billing, you also disable the Cloud SQL service. Make sure you really want to disable the Cloud SQL service before you disable billing.

After you disable billing, you will receive one last bill for charges that occurred between the beginning of the billing cycle and when you cancelled.

Back to top

Using Cloud SQL with App Engine

Can I connect from App Engine to a PostgreSQL instance?
You can connect from an App Engine application to a PostgreSQL instance, depending on the environment and language you are using. For more information, see Connecting from App Engine standard environment, or Connecting from App Engine flexible environment.
Can my App Engine application in the US access my Cloud SQL instance in the EU (and the other way around)?

If you are connecting to a Cloud SQL instance, your App Engine application does not need to be in the same region. However, a larger distance between your Cloud SQL instance and your App Engine application causes greater latency for connections to the database.

Which Google Cloud database service is right for me?
This depends on the requirements of your application. Google Cloud offers a number of options for storing, managing and retrieving your data. For more information, see Google Cloud databases.
Do I need to install a local database server to use the App Engine Development Server?
No. You can configure App Engine to use either Cloud SQL or a locally installed database server when running on the development server.
What languages can I use to access my instance?
App Engine standard environment supports several languages that you can use to connect to your instances. For more information, see Connecting from App Engine standard environment, or Connecting from App Engine flexible environment.

If you are not using App Engine, you can use any language that has an associated connector or API.

Can I use Django with Cloud SQL?
Yes. Cloud SQL is compatible with Django. See Getting Started with Django.
Which placeholders can I use in my Python query string?
Python users can only use the %s format code in parameter substitution. Therefore, the following statement is invalid: cursor.execute('INSERT INTO entries (guestAge) VALUES (%d)', (age)).
How do I manage connections?

Managing your database connections effectively is an important aspect of database application development, including using connection pooling and exponential backoff. For examples of how to employ these techniques in a variety of languages and frameworks, see Managing database connections.

To learn more about instance connection limits, see Quotas and Limits.

What does a SQLException with message of "Invalid connection ID" mean?
It means that the connection is no longer open on the server and is discarded by the client.  You do not need to call 'close' on these connections; they are already closed.
Can I access my Cloud SQL instance programmatically outside of App Engine?
Yes. You can access Cloud SQL instances programmatically from external applications by using any supported language. See Connecting overview.
Back to top