Google Cloud release notes

The following release notes cover the most recent changes over the last 30 days. For a comprehensive list, see the individual product release note pages .

You can see the latest product updates for all of Google Cloud on the Google Cloud release notes page.

To get the latest product updates delivered to you, add the URL of this page to your feed reader, or add the feed URL directly: https://cloud.google.com/feeds/gcp-release-notes.xml

October 21, 2020

Cloud SQL for MySQL

Cloud SQL for MySQL supports binary logging on read replicas for MySQL versions 5.7 and 8.0.

October 20, 2020

Cloud Load Balancing

For HTTP requests, the httpRequest.remoteIp and httpRequest.serverIp fields can include port information. For example 10.0.0.1:80.

Cloud Logging

Recent queries is now generally available (GA). To learn more, go to Recent queries.

October 19, 2020

BigQuery

BigQuery Audit Logs stopped using the following checks for redacting resource names for cross-project access and caller identities: The bigquery.jobs.create permission check and the internal setting for a project domain. Please review the documentation at Caller identities and resource names.

Cloud Logging

In the Logs Explorer you can now download your logs in JSON and CSV to your computer, Google Drive, or view them in a new tab. To learn more, see Downloading logs.

Cloud Run

Cloud Run is now available in the following regions:

asia-east2 (Hong Kong)
asia-northeast3 (Seoul, South Korea)
asia-southeast2 (Jakarta)
asia-south1 (Mumbai, India)
europe-west2 (London, UK)
europe-west3 (Frankfurt, Germany)
europe-west6 (Zurich, Switzerland)
southamerica-east1 (Sao Paulo, Brazil)

You can now purchase a custom domain via Cloud Domains using the Cloud Run user interface.

Compute Engine

Memory-optimized M1 machine types are available in Frankfurt europe-west3-a,b,c. Memory-optimized M2 machine types are available in Frankfurt, europe-west3-a,b. See VM instance pricing for details.

Dataproc

Announcing the GA (General Availability) release of the Dataproc Ranger Optional Component and the Dataproc Solr Optional Component.

Istio on Google Kubernetes Engine

A fix for a known issue where custom resources created in the istio-system namespace were deleted when upgrading from GKE 1.16 to 1.17 and 1.18 is available in R33.

Upgrade to one of the following unaffected versions:

1.17.12-gke.1501 and higher
1.18.9-gke.1501 and higher

The issue only occurs during upgrades, so new clusters created in earlier versions are also unaffected.

Pub/Sub

Pub/Sub message ordering is now available in GA.

October 16, 2020

Cloud Bigtable

A tutorial is now available that demonstrates how to send a Cloud Bigtable read request using a Cloud Functions HTTP(S) request.

Cloud Vision

LABEL_DETECTION model upgrade

The LABEL_DETECTION model will undergo an upgrade over the next 90 days to a newer version. The API interface and client library will be the same as with the previous version. The API follows the same Service Level Agreement.

Please note that you have 30 days from today to test the new model by specifying "builtin/latest" in the model field of the Feature object while requesting image annotation. At the end of that period, it will be promoted to the default model accessible as "builtin/stable". After that event, the original model will still be available for another 60 days using "builtin/legacy".

If you encounter problems with this upgrade, please contact Vision API engineering team by submitting a ticket in the private issue tracker.

Dataproc

Announcing the GA (General Availability) release of the Dataproc - Docker Optional Component and the Dataproc - Flink Optional Component.

Document AI

Document AI Preview released

The following beta and preview features are available in API version v1beta3:

General processors: Document OCR (Optical Character Recognition), form parser, and document splitter.
Lending processors: W9, 1040, W2, 1099-MISC, and 1003 parsers, as well as lending document splitter & classifier.

Identity and Access Management

Credential Access Boundaries are now generally available. Use Credential Access Boundaries to downscope the permissions that a short-lived credential can use to access a Cloud Storage bucket.

October 15, 2020

Cloud Bigtable

The steps to create a new Cloud Bigtable instance and edit an existing instance have been streamlined and improved in the Google Cloud Console.

Cloud Billing

Discount sharing for committed use discounts is now Generally Available. With discount sharing enabled, you can apply your purchased commitments across multiple projects within a single Cloud Billing account. Discount sharing helps you minimize the overhead of managing each of your commitments individually and provides increased flexibility so that you can use the compute options that best suit your needs, while also increasing cost predictability.

For more information about enabling committed use discount sharing, see Turning on committed use discount sharing.
For more information on the possible cost savings using committed use discount sharing, see Understanding discount sharing.

Cloud Composer

New versions of Cloud Composer images: composer-1.12.3-airflow-1.10.6, composer-1.12.3-airflow-1.10.9, and composer-1.12.3-airflow-1.10.10. The default is composer-1.12.3-airflow-1.10.9. Upgrade your Cloud SDK to use features in this release.

Cloud Build logs from the tenant project are now published in the Composer logs. They are available under the log name build-log-webserver.
Airflow DAG processor manager logs are now published in the Composer logs. They are available under the log name dag-processor-manager.
If an update operation fails, links to the specific Cloud Build log will now be included in the error message.
Compatibility with Domain Restricted sharing has been improved. Upgrading your environment to the newest version of Composer can now enable or disable its compatibility with Domain Restricted Sharing based on your organization policy.

Setting or updating the machine type of the Airflow web server or Cloud SQL instance in Composer versions that don't support this feature (older than composer-1.7.2) will now return an error instead of failing silently.
Environments will now fall back to the in-cluster build when PyPI package installation fails due to Cloud Build unavailability under your VPC Service Controls configuration.
Airflow 1.10.10:
- Fixed an issue with async DAG bag loading.
- Task instance details will now render properly, even if there are no DAG runs related to the instance.

Cloud Run

You can now specify a minimum number of container instances to be kept warm and ready to serve requests, for services requiring reduced latency and fewer cold starts.

Cloud Spanner

A new multi-region instance configuration is now available in North America - nam9 (North Virginia/Iowa/South Carolina/Oregon).

Compute Engine

Support for 1500 MTU in VPC networks is now Generally available.

Config Connector

Support export sub-command in the config-connector CLI

Add support for the AccessContextManagerServicePerimeter resource

Add support for Folder-level IAM Audit Configs

Fix deadLetterTopicRef in the PubSubSubscription resource (Issue #281)

Identity and Access Management

If a role binding in an IAM policy refers to a deleted member (for example, deleted:user:tamika@example.com?uid=123456789012345678901), you can now add role bindings for a newly created member with the same name (in this case, user:tamika@example.com). The role bindings always apply to the newly created member.

For details, see the documentation for policies with deleted members.

Virtual Private Cloud

Support for 1500 MTU in VPC networks is now available in General Availability.

October 14, 2020

BigQuery

Dynamic SQL is now generally available (GA). Dynamic SQL lets you generate and execute SQL statements dynamically at runtime. For more information, see EXECUTE IMMEDIATE.

BigQuery standard SQL now supports the following new functions. These functions are generally available (GA).

ASCII
CHR
INITCAP
INSTR
LAST_DAY
LEFT
OCTET_LENGTH
REGEXP_EXTRACT with 2 additional parameters (position and occurrence)
REGEXP_INSTR
REGEXP_SUBSTR
RIGHT
SOUNDEX
TRANSLATE
UNICODE

BigQuery now supports the following new statements. These statements are generally available (GA).

BigQuery standard SQL now supports DATE arithmetics operators.

The following INFORMATION_SCHEMA views are now generally available (GA).

BigQuery now supports Unicode table names. For more information, see Table naming.

Queries can now have duplicate column names.

Cloud VPN

Classic VPN partial deprecation

Starting on October 31, 2021, you will no longer be able to do the following:

Create new Classic VPN tunnels using static routing (route based or policy based) that connect to another Classic VPN gateway
Create new Classic VPN tunnels using static routing (route based or policy based) that connect a Google Cloud Virtual Private Cloud (VPC) network to another cloud provider's network
Create new Classic VPN tunnels using dynamic routing (all configurations)

You can continue to create the following types of connections and get support for them:

VPN tunnels using static routing from Classic VPN gateways to on-premises VPN gateways and from on-premises VPN gateways to Classic VPN gateways
VPN tunnels using static routing from a Classic VPN gateway to and from a Compute Engine virtual machine (VM) acting as a VPN gateway

Although Google will not proactively disable existing connections on the deprecation date, deprecated Classic VPN configurations will no longer receive regular updates or maintenance.

For more information, see the Classic VPN partial deprecation page for a video tutorial and documentation to help you migrate, as soon as possible, to our more reliable High Availability Cloud VPN solution.

Compute Engine

Compute-optimized (C2) machine types are now available in the following regions and zones:

Finland: europe-north1-a,b,c
Seoul: asia-northeast3-a,b,c

See VM-instance-pricing for details.

Identity Platform

October 13, 2020

Anthos Service Mesh

1.4.10-asm.19 is now available

You can now allow an experimental feature to exceed 4GB of memory usage.

Cloud Functions

In runtimes that use buildpacks you can now configure aspects of your build by setting build configuration variables. See Using Environment Variables for more information. In Preview.

Cloud Run

You can now control egress traffic from a service and route all outbound requests to your VPC network. This allows you to configure a static outbound IP address by leveraging Cloud NAT.

Cloud Run for Anthos

Cloud Run for Anthos on Google Cloud version 0.17.2-gke.1 is now available for the following GKE minor version:

1.16
Fixes the security issue, ISTIO-SECURITY-2020-010 for Cloud Run for Anthos on Google Cloud clusters running on 1.15+ k8s version.

Cloud Spanner

CHECK constraints is now generally available, allowing you to define a boolean expression on the columns of a table and require that all rows in the table satisfy the expression. For more information, see Creating and managing check constraints.

Generated columns support is now generally available, allowing you to define columns that are computed from other columns in a row. For more information, see Creating and managing generated columns.

Cloud Talent Solution Job Search

Cloud Talent Solution has launched the v4 version of the API. Migrate to Cloud Talent Solution v4 by October 14, 2021 to continue using Cloud Talent Solution.

As of today Cloud Talent Solution versions v3, v3p1beta1, and v4beta1 are deprecated. Deprecated means that these versions will continue to work until October 13, 2021, at which time these versions will be shut down. Migrate to Cloud Talent Solution v4 by October 14, 2021 to continue using Cloud Talent Solution.

When using orderBy to order job search results by distance_from from the search location, equidistant jobs from the center of the search location will be tie-broken based on each job's relevance to the search keywords. Previously, jobs in this scenario weren't primarily tie-broken based on each job's relevance to the search keywords.

When using the EmploymentType as part of HistogramQuery, facet counts for CONTRACTOR no longer also include facet counts for CONTRACT_TO_HIRE.

HistogramQuery facet counts no longer differ from the number of jobs returned when filtering search results by a given facet.

CTS has made improvements to the handling of accented characters and gendered terms in job titles and search keywords.

Dataproc

New sub-minor versions of Dataproc images: 1.3.72-debian10, 1.3.72-ubuntu18, 1.4.43-debian10, 1.4.43-ubuntu18, 1.5.18-debian10, 1.5.18-ubuntu18, 2.0.0-RC14-debian10, and 2.0.0-RC14-ubuntu18.

Storage Transfer Service

Obtaining the status of the latest transfer operation is in Preview.

October 12, 2020

Anthos GKE on AWS

GKE on AWS 1.5.0 supports volume snapshots.

Cloud Logging

Cloud Logging has deprecated the following two logs-based metrics related to exclusions:

logging.googleapis.com/excluded_log_entry_count
logging.googleapis.com/excluded_byte_count

Cloud Logging will stop populating these metrics on October 1, 2021.

Cloud Run

You can now allocate 4 vCPUs to container instances of Cloud Run services.

Cloud SQL for MySQL

Cloud SQL now offers "deny maintenance periods". With deny maintenance periods, you can prevent automatic maintenance from occurring during a specific time period. For example, the end-of-year holiday season is a time of peak load that requires heightened focus on infrastructure stability for many retail businesses. By setting a deny maintenance period from mid-October to mid-January, these businesses can prevent planned upgrades from Cloud SQL during their busiest time of year.

Cloud SQL for PostgreSQL

Cloud SQL for PostgreSQL now offers IAM database authentication to help you better monitor and manage access for users and service accounts to databases. This feature allows users and service accounts to use IAM credentials to log into PostgreSQL instances. To learn more about how IAM database authentication works, see the Overview of Cloud SQL IAM database authentication. To configure an instance, see Configuring instances for IAM database authentication. To create users or service accounts, see Creating and managing users that use IAM database authentication.

Database auditing in Cloud SQL for PostgreSQL is available through the open-source pgAudit extension. Using this extension, you can selectively record and track SQL operations performed against a given database instance.

The pgAudit extension helps you configure many of the logs often required to comply with government, financial, and ISO certifications.

Cloud SQL for SQL Server

Compute Engine

N2 machine types are now available in the following four regions and zones:

Las Vegas: us-west4-a,b,c
Montréal: northamerica-northeast1-a,b,c
Finland: europe-north1-a
Hong Kong: asia-east2-a,b,c

For pricing details, see VM instance pricing.

Migrate for Compute Engine

Support added for migration of VMs from vSphere configured with CSM firmware type setting.

Resource Manager

You can now customize who receives notifications from GCP with Essential Contacts. This feature is available in preview. For more information, see Managing contacts for notifications.

October 11, 2020

Cloud Run

When a container instance needs to be shut down, it now receives a SIGTERM signal. If handled, CPU is allocated for up to 10 seconds before the container is shut down.

October 09, 2020

Identity and Access Management

The documentation now provides details about service agents for all publicly available services. A service agent is a special type of service account that is created and managed by Google, and is used by Google Cloud services to access your resources.

Pub/Sub

Pub/Sub Lite is now available in GA.

October 08, 2020

Cloud Billing

Cloud Billing budget settings have been updated to support credits by credit type. We have added all possible Cloud Billing credit types to the budget scope, allowing you to set your budget amount to include or exclude specific credits by type, such as promotional credits, committed use discounts, and free tiers. Previously, the credits setting was an optional checkbox when setting the budget amount — the Include credits in cost option — and not the granular options now available in the budget scope. The previous credits checkbox setting could only include either all of the available credits or none of the credits.

For budgets that were set up before the granular credits budget scope feature became available:

In the budget amount, if you had enabled the Include credits in cost option, then all credits are included in the cost calculation.
In the budget amount, if you had deselected the Include credits in cost option, then none of the credits are included in the cost calculation.

To implement the new credits scope feature in existing budgets, edit the budget's credit settings.

Read more about credits and budget scope options in our documentation.

Cloud Healthcare API

The Consent Management API is available in beta.

Cloud Load Balancing

External HTTP(S) Load Balancing is now supported for App Engine, Cloud Functions, and Cloud Run services. To configure this, you will need to use a new type of network endpoint group (NEG) called a Serverless NEG.

This feature is now available in General Availability.

Cloud Spanner

The following updates to Cloud Spanner standard SQL are now available :

Support for SELECT * REPLACE and SELECT * EXCEPT syntax.
Documentation for Net functions.

Security Command Center

Event Threat Detection, a built-in service of Security Command Center Premium, now includes two new detectors to monitor your organization's BigQuery resources. The detectors identify data exfiltration - resources saved outside of your organization or attempts to access protected data.

Read more about available detectors in Event Threat Detection conceptual overview.

The Security Command Center API now includes a severity field for Findings. This feature is available using Security Command Center's v1p1beta1 API.

October 07, 2020

Cloud Billing

Project-level tax information in BigQuery Export tables: Starting on September 1 2020, your daily cost detail data in BigQuery shows taxes broken down by project, instead of aggregating taxes into a single line item. You don't need to make any changes to access the data.

If you have queries or visualizations that depend on tax data, you might need to update the queries to account for these changes.

Learn about viewing your tax data in BigQuery.

Cloud Composer

New versions of Cloud Composer images: composer-1.12.2-airflow-1.10.6, composer-1.12.2-airflow-1.10.9, and composer-1.12.2-airflow-1.10.10. The default is composer-1.12.2-airflow-1.10.9. Upgrade your Cloud SDK to use features in this release.

Added the log entry labels version_id and instance_id to differentiate the logs of different Airflow web server instances.
Airflow database upgrade logs are now published in the Composer logs under a separate log name.
Cloud Storage syncing logs are now published together in the Composer logs under a separate log name. They can be separated based further on pod_id.

Fixed upgrade rollback failures due to a mismatch in API versions error.
Improved handling of errors caused by a missing plugins/ directory in the Cloud Storage bucket.
Backported an Airflow change that fixes an issue with Airflow 1.10.9 and 1.10.10 that causes MySQL to deadlock on the rendered_task_instance_fields table when using DAG serialization.
Fixed a bug that undercharged customers for App Engine storage.
Backfilled GKE API versions to make older Composer environments GKE 1.16-proof.
Fixed an issue that caused bq load commands for files larger than 100MB to fail with a RedirectMissingLocation error.

Cloud Healthcare API

The Cloud Healthcare API offers single-region support in the southamerica-east1 (Osasco (São Paulo), Brazil) region.

The Cloud Healthcare API offers single-region support in the australia-southeast1 (Sydney, Australia) region.

Config Connector

Add support for the DataflowFlexTemplateJob resource

Add the transformNameMapping field to DataflowJob

Add the auditConfigs field to IAMPolicy

Add the loadBalancerType, datapathProvider, and notificationConfig fields to ContainerCluster

Add the artifacts and options fields to CloudBuildTrigger

Add support for the GRPC protocol for ComputeBackendService

Add logic to auto-trigger server-side apply metadata on resources on K8s clusters with server-side apply enabled (i.e. K8s 1.16+)

Fix issue where kubectl get gcp did not include IAMPolicy, IAMPolicyMember, and IAMAuditConfig resources (Issue #286)

October 06, 2020

BigQuery

Authorized user-defined functions (UDFs) are now generally available (GA). Authorized UDFs let you share query results without giving access to the underlying tables. For more information, see Authorized UDFs.

The Cloud Console now lets you opt in to search and autocomplete powered by Data Catalog. This feature is in beta.

Cloud NAT

The ability to enable or disable Endpoint-Independent Mapping for your gateway is now available in Preview.

Cloud Run

Cloud Run now supports request timeouts up to 60 minutes. However, timeouts greater than 15 minutes are a beta feature.

Dataproc

New sub-minor versions of Dataproc images: 1.3.71-debian10, 1.3.71-ubuntu18, 1.4.42-debian10, 1.4.42-ubuntu18, 1.5.17-debian10, 1.5.17-ubuntu18, 2.0.0-RC13-debian10, and 2.0.0-RC13-ubuntu18.

Image 1.4

Upgraded Spark to version 2.4.7.

Image 1.5

Upgraded Spark to version 2.4.7.
Installed google-cloud-bigquery-storage package by default in the Anaconda component.
Changed default value of zeppelin.notebook.storage in zeppelin-site.xml to "org.apache.zeppelin.notebook.repo.GCSNotebookRepo".

Image 2.0

Updated HBase to version 2.2.6.
Installed google-cloud-bigquery-storage in default conda environment.
Changed default value of zeppelin.notebook.storage in zeppelin-site.xml to "org.apache.zeppelin.notebook.repo.GCSNotebookRepo".

Istio on Google Kubernetes Engine

There is a known issue with the upgrade from GKE 1.16 to 1.17. Any custom resources you created in the istio-system namespace are deleted during an upgrade to 1.17. These resources must be manually recreated. We recommend not upgrading clusters with the Istio addon to 1.17 until the fix is rolled out. The issue only occurs during upgrades, so new clusters are not affected.

The fix was not included in release R31 as previously reported

Memorystore for Redis

Added support for Redis AUTH to Memorystore for Redis.

October 05, 2020

Cloud Monitoring

Alerting is now available for Monitoring Query Language (MQL). For more information, see Alerting policies with MQL

Compute Engine

You can use OS Login in VPC Service Controls. This feature is in Beta stage support.

Container Registry

Starting October 5, the Container Registry Service Agent is granted the Container Registry Service Agent IAM role by default when you enable the Container Registry API. Previously, this account was granted the Editor role.

To learn more about this change and how to update the role on an existing Container Registry service account with Editor permissions, see the Container Registry access control documentation

VPC Service Controls

Beta stage support for the following integration:

OS Login

October 02, 2020

Anthos GKE on AWS

Anthos GKE on-AWS 1.5.0-gke.6 is now available and clusters run on 1.16.15-gke.700 and v1.17.9-gke.2800. To upgrade your clusters, perform the following steps:

Upgrade your Management service to 1.5.0-gke.6.
Upgrade your user clusters to 1.16.15-gke.700 or v1.17.9-gke.2800

Workload identity (preview) lets you bind Kubernetes service accounts to AWS IAM accounts with specific permissions. Workload identity blocks unwanted access to cloud resources with AWS IAM permissions. With workload identity, you can assign different IAM roles to each workload. Fine grained permissions control allows you to follow the principle of least privilege. For more details, see Creating a user cluster with workload identity

You can now route traffic from the GKE on AWS management service and Connect through an HTTP/HTTPS proxy. For more details, see Using a proxy with GKE on AWS

Improved installation experience

This version enables installation and upgrade by using any Google Cloud–authenticated service account. You no longer need to be on the allowlist to access GKE on AWS components..
Additional preflight checks enforce enablement of required Google Cloud APIs. See Google Cloud requirements for more information.

When creating multiple multiple management clusters, users may have seen name collisions with S3 bucket. Now, you can specify a custom name for your S3 bucket to avoid naming conflicts.

Compute Engine

N2D machine types are available in The Dalles, Oregon, in the us-west1-c zone. For more information, see the VM instance pricing page.

C2 machine types are now available in Sydney, Australia australia-southeast1-b. See the VM instance pricing page for details.

Config Connector

Added Cloud IAM support for ComputeImage.

Fixed an issue where an IAMPolicy cannot be deleted when the externally referenced resource does not exist.

Fixed an infinite diff condition on spec.minMasterVersion.

Istio on Google Kubernetes Engine

There is a known issue with the upgrade from GKE 1.16 to 1.17 versions lower than 1.17.9-gke.6300 (R30 or earlier). Any custom resources you created in the istio-system namespace are deleted during an upgrade to 1.17 (R30 or earlier). These resources must be manually recreated. We recommend that you upgrade only to R31 or a later version that doesn't have the issue. The issue only occurs during upgrades, so new clusters are not affected.

October 01, 2020

BigQuery

BigQuery table-level access control is now generally available. For more information, see Introduction to table access controls .

Cloud CDN

Added a new tutorial for delivering HTTP and HTTPS content over the same hostname when using Cloud CDN. While many browsers enforce the use of Transport Layer Security (TLS) and disallow non-secure content delivery, there are still use cases where non-secure delivery and secure delivery must be allowed over the same hostname.

Cloud Load Balancing

Compute Engine

N2D machine types are now available in all three zones of us-east1-b,c,d in Moncks Corner, South Carolina. See VM instance pricing for details.

Dataproc

Launched Dataproc integration with Compute Engine sole-tenant nodes, which allows users to create a cluster in a sole-tenant node group.

Memorystore for Redis

Added Cloud Console UI support for creating Redis instances with Shared VPC using private services access.

September 30, 2020

Cloud Data Fusion

This release is in parallel with the CDAP 6.2.2 release.

Cloud Data Fusion now supports autoscaling Dataproc clusters.

Cloud Data Fusion now displays the number of pending preview runs, if any, before the current run. In the Studio, the number of pending runs is displayed under the timer.

Improved performance for skewed joins by including Distribution in the Joiner plugin settings.

Wrangler now supports BigQuery views and materialized views.

Cloud Run for Anthos

Cloud Run for Anthos on Google Cloud version 0.17.2-gke.1 is now available for the following GKE minor version:

1.17

Cloud Talent Solution Job Search

Cloud Talent Solution's consumption pricing and quota limits will change effective January 4, 2021. The new pricing and quota limits are intended to better address the variety of use cases the talent industry has for managing and searching for jobs.

Dataflow

Dataflow now supports Flex Templates in GA.

Dataproc

Creating clusters and instantiating workflow requests that succeed even when the requester did not have ActAs permission on the service account now generate a warning field in the audit log request.

New sub-minor versions of Dataproc images: 1.3.70-debian10, 1.3.70-ubuntu18, 1.4.41-debian10, 1.4.41-ubuntu18, 1.5.16-debian10, 1.5.16-ubuntu18, 2.0.0-RC12-debian10, and 2.0.0-RC12-ubuntu18.

All supported images

Upgraded Conscrypt to the 2.5.1 version.

Image 1.5

Upgraded Delta Lake to the 0.6.1 version.

Image 1.5 and Image 2.0 Preview

Upgraded Cloud Storage connector to the 2.1.5 version.

Image 2.0 preview

The Anaconda optional component is no longer available or required when using the Jupyter optional component (Miniconda is installed and activated by default).
Updated R to the 4.0.0 version.
Configured YARN aggregated logs to use the IFile format.
Upgrade Flink to the 1.11.2 version.

YARN-9607: Auto-configuring rollover-size of IFile format for non-appendable filesystems.
YARN-9525: IFile format is not working against s3a remote folder.

Firestore

Firestore now supports the not equals != and not-in query operators.

September 29, 2020

Anthos Service Mesh

1.6.11-asm.1, 1.5.10-asm.2, and 1.4.10-asm.18

Fixes the security issue, ISTIO-SECURITY-2020-010, with the same fixes as Istio 1.6.11. These fixes were backported to 1.6.11-asm.1, 1.5.10-asm.2 and 1.4.10-asm.18. For more information, see the Istio 1.6.11 release notes.

For details on upgrading Anthos Service Mesh, refer to the following upgrade guides:

1.6

1.5

1.4

BigQuery ML

Time series models now let you change DATA_FREQUENCY from the default value (AUTO_FREQUENCY) when forecasting multiple time series using TIME_SERIES_ID_COL.

Cloud CDN

Improvements to Cloud CDN's request collapsing behavior: If your deployment serves large objects, these improvements reduce origin load during revalidation and cache fill. Live video workloads will see the largest benefit. For more information, see Support for byte range requests.

Cloud Profiler

Cloud Profiler history view is available in beta. For more information, see Viewing historical trends.

Cloud Run

Cloud Run now supports server-side HTTP and gRPC streaming.

Dataflow

You can now use a network tags parameter to add network tags to all worker VMs that execute a particular Dataflow job.

Traffic Director

Automated Envoy deployment for Google Compute Engine VMs is now in General Availability.

September 28, 2020

Cloud Billing

Budget alert email notifications: Cloud Billing Budgets functionality has been updated to offer more control over recipients of alert emails. In May 2020, we announced that you can use Monitoring notifications to customize your budget to send alert emails to up to five additional email recipients you specify, in addition to the default email recipients. Now, you can also opt out of the default email settings, choosing not to send budget alert emails to Billing Account Administrators and Billing Account Users on the target Cloud Billing account (that is, every user assigned a billing role of either roles/billing.admin or roles/billing.user). To opt out of the default behavior, in the Cloud Billing budget's Manage notifications settings, deselect Email alerts to billing admins and users. Read more about email notification settings in our documentation.

Committed use discounts (CUDs) are now available to purchase for Cloud VMware Engine. CUDs provide discounted prices in exchange for your commitment to use a minimum level of resources for a specified term. With spend-based committed use discounts for Cloud VMware Engine, you can earn a deep discount off your cost of use in exchange for committing to continuously use VMware Engine nodes in a particular region for a 1- or 3-year term. See the documentation for more details.

Cloud Composer

New versions of Cloud Composer images: composer-1.12.1-airflow-1.10.6, composer-1.12.1-airflow-1.10.9, and composer-1.12.1-airflow-1.10.10. The default is composer-1.12.1-airflow-1.10.6. Upgrade your Cloud SDK to use features in this release.

In-cluster image build logs will now appear in Monitoring under separate log names build-log-*, instead of in the Composer Agent logs.
You can now set or update machine types for the Airflow web server and Cloud SQL instance for any environment running a Composer version 1.7.2 or newer, regardless of Airflow version.

Airflow 1.10.6, 1.10.9, and 1.10.9: An Airflow change has been backported that lowers the network cost of DAG serialization.
Airflow 1.10.9: An Airflow change has been backported that improves GKE cluster resource usage, improving overall Airflow performance.

Cloud Spanner

The NUMERIC data type is now generally available.

Cloud Storage

Tokyo+Osaka dual-region (asia1) launched.

New location for storing your data.

Compute Engine

N2D machine types are available in The Dalles, Oregon, the us-west1-b zone. For more information, see the VM instance pricing page.

Google Cloud VMware Engine

Committed use discounts (CUDs) are available to purchase for Google Cloud VMware Engine. CUDs provide discounted prices in exchange for your commitment to use a minimum level of resources for a specified term. With spend-based committed use discounts for VMware Engine, you can earn a deep discount off your cost of use in exchange for committing to continuously use VMware Engine nodes in a particular region for a 1- or 3-year term. See the documentation for more details.