Release notes

These release notes apply to the core Dataproc Metastore product. You can periodically check this page for announcements about new or updated features, bug fixes, known issues, and deprecated functionality.

See Dataproc Metastore version policy for a list of current and past supported software versions.

You can see the latest product updates for all of Google Cloud on the Google Cloud page, or browse and filter all release notes in the Google Cloud Console.

To get the latest product updates delivered to you, add the URL of this page to your feed reader, or add the feed URL directly: https://cloud.google.com/feeds/metastore-release-notes.xml

April 15, 2021

v1

The asynchronous workflows logs now have labels that appear in Cloud logging.

You no longer need to manually override metastore.expression.proxy to use PartitionProxyForMetastore in Hive 3.1.2.

March 31, 2021

v1

The GA release of Dataproc Metastore is now available.

Dataproc Metastore imports and exports now support Avro storage format. This feature is in Preview.

Dataproc Metastore supports backing up and restoring service metadata and configuration. This feature is in Preview.

Dataproc Metastore supports asynchronous background tasks through the Canary release channel.

March 03, 2021

v1beta1

Fixed a bug where specifying a Cloud Storage URI without an object would return an internal error.

Fixed metastore.googleapis.com/service/health metric not showing up for some services.

February 19, 2021

v1beta1

Hive configuration overrides are rejected if either the key or value contains a newline or "<" character.

Fixed a bug where services would fail to create in projects with project IDs that contain the colon "(:)" character.

Logs query builder doesn't work when selecting location and service ID.

The MetadataImport.DatabaseDump.source_database field is deprecated. It will be removed from the v1beta API channel no earlier than August 18, 2021.

February 16, 2021

v1beta1

You must now have storage.objects.get permission on the Cloud Storage object in order to import metadata from the Cloud Storage file.

February 03, 2021

v1beta1

You can now create Dataproc Metastore services in cross-product networks (shared VPC).

Dataproc Metastore now suppports the use of non-RFC 1918 private IP address ranges in metastore services.

New Cloud Monitoring service metric is now available:

  • metastore.googleapis.com/service/request_count

You can now update the description of metadata imports under a Dataproc Metastore service.

Fixed an issue in which a service could get stuck in the UPDATING state.

Fixed an issue where Cloud Storage buckets with single character directories would fail request validation.

January 19, 2021

v1beta1

The Dataproc Metastore Cloud Logging and Monitoring issue has been fixed.

January 08, 2021

v1beta1

Dataproc Metastore Cloud Logging and Monitoring is unavailable. The issue will be fixed shortly.

December 14, 2020

v1beta1

The public Preview release of Dataproc Metastore is now available.

Legacy Dataproc Metastore services created during private Preview (prior to December 14, 2020 at 12:00 PM Pacific Standard Time) will be automatically deleted on January 29, 2021.

The Thrift endpoints of legacy services will continue to function normally, but certain pre-existing functionality such as metadata imports will cease to work. Furthermore, new features (including those announced on December 14, 2020) and bugfixes will not be available to legacy services.

To ensure you receive the newest features, patches, and stability, we strongly recommend you recreate legacy Dataproc Metastore services. Since the new metadata export feature is not available for legacy services, if you need help migrating metadata from a legacy service, the Dataproc Metastore team will be happy to assist you with a manual migration.

Please contact dataproc-metastore-support@google.com with any questions or to request help migrating metadata.