Google Cloud platform logs

This document provides basic information about the Google Cloud platform logs that are available in Cloud Logging, as well as next steps for viewing and managing platform logs.

Overview

Logging receives, indexes, and stores log entries from Google Cloud services. Google Cloud platform logs are service-specific logs that can help you debug and troubleshoot issues, as well as better understand the Google Cloud services you're using.

The Google Cloud platform logs visible to you in Cloud Logging vary, depending on which Google Cloud resources you're using in your Cloud project or organization.

When using this document, note the following:

  • Not all Google Cloud services implement platform logs. For an expanding (non-exhaustive) list of the services that implement platform logs, see the following Index of Google Cloud platform logs.
  • Each Google Cloud service that implements platform logs manages its own configuration. Refer to service-specific documentation to determine whether the service enables platform logs by default and how to enable or disable platform logs.

Index of Google Cloud platform logs

Following are some of the Google Cloud platform logs supported by Cloud Logging.

Backup for GKE

Logging API service name: gkebackup.googleapis.com

Log ID Monitored resource Payload
gkebackup.googleapis.com%2Fbackup_change gkebackup.googleapis.com/BackupPlan type.googleapis.com/google.cloud.gkebackup.logging.v1.BackupChange
gkebackup.googleapis.com%2Fbackup_plan_change gkebackup.googleapis.com/BackupPlan type.googleapis.com/google.cloud.gkebackup.logging.v1.BackupPlanChange
gkebackup.googleapis.com%2Frestore_change gkebackup.googleapis.com/RestorePlan type.googleapis.com/google.cloud.gkebackup.logging.v1.RestoreChange
gkebackup.googleapis.com%2Frestore_plan_change gkebackup.googleapis.com/RestorePlan type.googleapis.com/google.cloud.gkebackup.logging.v1.RestorePlanChange

BigQuery Data Transfer API

Logging API service name: bigquerydatatransfer.googleapis.com

Log ID Monitored resource Payload
bigquerydatatransfer.googleapis.com%2Ftransfer_config bigquery_dts_config Debug logs for BigQuery Data Transfer runs. Describes the current status of the transfer run.

Cloud Database Migration Service

Logging API service name: datamigration.googleapis.com

Log ID Monitored resource Payload
datamigration.googleapis.com%2Fmigration_job_event datamigration.googleapis.com/MigrationJob type.googleapis.com/google.cloud.clouddms.logging.v1.MigrationJobEventLog
datamigration.googleapis.com%2Fconnection_profile_event datamigration.googleapis.com/ConnectionProfile type.googleapis.com/google.cloud.clouddms.logging.v1.ConnectionProfileEventLog

Cloud Functions

Logging API service name: cloudfunctions.googleapis.com

Log ID Monitored resource Payload
cloudfunctions.googleapis.com%2Fcloud-functions cloud_function Cloud Functions writes logs to this stream that indicate the start and end of execution, as well as the stdout and stderr from those executions.

Cloud Integrations

Logging API service name: integrations.googleapis.com

Log ID Monitored resource Payload
integrations.googleapis.com%2Fexecution_info integrations.googleapis.com/IntegrationVersion type.googleapis.com/google.cloud.integrations.v1alpha.ExecutionInfo

Cloud Logging API

Logging API service name: logging.googleapis.com

Log ID Monitored resource Payload
logging.googleapis.com%2Fsink_error logging_sink A report of an error encountered while trying to export data to a configured log sink.

Cloud Monitoring API

Logging API service name: monitoring.googleapis.com

Log ID Monitored resource Payload
monitoring.googleapis.com%2Fuptime_checks uptime_url type.googleapis.com/google.monitoring.v3.UptimeCheckConfig, type.googleapis.com/google.monitoring.v3.UptimeCheckResult
monitoring.googleapis.com%2Fuptime_checks gae_app type.googleapis.com/google.monitoring.v3.UptimeCheckConfig, type.googleapis.com/google.monitoring.v3.UptimeCheckResult
monitoring.googleapis.com%2Fuptime_checks gce_instance type.googleapis.com/google.monitoring.v3.UptimeCheckConfig, type.googleapis.com/google.monitoring.v3.UptimeCheckResult
monitoring.googleapis.com%2Fuptime_checks aws_ec2_instance type.googleapis.com/google.monitoring.v3.UptimeCheckConfig, type.googleapis.com/google.monitoring.v3.UptimeCheckResult
monitoring.googleapis.com%2Fuptime_checks aws_elb_load_balancer type.googleapis.com/google.monitoring.v3.UptimeCheckConfig, type.googleapis.com/google.monitoring.v3.UptimeCheckResult
monitoring.googleapis.com%2Fuptime_checks k8s_service type.googleapis.com/google.monitoring.v3.UptimeCheckConfig, type.googleapis.com/google.monitoring.v3.UptimeCheckResult

Cloud Run

Logging API service name: run.googleapis.com

Log ID Monitored resource Payload
run.googleapis.com%2Fstdout cloud_run_revision Cloud Run stdout logs. Each entry contains a line (or multiple lines, if they match a known multi-line exception format like a stack trace) written to stdout from the user container.
run.googleapis.com%2Fstderr cloud_run_revision Cloud Run stderr logs. Each entry contains a line (or multiple lines, if they match a known multi-line exception format like a stack trace) written to stderr from the user container.
run.googleapis.com%2Frequests cloud_run_revision Cloud Run request logs. Each request served by a Cloud Run service should have a corresponding request log entry.
run.googleapis.com%2F/dev/log cloud_run_revision Cloud Run syslogs. These are syslog-structured logs written to /dev/log in the user container.
run.googleapis.com%2F/var/log cloud_run_revision Cloud Run /var/log logs. Each entry contains a line (or multiple lines, if they match a known multi-line exception format like a stack trace) written to /var/log/** from the user container.

Cloud SQL

Logging API service name: cloudsql.googleapis.com

Log ID Monitored resource Payload
cloudsql.googleapis.com%2Fmysql.err cloudsql_database The error log contains a record and diagnostic messages such as errors, warnings, and notes that occur during server startup, shutdown, and while the server is running.
cloudsql.googleapis.com%2Fmysql-slow.log cloudsql_database The slow query log consists of SQL statements that take more than long_query_time seconds to execute.
cloudsql.googleapis.com%2Fmysql-general.log cloudsql_database The general query log records when clients connect or disconnect, and it logs each SQL statement received from clients.
cloudsql.googleapis.com%2Freplication-setup.log cloudsql_database They are related to external server replication setup.
cloudsql.googleapis.com%2Freplication-state.log cloudsql_database They are related to external server replication state monitoring.
cloudsql.googleapis.com%2Fmysql-upgrade.log cloudsql_database Used to contain mysql_upgrade logs. Now deprecated.
cloudsql.googleapis.com%2Fpostgres.log cloudsql_database It contains the database server's log output from the Cloud SQL instance.
cloudsql.googleapis.com%2Fpostgres-audit.log cloudsql_database It contains the audit log entries from the pgAudit extension in the Cloud SQL instance.
cloudsql.googleapis.com%2Fsqlserver.err cloudsql_database These logs are from the SQL Server errorlog on the Cloud SQL instance.
cloudsql.googleapis.com%2Fsqlagent.out cloudsql_database These logs are from sqlagent.out on the Cloud SQL instance.
cloudsql.googleapis.com%2Foperationdetails.log cloudsql_database These logs show details of long running operations such as Import SQL for SQL Server instances.
cloudsql.googleapis.com%2Fpg_upgrade_server.log cloudsql_database It contains server errorlog when running pg_upgrade.
cloudsql.googleapis.com%2Fpg_upgrade_utility.log cloudsql_database It contains utility errorlog when running pg_upgrade.
cloudsql.googleapis.com%2Fpg_upgrade_internal.log cloudsql_database It contains upgrade internal errorlog when running pg_upgrade.
cloudsql.googleapis.com%2Fpg_upgrade_dump.log cloudsql_database It contains dump files generated by pg_upgrade
cloudsql.googleapis.com%2Fcontrib_isn_and_int8_pass_by_value.txt cloudsql_database It dumps the CREATE TYPE PASSEDBYVALUE setting when running pg_upgrade.
cloudsql.googleapis.com%2Ftables_with_oids.txt cloudsql_database It dumps tables are declared with oids when running pg_upgrade.
cloudsql.googleapis.com%2Ftables_using_composite.txt cloudsql_database It dumps tables using composite types when running pg_upgrade.
cloudsql.googleapis.com%2Ftables_using_unknown.txt cloudsql_database It dumps tables using unknown data type when running pg_upgrade.
cloudsql.googleapis.com%2Ftables_using_sql_identifier.txt cloudsql_database It dumps tables using sql identifier when running pg_upgrade.
cloudsql.googleapis.com%2Floadable_libraries.txt cloudsql_database It checks if new cluster contains all required loadable libraries when running pg_upgrade.
cloudsql.googleapis.com%2Ftables_using_reg.txt cloudsql_database It dumps tables using reg* data types when running pg_upgrade.
cloudsql.googleapis.com%2Fpostfix_ops.txt cloudsql_database It checks for user-defined postfix operators when running pg_upgrade.

Dataproc

Logging API service name: dataproc.googleapis.com

Log ID Monitored resource Payload
dataproc.googleapis.com%2Fautoscaler cloud_dataproc_cluster type.googleapis.com/google.cloud.dataproc.logging.AutoscalerLog

Dataproc Metastore

Logging API service name: metastore.googleapis.com

Log ID Monitored resource Payload
metastore.googleapis.com%2Fbackground metastore.googleapis.com/Service type.googleapis.com/google.cloud.metastore.logging.v1.BackgroundActivityLogEntry
metastore.googleapis.com%2Frequests metastore.googleapis.com/Service type.googleapis.com/google.cloud.metastore.logging.v1.RequestsLogEntry
metastore.googleapis.com%2Fsystem metastore.googleapis.com/Service type.googleapis.com/google.cloud.metastore.logging.v1.SystemActivityLogEntry

Dialogflow

Logging API service name: dialogflow-runtime.googleapis.com

Log ID Monitored resource Payload
dialogflow-runtime.googleapis.com%2Frequests runtime_requests type.googleapis.com/google.cloud.dialogflow.cx.v3beta1.DetectIntentRequest, type.googleapis.com/google.cloud.dialogflow.cx.v3beta1.DetectIntentResponse, type.googleapis.com/google.cloud.dialogflow.cx.v3beta1.WebhookRequest, type.googleapis.com/google.cloud.dialogflow.cx.v3beta1.WebhookResponse

Firestore/Datastore

Logging API service name: datastore.googleapis.com

Log ID Monitored resource Payload
datastore.googleapis.com%2Fmigration_state datastore_database type.googleapis.com/google.datastore.admin.v1.MigrationStateEvent
datastore.googleapis.com%2Fmigration_progress datastore_database type.googleapis.com/google.datastore.admin.v1.MigrationProgressEvent

GKE On-prem (Anthos)

Logging API service name: anthos.googleapis.com

Log ID Monitored resource Payload
anthos.googleapis.com%2Fseesaw_engine anthos_l4lb These logs are from seesaw_engine on the Seesaw VM instances running in GKE OnPrem.
anthos.googleapis.com%2Fseesaw_ha anthos_l4lb These logs are from seesaw_ha on the Seesaw VM instances running in GKE OnPrem.
anthos.googleapis.com%2Fseesaw_healthcheck anthos_l4lb These logs are from seesaw_healthcheck on the Seesaw VM instances running in GKE OnPrem.
anthos.googleapis.com%2Fseesaw_ncc anthos_l4lb These logs are from seesaw_ncc on the Seesaw VM instances running in GKE OnPrem.
anthos.googleapis.com%2Fseesaw_ecu anthos_l4lb These logs are from seesaw_ecu on the Seesaw VM instances running in GKE OnPrem.
anthos.googleapis.com%2Fseesaw_config anthos_l4lb These logs are from seesaw_config on the Seesaw VM instances running in GKE OnPrem.

Google Binary Authorization API

Logging API service name: binaryauthorization.googleapis.com

Log ID Monitored resource Payload
binaryauthorization.googleapis.com%2Fcontinuous_validation k8s_cluster v1beta1: type.googleapis.com/google.cloud.binaryauthorization.v1beta1.ContinuousValidationEvent

Google Workspace Add-ons

Logging API service name: gsuiteaddons.googleapis.com

Log ID Monitored resource Payload
gsuiteaddons.googleapis.com%2Ferrors g_suite_add_ons type.googleapis.com/google.cloud.gsuiteaddons.logging.v1.GSuiteAddOnsLogEntry

Live Stream API

Logging API service name: livestream.googleapis.com

Log ID Monitored resource Payload
livestream.googleapis.com%2Fchannel_activities livestream.googleapis.com/Channel type.googleapis.com/google.cloud.video.livestream.logging.v1.ChannelActivity

Partner Data Ingestion

Logging API service name: partnerdataingestion.googleapis.com

Log ID Monitored resource Payload
partnerdataingestion.googleapis.com%2Fingest_details consumed_api type.googleapis.com/google.search.partnerdataingestion.logging.v1.IngestDetailsLog

Recommender API

Logging API service name: recommender.googleapis.com

Log ID Monitored resource Payload
recommender.googleapis.com%2Factions recommender v1: type.googleapis.com/google.cloud.recommender.logging.v1.ActionLog
v1beta1: type.googleapis.com/google.cloud.recommender.logging.v1beta1.ActionLog
recommender.googleapis.com%2Factions recommender_insight_type v1: type.googleapis.com/google.cloud.recommender.logging.v1.InsightActionLog
v1beta1: type.googleapis.com/google.cloud.recommender.logging.v1beta1.InsightActionLog

SaaS Lifecycle Management

Logging API service name: saasmanagement.googleapis.com

Log ID Monitored resource Payload
saasmanagement.googleapis.com%2Fterraform_internal saasmanagement.googleapis.com/Instance type.googleapis.com/google.cloud.saasaccelerator.management.logs.v1.InstanceEvent

Secret Manager API

Logging API service name: secretmanager.googleapis.com

Log ID Monitored resource Payload
secretmanager.googleapis.com%2Fsecret_event secretmanager.googleapis.com/Secret type.googleapis.com/google.cloud.secretmanager.logging.v1.SecretEvent

Serial Console

Logging API service name: serialconsole.googleapis.com

Log ID Monitored resource Payload
serialconsole.googleapis.com%2Fconsole_output gce_instance A virtual machine instance has four virtual serial ports. The instance's operating system, BIOS, and other system-level entities often write output to the serial ports, which makes them useful for troubleshooting crashes, failed boots, startup issues, or shutdown issues.

Storage Transfer

Logging API service name: storagetransfer.googleapis.com

Log ID Monitored resource Payload
storagetransfer.googleapis.com%2Ftransfer_activity storage_transfer_job type.googleapis.com/google.storagetransfer.logging.TransferActivityLog

Traffic Director

Logging API service name: trafficdirector.googleapis.com

Log ID Monitored resource Payload
trafficdirector.googleapis.com%2Ftrafficdirector.googleapis.com/events gce_network type.googleapis.com/google.networking.trafficdirector.type.TrafficDirectorLogEntry

Workflows

Logging API service name: workflows.googleapis.com

Log ID Monitored resource Payload
workflows.googleapis.com%2Fengine_call workflows.googleapis.com/Workflow type.googleapis.com/google.cloud.workflows.type.EngineCallLog
workflows.googleapis.com%2Fexecutions_system workflows.googleapis.com/Workflow type.googleapis.com/google.cloud.workflows.type.ExecutionsSystemLog

Understand and manage platform logs

The following sections provide basic information about using and managing platform logs in Cloud Logging.

Log entry structure

Cloud Logging represents logs using a single data type, LogEntry, which defines certain common data for all log entries as well as the payloads that Google Cloud services can include.

Every log entry is characterized by the following information:

  • A log name. This includes the identifier of the Google Cloud project, folder, or organization that contains the log entry.
  • The resource from which the log entry originated. This consists of a resource type from the Monitored resource list and additional label values that identify a specific instance.
  • A timestamp.
  • A payload, which can be represented as textPayload, jsonPayload, or (for some Google Cloud services) protoPayload.

Note that if the [LOG_ID] string in a log entry's logName field is prefixed by serviceName.googleapis.com, it is a Google Cloud platform log entry.

For more information about log entry contents, see the Logging API reference for the LogEntry type.

View logs

There are several ways to view your platform log entries:

Route logs

You can control how your log entries are routed and stored. The Log Router checks each log entry against existing rules to determine which log entries to discard, which log entries to store in Cloud Logging, and which log entries to include in exports to other destinations.

For details, see Routing and storage overview: Log Router.

Logs retention

Log entries are stored in Logging buckets for a specified length of time and are then deleted. For more information, see Logs retention periods.

Pricing

For information on logs pricing, see Logging pricing.