Google Cloud platform logs

This document provides basic information about the Google Cloud platform logs that are available in Cloud Logging, as well as next steps for viewing and managing platform logs.

Overview

Logging receives, indexes, and stores log entries from Google Cloud services. Google Cloud platform logs are service-specific logs that can help you debug and troubleshoot issues, as well as better understand the Google Cloud services you're using.

The Google Cloud platform logs visible to you in Cloud Logging vary, depending on which Google Cloud resources you're using in your Cloud project or organization.

When using this document, note the following:

  • Not all Google Cloud services implement platform logs. For an expanding (non-exhaustive) list of the services that implement platform logs, see the following Index of Google Cloud platform logs.
  • Each Google Cloud service that implements platform logs manages its own configuration. Refer to service-specific documentation to determine whether the service enables platform logs by default and how to enable or disable platform logs.

Index of Google Cloud platform logs

Following are tables of some of the Google Cloud platform logs supported by Cloud Logging. To understand the data contained in the tables, see Log entry structure on this page.

AlloyDB

Logging API service name: alloydb.googleapis.com

Log ID Monitored resource Payload
alloydb.googleapis.com%2Fpostgres.log alloydb.googleapis.com/Instance The PostgreSQL database logs.
alloydb.googleapis.com%2Fjournald alloydb.googleapis.com/Instance Container logs for dataplane agents.

Assured Workloads

Logging API service name: assuredworkloads.googleapis.com

Log ID Monitored resource Payload
assuredworkloads.googleapis.com%2Fregulatory_intercept_ack folder type.googleapis.com/google.cloud.assuredworkloads.regulatoryintercept.logging.v1.RegulatoryInterceptAckLogEntry
assuredworkloads.googleapis.com%2Fregulatory_intercept_ack project type.googleapis.com/google.cloud.assuredworkloads.regulatoryintercept.logging.v1.RegulatoryInterceptAckLogEntry

Backup for GKE

Logging API service name: gkebackup.googleapis.com

Log ID Monitored resource Payload
gkebackup.googleapis.com%2Fbackup_change gkebackup.googleapis.com/BackupPlan type.googleapis.com/google.cloud.gkebackup.logging.v1.BackupChange
gkebackup.googleapis.com%2Fbackup_plan_change gkebackup.googleapis.com/BackupPlan type.googleapis.com/google.cloud.gkebackup.logging.v1.BackupPlanChange
gkebackup.googleapis.com%2Frestore_change gkebackup.googleapis.com/RestorePlan type.googleapis.com/google.cloud.gkebackup.logging.v1.RestoreChange
gkebackup.googleapis.com%2Frestore_plan_change gkebackup.googleapis.com/RestorePlan type.googleapis.com/google.cloud.gkebackup.logging.v1.RestorePlanChange

BigQuery Data Transfer API

Logging API service name: bigquerydatatransfer.googleapis.com

Log ID Monitored resource Payload
bigquerydatatransfer.googleapis.com%2Ftransfer_config bigquery_dts_config Debug logs for BigQuery Data Transfer runs. Describes the current status of the transfer run.

Chat

Logging API service name: chat.googleapis.com

Log ID Monitored resource Payload
chat.googleapis.com%2Ferrors chat.googleapis.com/Project type.googleapis.com/google.chat.logging.v1.ChatAppLogEntry

Cloud Database Migration Service

Logging API service name: datamigration.googleapis.com

Log ID Monitored resource Payload
datamigration.googleapis.com%2Fmigration_job_event datamigration.googleapis.com/MigrationJob type.googleapis.com/google.cloud.clouddms.logging.v1.MigrationJobEventLog
datamigration.googleapis.com%2Fconnection_profile_event datamigration.googleapis.com/ConnectionProfile type.googleapis.com/google.cloud.clouddms.logging.v1.ConnectionProfileEventLog

Cloud Deploy

Logging API service name: clouddeploy.googleapis.com

Log ID Monitored resource Payload
clouddeploy.googleapis.com%2Frelease_render clouddeploy.googleapis.com/DeliveryPipeline type.googleapis.com/google.cloud.deploy.v1.ReleaseRenderEvent
clouddeploy.googleapis.com%2Frollout_notification clouddeploy.googleapis.com/DeliveryPipeline type.googleapis.com/google.cloud.deploy.v1.RolloutNotificationEvent
clouddeploy.googleapis.com%2Fdeliverypipeline_notification clouddeploy.googleapis.com/DeliveryPipeline type.googleapis.com/google.cloud.deploy.v1.DeliveryPipelineNotificationEvent
clouddeploy.googleapis.com%2Ftarget_notification clouddeploy.googleapis.com/Target type.googleapis.com/google.cloud.deploy.v1.TargetNotificationEvent
clouddeploy.googleapis.com%2Frelease_notification clouddeploy.googleapis.com/DeliveryPipeline type.googleapis.com/google.cloud.deploy.v1.ReleaseNotificationEvent

Cloud Functions

Logging API service name: cloudfunctions.googleapis.com

Log ID Monitored resource Payload
cloudfunctions.googleapis.com%2Fcloud-functions cloud_function Cloud Functions writes logs to this stream that indicate the start and end of execution, as well as the stdout and stderr from those executions.

Cloud Integrations

Logging API service name: integrations.googleapis.com

Log ID Monitored resource Payload
integrations.googleapis.com%2Fexecution_info integrations.googleapis.com/IntegrationVersion type.googleapis.com/google.cloud.integrations.v1alpha.ExecutionInfo

Cloud Load Balancing

Logging API service name: loadbalancing.googleapis.com

Log ID Monitored resource Payload
loadbalancing.googleapis.com%2Frequests internal_http_lb_rule type.googleapis.com/google.cloud.loadbalancing.type.LoadBalancerLogEntry
loadbalancing.googleapis.com%2Frequests http_external_regional_lb_rule type.googleapis.com/google.cloud.loadbalancing.type.LoadBalancerLogEntry

Cloud Logging API

Logging API service name: logging.googleapis.com

Log ID Monitored resource Payload
logging.googleapis.com%2Fsink_error logging_sink A report of an error encountered while trying to export data to a configured log sink.

Cloud Monitoring API

Logging API service name: monitoring.googleapis.com

Log ID Monitored resource Payload
monitoring.googleapis.com%2Fuptime_checks uptime_url type.googleapis.com/google.monitoring.v3.UptimeCheckConfig, type.googleapis.com/google.monitoring.v3.UptimeCheckResult
monitoring.googleapis.com%2Fuptime_checks gae_app type.googleapis.com/google.monitoring.v3.UptimeCheckConfig, type.googleapis.com/google.monitoring.v3.UptimeCheckResult
monitoring.googleapis.com%2Fuptime_checks gce_instance type.googleapis.com/google.monitoring.v3.UptimeCheckConfig, type.googleapis.com/google.monitoring.v3.UptimeCheckResult
monitoring.googleapis.com%2Fuptime_checks aws_ec2_instance type.googleapis.com/google.monitoring.v3.UptimeCheckConfig, type.googleapis.com/google.monitoring.v3.UptimeCheckResult
monitoring.googleapis.com%2Fuptime_checks aws_elb_load_balancer type.googleapis.com/google.monitoring.v3.UptimeCheckConfig, type.googleapis.com/google.monitoring.v3.UptimeCheckResult
monitoring.googleapis.com%2Fuptime_checks k8s_service type.googleapis.com/google.monitoring.v3.UptimeCheckConfig, type.googleapis.com/google.monitoring.v3.UptimeCheckResult

Cloud Run

Logging API service name: run.googleapis.com

Log ID Monitored resource Payload
run.googleapis.com%2Fstdout cloud_run_revision Cloud Run stdout logs. Each entry contains a line (or multiple lines, if they match a known multi-line exception format like a stack trace) written to stdout from the user container.
run.googleapis.com%2Fstderr cloud_run_revision Cloud Run stderr logs. Each entry contains a line (or multiple lines, if they match a known multi-line exception format like a stack trace) written to stderr from the user container.
run.googleapis.com%2Frequests cloud_run_revision Cloud Run request logs. Each request served by a Cloud Run service should have a corresponding request log entry.
run.googleapis.com%2F/dev/log cloud_run_revision Cloud Run syslogs. These are syslog-structured logs written to /dev/log in the user container.
run.googleapis.com%2F/var/log cloud_run_revision Cloud Run /var/log logs. Each entry contains a line (or multiple lines, if they match a known multi-line exception format like a stack trace) written to /var/log/** from the user container.
run.googleapis.com%2Fstdout cloud_run_job Cloud Run stdout logs. Each entry contains a line (or multiple lines, if they match a known multi-line exception format like a stack trace) written to stdout from the user container.
run.googleapis.com%2Fstderr cloud_run_job Cloud Run stderr logs. Each entry contains a line (or multiple lines, if they match a known multi-line exception format like a stack trace) written to stderr from the user container.
run.googleapis.com%2F/dev/log cloud_run_job Cloud Run syslogs. These are syslog-structured logs written to /dev/log in the user container.
run.googleapis.com%2F/var/log cloud_run_job Cloud Run /var/log logs. Each entry contains a line (or multiple lines, if they match a known multi-line exception format like a stack trace) written to /var/log/** from the user container.

Cloud SQL

Logging API service name: cloudsql.googleapis.com

Log ID Monitored resource Payload
cloudsql.googleapis.com%2Fmysql.err cloudsql_database The error log contains a record and diagnostic messages such as errors, warnings, and notes that occur during server startup, shutdown, and while the server is running.
cloudsql.googleapis.com%2Fmysql-slow.log cloudsql_database The slow query log consists of SQL statements that take more than long_query_time seconds to execute.
cloudsql.googleapis.com%2Fmysql-general.log cloudsql_database The general query log records when clients connect or disconnect, and it logs each SQL statement received from clients.
cloudsql.googleapis.com%2Freplication-setup.log cloudsql_database They are related to external server replication setup.
cloudsql.googleapis.com%2Freplication-status.log cloudsql_database They are related to external server replication status monitoring.
cloudsql.googleapis.com%2Fmysql-upgrade.log cloudsql_database Used to contain mysql_upgrade logs. Now deprecated.
cloudsql.googleapis.com%2Fpostgres.log cloudsql_database It contains the database server's log output from the Cloud SQL instance.
cloudsql.googleapis.com%2Fpostgres-audit.log cloudsql_database It contains the audit log entries from the pgAudit extension in the Cloud SQL instance.
cloudsql.googleapis.com%2Fsqlserver.err cloudsql_database These logs are from the SQL Server errorlog on the Cloud SQL instance.
cloudsql.googleapis.com%2Fsqlagent.out cloudsql_database These logs are from sqlagent.out on the Cloud SQL instance.
cloudsql.googleapis.com%2Foperationdetails.log cloudsql_database These logs show details of long running operations such as Import SQL for SQL Server instances.
cloudsql.googleapis.com%2Fpostgres-upgrade.log cloudsql_database It contains log output by pg_upgrade during database major version upgrade.

Cloud Setup

Logging API service name: cloudsetup.googleapis.com

Log ID Monitored resource Payload
cloudsetup.googleapis.com%2Fcomplete_deployment api type.googleapis.com/google.cloud.cloudsetup.logging.v1.CompleteDeploymentEvent

Dataproc

Logging API service name: dataproc.googleapis.com

Log ID Monitored resource Payload
dataproc.googleapis.com%2Fautoscaler cloud_dataproc_cluster type.googleapis.com/google.cloud.dataproc.logging.AutoscalerLog

Dataproc Metastore

Logging API service name: metastore.googleapis.com

Log ID Monitored resource Payload
metastore.googleapis.com%2Fbackground metastore.googleapis.com/Service type.googleapis.com/google.cloud.metastore.logging.v1.BackgroundActivityLogEntry
metastore.googleapis.com%2Frequests metastore.googleapis.com/Service type.googleapis.com/google.cloud.metastore.logging.v1.RequestsLogEntry
metastore.googleapis.com%2Fsystem metastore.googleapis.com/Service type.googleapis.com/google.cloud.metastore.logging.v1.SystemActivityLogEntry

Dialogflow

Logging API service name: dialogflow-runtime.googleapis.com

Log ID Monitored resource Payload
dialogflow-runtime.googleapis.com%2Frequests runtime_requests type.googleapis.com/google.cloud.dialogflow.cx.v3beta1.DetectIntentRequest, type.googleapis.com/google.cloud.dialogflow.cx.v3beta1.DetectIntentResponse, type.googleapis.com/google.cloud.dialogflow.cx.v3beta1.WebhookRequest, type.googleapis.com/google.cloud.dialogflow.cx.v3beta1.WebhookResponse

Firestore/Datastore

Logging API service name: datastore.googleapis.com

Log ID Monitored resource Payload
datastore.googleapis.com%2Fmigration_state datastore_database type.googleapis.com/google.datastore.admin.v1.MigrationStateEvent
datastore.googleapis.com%2Fmigration_progress datastore_database type.googleapis.com/google.datastore.admin.v1.MigrationProgressEvent

GKE On-prem (Anthos)

Logging API service name: anthos.googleapis.com

Log ID Monitored resource Payload
anthos.googleapis.com%2Fseesaw_engine anthos_l4lb These logs are from seesaw_engine on the Seesaw VM instances running in GKE OnPrem.
anthos.googleapis.com%2Fseesaw_ha anthos_l4lb These logs are from seesaw_ha on the Seesaw VM instances running in GKE OnPrem.
anthos.googleapis.com%2Fseesaw_healthcheck anthos_l4lb These logs are from seesaw_healthcheck on the Seesaw VM instances running in GKE OnPrem.
anthos.googleapis.com%2Fseesaw_ncc anthos_l4lb These logs are from seesaw_ncc on the Seesaw VM instances running in GKE OnPrem.
anthos.googleapis.com%2Fseesaw_ecu anthos_l4lb These logs are from seesaw_ecu on the Seesaw VM instances running in GKE OnPrem.
anthos.googleapis.com%2Fseesaw_config anthos_l4lb These logs are from seesaw_config on the Seesaw VM instances running in GKE OnPrem.

Google Binary Authorization API

Logging API service name: binaryauthorization.googleapis.com

Log ID Monitored resource Payload
binaryauthorization.googleapis.com%2Fcontinuous_validation k8s_cluster v1beta1: type.googleapis.com/google.cloud.binaryauthorization.v1beta1.ContinuousValidationEvent

Google Workspace Add-ons

Logging API service name: gsuiteaddons.googleapis.com

Log ID Monitored resource Payload
gsuiteaddons.googleapis.com%2Ferrors g_suite_add_ons type.googleapis.com/google.cloud.gsuiteaddons.logging.v1.GSuiteAddOnsLogEntry

Live Stream API

Logging API service name: livestream.googleapis.com

Log ID Monitored resource Payload
livestream.googleapis.com%2Fchannel_activities livestream.googleapis.com/Channel type.googleapis.com/google.cloud.video.livestream.logging.v1.ChannelActivity

Network Analyzer

Logging API service name: networkanalyzer.googleapis.com

Log ID Monitored resource Payload
networkanalyzer.googleapis.com%2Fanalyzer_reports networking.googleapis.com/Location type.googleapis.com/google.cloud.networkanalyzer.logging.v1.Report

Partner Data Ingestion

Logging API service name: partnerdataingestion.googleapis.com

Log ID Monitored resource Payload
partnerdataingestion.googleapis.com%2Fingest_details consumed_api type.googleapis.com/google.search.partnerdataingestion.logging.v1.IngestDetailsLog

Recommender API

Logging API service name: recommender.googleapis.com

Log ID Monitored resource Payload
recommender.googleapis.com%2Factions recommender v1: type.googleapis.com/google.cloud.recommender.logging.v1.ActionLog
v1beta1: type.googleapis.com/google.cloud.recommender.logging.v1beta1.ActionLog
recommender.googleapis.com%2Factions recommender_insight_type v1: type.googleapis.com/google.cloud.recommender.logging.v1.InsightActionLog
v1beta1: type.googleapis.com/google.cloud.recommender.logging.v1beta1.InsightActionLog

SaaS Lifecycle Management

Logging API service name: saasmanagement.googleapis.com

Log ID Monitored resource Payload
saasmanagement.googleapis.com%2Fterraform_internal saasmanagement.googleapis.com/Instance type.googleapis.com/google.cloud.saasaccelerator.management.logs.v1.InstanceEvent

Secret Manager API

Logging API service name: secretmanager.googleapis.com

Log ID Monitored resource Payload
secretmanager.googleapis.com%2Fsecret_event secretmanager.googleapis.com/Secret type.googleapis.com/google.cloud.secretmanager.logging.v1.SecretEvent

Serial Console

Logging API service name: serialconsole.googleapis.com

Log ID Monitored resource Payload
serialconsole.googleapis.com%2Fconsole_output gce_instance A virtual machine instance has four virtual serial ports. The instance's operating system, BIOS, and other system-level entities often write output to the serial ports, which makes them useful for troubleshooting crashes, failed boots, startup issues, or shutdown issues.

Storage Transfer

Logging API service name: storagetransfer.googleapis.com

Log ID Monitored resource Payload
storagetransfer.googleapis.com%2Ftransfer_activity storage_transfer_job type.googleapis.com/google.storagetransfer.logging.TransferActivityLog

Traffic Director

Logging API service name: trafficdirector.googleapis.com

Log ID Monitored resource Payload
trafficdirector.googleapis.com%2Fevents gce_network type.googleapis.com/google.networking.trafficdirector.type.TrafficDirectorLogEntry

Vertex AI API

Logging API service name: aiplatform.googleapis.com

Log ID Monitored resource Payload
aiplatform.googleapis.com%2Fpipeline_job_events aiplatform.googleapis.com/PipelineJob type.googleapis.com/google.cloud.aiplatform.logging.PipelineJobLogEntry

Workflows

Logging API service name: workflows.googleapis.com

Log ID Monitored resource Payload
workflows.googleapis.com%2Fengine_call workflows.googleapis.com/Workflow type.googleapis.com/google.cloud.workflows.type.EngineCallLog
workflows.googleapis.com%2Fexecutions_system workflows.googleapis.com/Workflow type.googleapis.com/google.cloud.workflows.type.ExecutionsSystemLog

Understand and manage platform logs

The following sections provide basic information about using and managing platform logs in Cloud Logging.

Log entry structure

Cloud Logging represents logs using a single data type, LogEntry, which defines certain common data for all log entries as well as the payloads that Google Cloud services can include. For detailed information about the contents of log entries, see the Logging API reference for the LogEntry type.

The index of platform logs highlights the following characteristics of log entries:

  • Log ID: The URL-encoded identifier within logName. For example, if the broader log name is organizations/1234567890/logs/cloudresourcemanager.googleapis.com%2Factivity, then the log ID is cloudresourcemanager.googleapis.com%2Factivity.

    Note that if the log ID string in a log entry's logName field is prefixed by serviceName.googleapis.com, it is a Google Cloud platform log entry.

  • Monitored resource: The resource from which the log entry originated. This consists of a resource type from the Monitored resource list and additional label values that identify a specific instance.

  • Payload: The log entry payload, which can be represented as textPayload or jsonPayload.

View logs

There are several ways to view your platform log entries:

Route logs

You can control how your log entries are routed and stored. The Log Router checks each log entry against existing rules to determine which log entries to discard, which log entries to store in Cloud Logging, and which log entries to include in exports to other destinations.

For details, see Routing and storage overview: Log Router.

Logs retention

Log entries are stored in Logging buckets for a specified length of time and are then deleted. For more information, see Logs retention periods.

Pricing

For information on logs pricing, see Logging pricing.