BigQuery Data Transfer Service のモニタリングとロギングでは、サービスのワークロードのパフォーマンスとステータスに関する情報が提供されます。BigQuery Data Transfer Service では、モニタリング データが Cloud Monitoring にエクスポートされます。
BigQuery Data Transfer Service をモニタリングする
モニタリング指標は、次の目的で使用できます。
データ移転構成の使用状況とパフォーマンスを評価する。
問題のトラブルシューティングを行う。
転送実行のステータスをモニタリングする。
Monitoring でカスタム ダッシュボードの作成、アラートの設定、指標の照会を行うには、 Google Cloud コンソールまたは Monitoring API を使用します。
BigQuery Data Transfer Service では、次の形式でメッセージが記録されます。
{"insertId":"0000000000","jsonPayload":{"message":"DTS transfer run message."},"resource":{"type":"bigquery_dts_config","labels":{"project_id":"my_project_id","config_id":"transfer_config_id","location":"us"}},"timestamp":"2020-11-25T04:45:48.545732221Z","severity":"INFO","labels":{"run_id":"transfer_run_id"},"logName":"projects/your_project_id/logs/bigquerydatatransfer.googleapis.com%2Ftransfer_config","receiveTimestamp":"2020-11-25T04:45:48.960214929Z"}
ログの内容
BigQuery Data Transfer Service ログエントリには、転送実行のモニタリングとデバッグに役立つ情報が含まれています。ログエントリには次のタイプの情報が含まれています。
[[["わかりやすい","easyToUnderstand","thumb-up"],["問題の解決に役立った","solvedMyProblem","thumb-up"],["その他","otherUp","thumb-up"]],[["わかりにくい","hardToUnderstand","thumb-down"],["情報またはサンプルコードが不正確","incorrectInformationOrSampleCode","thumb-down"],["必要な情報 / サンプルがない","missingTheInformationSamplesINeed","thumb-down"],["翻訳に関する問題","translationIssue","thumb-down"],["その他","otherDown","thumb-down"]],["最終更新日 2025-08-21 UTC。"],[[["\u003cp\u003eBigQuery Data Transfer Service provides monitoring and logging features to track workload performance and status, exporting monitoring data to Cloud Monitoring.\u003c/p\u003e\n"],["\u003cp\u003eMonitoring metrics can be utilized to evaluate performance, troubleshoot problems, and track transfer run statuses via the Google Cloud console or Monitoring API.\u003c/p\u003e\n"],["\u003cp\u003eCloud Monitoring alerts and custom dashboards can be defined for BigQuery Data Transfer Service metrics, with metrics being exported in batches at 1-minute intervals and retained for 6 weeks.\u003c/p\u003e\n"],["\u003cp\u003eBigQuery Data Transfer Service logs each run, providing detailed information for monitoring and debugging, accessible through the Logs Explorer.\u003c/p\u003e\n"],["\u003cp\u003eLogs can be filtered by transfer configuration ID or run ID, or viewed in their entirety, and the log format includes details such as timestamp, severity, and a message explaining the transfer run status.\u003c/p\u003e\n"]]],[],null,["# Monitor and view logs for BigQuery Data Transfer Service\n========================================================\n\nBigQuery Data Transfer Service [monitoring](#monitor) and [logging](#logs) provide\ninformation about the service's workload performance and status.\nBigQuery Data Transfer Service exports monitoring data to\n[Cloud Monitoring](/monitoring/docs).\n\nMonitor BigQuery Data Transfer Service\n--------------------------------------\n\nYou can use monitoring metrics for the following purposes:\n\n- Evaluate the usage and performance a data transfer configuration.\n- Troubleshoot problems.\n- Monitor transfer run statuses.\n\nTo create custom dashboards, set up alerts, and query metrics with\nMonitoring, you can use the Google Cloud console or the\n[Monitoring API](/monitoring/api).\n\n### View transfer data in Metrics Explorer\n\n1. In the Google Cloud console, go to the **Monitoring** page.\n\n [Go to Monitoring](https://console.cloud.google.com/monitoring)\n2. In the navigation pane, click **Metrics Explorer**.\n\n3. Select your project.\n\n4. In the **Find resource type and metric** box, enter the following:\n\n - For **Resource type** , enter `BigQuery DTS Config`.\n - For **Metric** , select one of the metrics listed in [Monitoring metrics for transfer configurations](#monitor_metrics_for_transfer_configurations), for example,\n `Completed run count`.\n\n5. Optional: Select aligner, reducer, and other parameters.\n\n6. The metrics are displayed in the **Metrics explorer** window.\n\n### Define Cloud Monitoring alerts\n\nYou can define [Monitoring alerts](/monitoring/alerts) for\nBigQuery Data Transfer Service metrics:\n\n1. In the Google Cloud console, go to the **Monitoring** page.\n\n [Go to Monitoring](https://console.cloud.google.com/monitoring)\n2. In the navigation pane, select **Alerting \\\u003e Create policy**.\n\n For more information about alerting policies and concepts behind them, see\n [Types of alerting policies](/monitoring/alerts/types-of-conditions).\n3. Click **Add Condition** and select a condition type.\n\n4. Select metrics and filters. For metrics, the resource type is **BigQuery DTS\n Config**.\n\n5. Click **Save Condition**.\n\n6. Enter policy name, and then click **Save Policy**.\n\nFor more information about alerting policies and concepts, see\n[Introduction to alerting](/monitoring/alerts).\n\n### Define Cloud Monitoring custom dashboards\n\nYou can create custom dashboards over BigQuery Data Transfer Service metrics:\n\n1. In the Google Cloud console, go to the **Monitoring** page.\n\n [Go to Monitoring](https://console.cloud.google.com/monitoring)\n2. In the navigation pane, select **Dashboards \\\u003e Create Dashboard**.\n\n3. Click **Add Chart**.\n\n4. Give the chart a title.\n\n5. Select metrics and filters. For metrics, the resource type is **BigQuery DTS\n Config**.\n\n6. Click **Save**.\n\nFor more information, see [Manage custom dashboards](/monitoring/charts/dashboards).\n\n### Metric reporting frequency and retention\n\nMetrics for BigQuery Data Transfer Service runs are exported to Monitoring in\nbatches, at 1-minute intervals. Monitoring data is retained for 6 weeks.\n\nThe dashboard provides data analysis in default intervals of `1h` (1 hour), `6H`\n(6 hours), `1D` (1 day), `1W` (1 week), and `6W` (6 weeks). You can manually\nrequest analysis in any interval between `1M` (1 minute) to `6W` (6 weeks).\n\n### Monitor metrics for transfer configurations\n\nThe following metrics for BigQuery Data Transfer Service configs are exported to\nMonitoring:\n\n### Filter dimensions for metrics\n\nMetrics are aggregated for each BigQuery Data Transfer Service configuration. You\ncan filter aggregated metrics by the following dimensions:\n\nBigQuery Data Transfer Service logs\n-----------------------------------\n\nEach BigQuery Data Transfer Service run is logged using [Cloud Logging](/logging/docs).\nLogging is automatically enabled for all data transfers.\n\n### Required roles\n\nThe Logs Viewer role (`roles/logging.viewer`) gives you read-only access to all\nfeatures of Logging. For more information about the\nIdentity and Access Management (IAM) permissions and roles that apply to\nLogging data, see the [Logging access control\nguide](/logging/docs/access-control).\n\n### View logs\n\nTo view logs, go to the **Logs Explorer** page.\n\n[Go to Logs Explorer](https://console.cloud.google.com/logs)\n\nBigQuery Data Transfer Service logs are indexed first by the transfer configuration and\nthen by the individual transfer run.\n\n#### View transfer run logs\n\nTo show only the log entries from a given transfer `run_id`, in the **Query\nbuilder**, add the following filters: \n\n```googlesql\nresource.type=\"bigquery_dts_config\"\nlabels.run_id=\"\u003cvar translate=\"no\"\u003etransfer_run_id\u003c/var\u003e\"\n```\n\n#### View transfer configuration logs\n\nTo show log entries from a given transfer `config_id`, in the **Query builder**,\nadd the following filters: \n\n```googlesql\nresource.type=\"bigquery_dts_config\"\nresource.labels.config_id=\"\u003cvar translate=\"no\"\u003etransfer_config_id\u003c/var\u003e\"\n```\n\n#### View all logs\n\nTo see all BigQuery Data Transfer Service logs, do one of the following:\n\n- In the **Fields** pane, for **Resource type** , select **BigQuery DTS\n Config**.\n\n- In the **Query builder**, add the following filter:\n\n ```googlesql\n resource.type=\"bigquery_dts_config\"\n ```\n\nFor more information about how to use the Log Explorer, see\n[Using the Log Explorer](/logging/docs/view/logs-explorer-interface).\n\n### Log format\n\nBigQuery Data Transfer Service logs messages in the following format: \n\n```googlesql\n{\n \"insertId\": \"0000000000\",\n \"jsonPayload\": {\n \"message\": \"DTS transfer run message.\"\n },\n \"resource\": {\n \"type\": \"bigquery_dts_config\",\n \"labels\": {\n \"project_id\": \"my_project_id\",\n \"config_id\": \"transfer_config_id\",\n \"location\": \"us\"\n }\n },\n \"timestamp\": \"2020-11-25T04:45:48.545732221Z\",\n \"severity\": \"INFO\",\n \"labels\": {\n \"run_id\": \"transfer_run_id\"\n },\n \"logName\": \"projects/your_project_id/logs/bigquerydatatransfer.googleapis.com%2Ftransfer_config\",\n \"receiveTimestamp\": \"2020-11-25T04:45:48.960214929Z\"\n}\n```\n\n### What is logged\n\nBigQuery Data Transfer Service log entries contain information that is useful for\nmonitoring and debugging your transfer runs. Log entries contain the following\ntypes of information:\n\n- `timestamp`: used to compute the log entry's age and to enforce the log's retention period\n- `severity`: can be `INFO`, `WARNING` or `ERROR`\n- `message_text`: holds a string that explains the current status of the transfer run\n\nWhat's next\n-----------\n\n- Learn more about [Monitoring](/monitoring).\n- Read an overview of [Cloud Audit Logs](/logging/docs/audit) and [Cloud Logging](/logging)."]]
