Conferir registros de pipeline avançados no Cloud Logging
Mantenha tudo organizado com as coleções
Salve e categorize o conteúdo com base nas suas preferências.
Nesta página, descrevemos como ativar o Cloud Logging para seus clusters do Dataproc do Cloud Data Fusion e acessar registros de pipeline avançados.
Ativar o Cloud Logging para Dataproc
Para conferir problemas de pipeline e cluster no Cloud Logging, ative os registros avançados
em instâncias novas ou atuais do Cloud Data Fusion. Para ativar os registros avançados em
uma instância atual, faça o seguinte:
No Google Cloud console, acesse a página Instâncias do Cloud Data Fusion.
Na seção Monitoramento e registro avançados, para o Dataproc Cloud Logging, clique em editEditar.
Na janela Cloud Logging, marque a caixa de seleção Ativar o Cloud Logging.
Clique em Salvar.
Ver registros
Cada execução do pipeline do Cloud Data Fusion recebe um RunID exclusivo.
Depois de implantar e executar o pipeline, encontre o RunID dele. Em seguida, no Logging, use o RunID para ver os registros do pipeline.
Conseguir o RunID do pipeline
Acesse sua instância:
In the Google Cloud console, go to the Cloud Data Fusion page.
To open the instance in the Cloud Data Fusion Studio,
click Instances, and then click View instance.
No menu suspenso Todos os recursos, selecione Cluster do Cloud Dataproc >cdap-PIPELINE_NAME-YOUR_RUNID.
Opcional: filtrar os registros
Use os menus de filtro para filtrar os registros. É possível filtrar por vários níveis de gravidade
de registro
ou por componentes, como datafusion-pipeline-logs.
[[["Fácil de entender","easyToUnderstand","thumb-up"],["Meu problema foi resolvido","solvedMyProblem","thumb-up"],["Outro","otherUp","thumb-up"]],[["Difícil de entender","hardToUnderstand","thumb-down"],["Informações incorretas ou exemplo de código","incorrectInformationOrSampleCode","thumb-down"],["Não contém as informações/amostras de que eu preciso","missingTheInformationSamplesINeed","thumb-down"],["Problema na tradução","translationIssue","thumb-down"],["Outro","otherDown","thumb-down"]],["Última atualização 2025-09-04 UTC."],[[["\u003cp\u003eThis guide explains how to enable Cloud Logging for Cloud Data Fusion Dataproc clusters, allowing you to view pipeline and cluster logs.\u003c/p\u003e\n"],["\u003cp\u003eYou can enable advanced logging on new or existing Cloud Data Fusion instances by editing the "Dataproc Cloud Logging" settings in the instance details.\u003c/p\u003e\n"],["\u003cp\u003eEach pipeline run is assigned a unique RunID, which is used to locate specific pipeline logs within Cloud Logging.\u003c/p\u003e\n"],["\u003cp\u003eTo view logs, you must go to the Cloud Logging Logs Explorer, select the correct Dataproc Cluster resource, and then can filter it down by severity or components.\u003c/p\u003e\n"],["\u003cp\u003eLogs can be downloaded directly from the Cloud Logging interface if needed.\u003c/p\u003e\n"]]],[],null,["# View advanced pipeline logs in Cloud Logging\n\nThis page describes how to enable Cloud Logging for your\nCloud Data Fusion Dataproc clusters and access advanced\npipeline logs.\n\nEnable Dataproc Cloud Logging\n-----------------------------\n\nTo view pipeline and cluster issues in Cloud Logging, enable advanced logs\nin new or existing Cloud Data Fusion instances. To enable advanced logs in\nan existing instance, do the following:\n\n1. In the Google Cloud console, go to the Cloud Data Fusion\n **Instances** page.\n\n [Go to Instances](https://console.cloud.google.com/data-fusion/locations/-/instances)\n2. Click the instance name.\n\n3. In the **Advanced monitoring and logging** section, for\n **Dataproc Cloud Logging** , click\n edit **Edit**.\n\n4. In the **Cloud Logging** window, select the\n **Enable Cloud Logging** checkbox.\n\n5. Click **Save**.\n\nView logs\n---------\n\nEvery Cloud Data Fusion pipeline run is assigned a unique `RunID`.\nAfter you deploy and run your pipeline, find its `RunID`. Then, in\nLogging, use the `RunID` to view your pipeline\nlogs.\n\n### Get the pipeline's RunID\n\n1. Go to your instance:\n 1. In the Google Cloud console, go to the Cloud Data Fusion page.\n\n 2. To open the instance in the Cloud Data Fusion Studio,\n click **Instances** , and then click **View instance**.\n\n [Go to Instances](https://console.cloud.google.com/data-fusion/locations/-/instances)\n2. Click **List**.\n3. Click the pipeline for which you want to get the Run ID.\n4. Click **Summary**.\n5. In the **Run history** section, click **Table**.\n6. To copy the Run ID, right-click the **RunID** , and click **Copy**.\n\n### View the logs in Logs Explorer\n\n1. In the Google Cloud console, go to the\n **Cloud Logging \\\u003e Logs Explorer** page:\n\n [Go Logs Explorer](https://console.cloud.google.com/logs/query)\n2. In the **All resources** drop-down,\n select\n **Cloud Dataproc Cluster \\\u003e **`cdap-`\u003cvar translate=\"no\"\u003ePIPELINE_NAME\u003c/var\u003e`-`\u003cvar translate=\"no\"\u003eYOUR_RUNID\u003c/var\u003e****.\n\n### Optional: Filter the logs\n\nUse the filter menus to filter your logs. You can filter by various log\nseverity levels\nor by components such as `datafusion-pipeline-logs`.\n\n### Optional: Download the logs\n\nClick **Download logs**.\n\nFor more information, see\n[downloading log entries](/logging/docs/view/logs-explorer-interface#download_logs).\n\nWhat's next\n-----------\n\n- Learn how to [view audit logs](/data-fusion/docs/how-to/audit-logging).\n- Learn how to [view pipeline logs from the Cloud Data Fusion Pipeline Studio](/data-fusion/docs/how-to/view-and-download-pipeline-logs)."]]
