对于目标发现，Managed Service for Prometheus Operator 需要与同一命名空间中的 StatsD 对应的 PodMonitoring 资源。
您可以使用以下 PodMonitoring 配置：
# Copyright 2022 Google LLC## Licensed under the Apache License, Version 2.0 (the "License");# you may not use this file except in compliance with the License.# You may obtain a copy of the License at## https://www.apache.org/licenses/LICENSE-2.0## Unless required by applicable law or agreed to in writing, software# distributed under the License is distributed on an "AS IS" BASIS,# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.# See the License for the specific language governing permissions and# limitations under the License.apiVersion:monitoring.googleapis.com/v1kind:PodMonitoringmetadata:name:airflowlabels:app.kubernetes.io/name:airflowapp.kubernetes.io/part-of:google-cloud-managed-prometheusspec:endpoints:-port:9102scheme:httpinterval:30spath:/metricsselector:matchLabels:tier:airflowcomponent:statsdrelease:airflow
确保 port 和 matchLabels 字段的值与要监控的 StatsD pod 的值相匹配。使用 Helm 部署 Airflow 时，系统会默认设置此处显示的标签和值。
# Copyright 2022 Google LLC## Licensed under the Apache License, Version 2.0 (the "License");# you may not use this file except in compliance with the License.# You may obtain a copy of the License at## https://www.apache.org/licenses/LICENSE-2.0## Unless required by applicable law or agreed to in writing, software# distributed under the License is distributed on an "AS IS" BASIS,# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.# See the License for the specific language governing permissions and# limitations under the License.apiVersion:monitoring.googleapis.com/v1kind:Rulesmetadata:name:airflow-ruleslabels:app.kubernetes.io/component:rulesapp.kubernetes.io/name:airflow-rulesapp.kubernetes.io/part-of:google-cloud-managed-prometheusspec:groups:-name:airflowinterval:30srules:-alert:AirflowDAGImportErrorsannotations:description:|-Airflow dag import errorsVALUE = {{ $value }}LABELS: {{ $labels }}summary:Airflow dag import errors (instance {{ $labels.instance }})expr:airflow_dag_processing_import_errors > 0for:5mlabels:severity:critical
[[["易于理解","easyToUnderstand","thumb-up"],["解决了我的问题","solvedMyProblem","thumb-up"],["其他","otherUp","thumb-up"]],[["很难理解","hardToUnderstand","thumb-down"],["信息或示例代码不正确","incorrectInformationOrSampleCode","thumb-down"],["没有我需要的信息/示例","missingTheInformationSamplesINeed","thumb-down"],["翻译问题","translationIssue","thumb-down"],["其他","otherDown","thumb-down"]],["最后更新时间 (UTC)：2025-07-31。"],[],[],null,["# Apache Airflow\n\n\u003cbr /\u003e\n\nThis document describes how to configure your Google Kubernetes Engine deployment\nso that you can use Google Cloud Managed Service for Prometheus to collect metrics from\n\nApache Airflow. This document shows you how to do the following:\n\n- Set up Airflow to report metrics.\n- Configure a PodMonitoring resource for Managed Service for Prometheus to collect the exported metrics.\n- Access a dashboard in Cloud Monitoring to view the metrics.\n- Configure alerting rules to monitor the metrics.\n\n\u003cbr /\u003e\n\nThese instructions apply only if you are using [managed collection](/stackdriver/docs/managed-prometheus/setup-managed)\nwith Managed Service for Prometheus.\nIf you are using self-deployed collection, then see the\n\n[Airflow documentation](https://airflow.apache.org/docs/apache-airflow/stable/logging-monitoring/metrics.html)\n\nfor installation information.\n\nThese instructions are provided as an example and are expected to work in\nmost Kubernetes environments.\n\nIf you are having trouble installing an\napplication or exporter due to restrictive security or organizational policies,\nthen we recommend you consult open-source documentation for support.\n\nFor information about Apache Airflow, see [Airflow](https://airflow.apache.org/).\n\nPrerequisites\n-------------\n\nTo collect metrics from\n\nStatsD\n\nby using\nManaged Service for Prometheus and managed collection, your deployment must\nmeet the following requirements:\n\n- Your cluster must be running Google Kubernetes Engine version 1.21.4-gke.300 or later.\n- You must be running Managed Service for Prometheus with managed collection enabled. For more information, see [Get started with managed collection](/stackdriver/docs/managed-prometheus/setup-managed).\n\n \u003cbr /\u003e\n\n\u003cbr /\u003e\n\nThe official Airflow [Helm chart](https://airflow.apache.org/docs/helm-chart/) includes a StatsD deployment that exposes Prometheus-format metrics automatically.\n\n\u003cbr /\u003e\n\nTo verify that StatsD is emitting metrics on the expected endpoints,\ndo the following:\n\n1. Set up port forwarding by using the following command: \n\n ```\n kubectl -n NAMESPACE_NAME port-forward deploy/AIRFLOW_RELEASE_NAME-statsd 9102\n ```\n2. Access the endpoint `localhost:9102/metrics` by using the browser or the `curl` utility in another terminal session.\n\nDefine a PodMonitoring resource\n-------------------------------\n\nFor target discovery, the Managed Service for Prometheus Operator\nrequires a PodMonitoring resource that corresponds to StatsD\nin the same namespace.\n\nYou can use the following PodMonitoring configuration: \n\n # Copyright 2022 Google LLC\n #\n # Licensed under the Apache License, Version 2.0 (the \"License\");\n # you may not use this file except in compliance with the License.\n # You may obtain a copy of the License at\n #\n # https://www.apache.org/licenses/LICENSE-2.0\n #\n # Unless required by applicable law or agreed to in writing, software\n # distributed under the License is distributed on an \"AS IS\" BASIS,\n # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.\n # See the License for the specific language governing permissions and\n # limitations under the License.\n\n apiVersion: monitoring.googleapis.com/v1\n kind: PodMonitoring\n metadata:\n name: airflow\n labels:\n app.kubernetes.io/name: airflow\n app.kubernetes.io/part-of: google-cloud-managed-prometheus\n spec:\n endpoints:\n - port: 9102\n scheme: http\n interval: 30s\n path: /metrics\n selector:\n matchLabels:\n tier: airflow\n component: statsd\n release: airflow\n\nEnsure that the values of the `port` and `matchLabels` fields match those of the StatsD pods you want to monitor. The labels and values shown here are set by default when Airflow is deployed with [Helm](https://airflow.apache.org/docs/helm-chart/).\n\nTo apply configuration changes from a local file, run the following command:\n\n```\nkubectl apply -n NAMESPACE_NAME -f FILE_NAME\n```\n\n\u003cbr /\u003e\n\nYou can also\n[use Terraform](/stackdriver/docs/managed-prometheus/setup-managed#terraform-scrape)\nto manage your configurations.\n\nDefine rules and alerts\n-----------------------\n\nYou can use the following `Rules` configuration to define\nalerts on your Airflow metrics: \n\n # Copyright 2022 Google LLC\n #\n # Licensed under the Apache License, Version 2.0 (the \"License\");\n # you may not use this file except in compliance with the License.\n # You may obtain a copy of the License at\n #\n # https://www.apache.org/licenses/LICENSE-2.0\n #\n # Unless required by applicable law or agreed to in writing, software\n # distributed under the License is distributed on an \"AS IS\" BASIS,\n # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.\n # See the License for the specific language governing permissions and\n # limitations under the License.\n\n apiVersion: monitoring.googleapis.com/v1\n kind: Rules\n metadata:\n name: airflow-rules\n labels:\n app.kubernetes.io/component: rules\n app.kubernetes.io/name: airflow-rules\n app.kubernetes.io/part-of: google-cloud-managed-prometheus\n spec:\n groups:\n - name: airflow\n interval: 30s\n rules:\n - alert: AirflowDAGImportErrors\n annotations:\n description: |-\n Airflow dag import errors\n VALUE = {{ $value }}\n LABELS: {{ $labels }}\n summary: Airflow dag import errors (instance {{ $labels.instance }})\n expr: airflow_dag_processing_import_errors \u003e 0\n for: 5m\n labels:\n severity: critical\n\nTo apply configuration changes from a local file, run the following command:\n\n```\nkubectl apply -n NAMESPACE_NAME -f FILE_NAME\n```\n\n\u003cbr /\u003e\n\nYou can also\n[use Terraform](/stackdriver/docs/managed-prometheus/setup-managed#terraform-scrape)\nto manage your configurations.\n\nFor more information about applying rules to your cluster, see\n[Managed rule evaluation and alerting](/stackdriver/docs/managed-prometheus/rules-managed).\nYou can adjust the alert thresholds to suit your application.\n\nVerify the configuration\n------------------------\n\nYou can use Metrics Explorer to verify that you correctly configured\nStatsD. It might take one or two minutes for\nCloud Monitoring to ingest your metrics.\n\nTo verify the metrics are ingested, do the following:\n\n1. In the Google Cloud console, go to the\n *leaderboard* **Metrics explorer** page:\n\n [Go to **Metrics explorer**](https://console.cloud.google.com/monitoring/metrics-explorer)\n\n \u003cbr /\u003e\n\n If you use the search bar to find this page, then select the result whose subheading is\n **Monitoring**.\n2. In the toolbar of the query-builder pane, select the button whose name is either *code* **MQL** or *code* **PromQL**.\n3. Verify that **PromQL** is selected in the **Language** toggle. The language toggle is in the same toolbar that lets you format your query.\n4. Enter and run the following query: \n\n ```\n up{job=\"airflow\", cluster=\"CLUSTER_NAME\", namespace=\"NAMESPACE_NAME\"}\n ```\n\n\u003cbr /\u003e\n\nView dashboards\n---------------\n\nThe Cloud Monitoring integration includes\n\nthe **Airflow Prometheus Overview** dashboard.\n\nDashboards are automatically installed when you configure the integration.\nYou can also view static previews of dashboards without installing the\nintegration.\n\n\nTo view an installed dashboard, do the following:\n\n1. In the Google Cloud console, go to the **Dashboards** page:\n\n [Go to **Dashboards**](https://console.cloud.google.com/monitoring/dashboards)\n\n \u003cbr /\u003e\n\n If you use the search bar to find this page, then select the result whose subheading is\n **Monitoring**.\n2. Select the **Dashboard List** tab.\n3. Choose the **Integrations** category.\n4. Click the name of the dashboard, for example, **Airflow Prometheus Overview**.\n\n\u003cbr /\u003e\n\nTo view a static preview of the dashboard, do the following:\n\n1. In the Google Cloud console, go to the\n **Integrations**\n page:\n\n [Go to **Integrations**](https://console.cloud.google.com/monitoring/integrations)\n\n \u003cbr /\u003e\n\n If you use the search bar to find this page, then select the result whose subheading is\n **Monitoring**.\n2. Click the **Kubernetes Engine** deployment-platform filter.\n3. Locate the Apache Airflow integration and click **View Details**.\n4. Select the **Dashboards** tab.\n\n\u003cbr /\u003e\n\nTroubleshooting\n---------------\n\nFor information about troubleshooting metric ingestion problems, see\n[Problems with collection from exporters](/stackdriver/docs/managed-prometheus/troubleshooting#exporter-problems) in [Troubleshooting ingestion-side problems](/stackdriver/docs/managed-prometheus/troubleshooting#ingest-problems)."]]
信息中心页面：
集成页面：