Airflow web interface

Apache Airflow includes a web interface that you can use to manage workflows (DAGs), manage the Airflow environment, and perform administrative actions. For example, you can use the web interface to review the progress of a DAG, set up a new data connection, or review logs from previous DAG runs.

Each Cloud Composer environment has a web server that runs the Airflow web interface. The web server is separate from your environment's GKE cluster and runs on a App Engine instance with a fixed machine type. The web server parses the DAG definition files in the dags/ folder and must be able to access a DAG's data and resources.

Before you begin

  • The following permission is required to access the Airflow web server in the Cloud Composer environment: composer.environments.get. For more information, see Cloud Composer Access Control.

  • During environment creation, Cloud Composer configures the URL for the web server that runs the Airflow web interface. The URL is non-customizable.

  • For Cloud Composer environments running Airflow 1.10, the Roles Based Access Control (RBAC) feature for the Airflow web interface is not supported.

Accessing the web interface

The Airflow web server service is deployed to the domain and provides access to the Airflow web interface. Cloud Identity-Aware Proxy protects the interface, guarding access based on user identities.

After creating a new Cloud Composer environment, it takes up to one hour for the web interface to finish hosting and become accessible.

Accessing the web interface via the Google Cloud Platform Console

To access the Airflow web interface from the Google Cloud Platform Console:

  1. To view your existing Cloud Composer environments, open the Environments page.

    Open the Environments page

  2. In the Airflow websever column, click the new window icon for the environment whose Airflow web interface you want to view.
  3. Log in with the Google account that has the appropriate permissions.

Retrieving the web interface URL via the gcloud command-line tool

You can access the Airflow web interface from any web browser. To get the URL for the web interface, enter the following gcloud command:

gcloud composer environments describe ENVIRONMENT_NAME \
--location LOCATION


  • ENVIRONMENT_NAME is the name of the environment.
  • LOCATION is the Compute Engine region where the environment is located.

The gcloud command shows the properties of a Cloud Composer environment, including the URL for the web interface. The URL is listed as airflowUri.

  dagGcsPrefix: gs://us-central1-example-environment-00a47695-bucket/dags
  gkeCluster: projects/example-project/zones/us-central1-a/clusters/us-central1-example-environment-00a47695-gke
    diskSizeGb: 100
    location: projects/example-project/zones/us-central1-a
    machineType: projects/example-project/zones/us-central1-a/machineTypes/n1-standard-1
    network: projects/example-project/global/networks/default
  nodeCount: 3
    imageVersion: composer-0.5.1-airflow-1.9.0
createTime: '2018-05-19T02:13:36.749Z'
name: projects/example-project/locations/us-central1/environments/example-environment
state: RUNNING
updateTime: '2018-05-19T02:30:21.387Z'
uuid: 66bd6a28-5b48-4da3-a0aa-898199b569da
Оцените, насколько информация на этой странице была вам полезна:

Оставить отзыв о...

Текущей странице
Cloud Composer