Cloud Composer V1 API - Class Google::Cloud::Orchestration::Airflow::Service::V1::Environments::Rest::Client (v0.7.0)

Reference documentation and code samples for the Cloud Composer V1 API class Google::Cloud::Orchestration::Airflow::Service::V1::Environments::Rest::Client.

REST client for the Environments service.

Managed Apache Airflow Environments.

Inherits

  • Object

Includes

Methods

.configure

def self.configure() { |config| ... } -> Client::Configuration

Configure the Environments Client class.

See Configuration for a description of the configuration fields.

Yields
  • (config) — Configure the Client client.
Yield Parameter
Returns
Example 
# Modify the configuration for all Environments clients
::Google::Cloud::Orchestration::Airflow::Service::V1::Environments::Rest::Client.configure do |config|
  config.timeout = 10.0
end

#configure

def configure() { |config| ... } -> Client::Configuration

Configure the Environments Client instance.

The configuration is set to the derived mode, meaning that values can be changed, but structural changes (adding new fields, etc.) are not allowed. Structural changes should be made on Client.configure.

See Configuration for a description of the configuration fields.

Yields
  • (config) — Configure the Client client.
Yield Parameter
Returns

#create_environment

def create_environment(request, options = nil) -> ::Gapic::Operation
def create_environment(parent: nil, environment: nil) -> ::Gapic::Operation

Create a new environment.

Overloads 
def create_environment(request, options = nil) -> ::Gapic::Operation
Pass arguments to create_environment via a request object, either of type CreateEnvironmentRequest or an equivalent Hash.
Parameters 
def create_environment(parent: nil, environment: nil) -> ::Gapic::Operation
Pass arguments to create_environment via keyword arguments. Note that at least one keyword argument is required. To specify no parameters, or to keep all the default parameter values, pass an empty Hash as a request object (see above).
Parameters
Yields
  • (result, operation) — Access the result along with the TransportOperation object
Yield Parameters
  • result (::Gapic::Operation)
  • operation (::Gapic::Rest::TransportOperation)
Returns
  • (::Gapic::Operation)
Raises
  • (::Google::Cloud::Error) — if the REST call is aborted.

#database_failover

def database_failover(request, options = nil) -> ::Gapic::Operation
def database_failover(environment: nil) -> ::Gapic::Operation

Triggers database failover (only for highly resilient environments).

Overloads 
def database_failover(request, options = nil) -> ::Gapic::Operation
Pass arguments to database_failover via a request object, either of type DatabaseFailoverRequest or an equivalent Hash.
Parameters 
def database_failover(environment: nil) -> ::Gapic::Operation
Pass arguments to database_failover via keyword arguments. Note that at least one keyword argument is required. To specify no parameters, or to keep all the default parameter values, pass an empty Hash as a request object (see above).
Parameter
  • environment (::String) — Target environment: "projects/{projectId}/locations/{locationId}/environments/{environmentId}"
Yields
  • (result, operation) — Access the result along with the TransportOperation object
Yield Parameters
  • result (::Gapic::Operation)
  • operation (::Gapic::Rest::TransportOperation)
Returns
  • (::Gapic::Operation)
Raises
  • (::Google::Cloud::Error) — if the REST call is aborted.

#delete_environment

def delete_environment(request, options = nil) -> ::Gapic::Operation
def delete_environment(name: nil) -> ::Gapic::Operation

Delete an environment.

Overloads 
def delete_environment(request, options = nil) -> ::Gapic::Operation
Pass arguments to delete_environment via a request object, either of type DeleteEnvironmentRequest or an equivalent Hash.
Parameters 
def delete_environment(name: nil) -> ::Gapic::Operation
Pass arguments to delete_environment via keyword arguments. Note that at least one keyword argument is required. To specify no parameters, or to keep all the default parameter values, pass an empty Hash as a request object (see above).
Parameter
  • name (::String) — The environment to delete, in the form: "projects/{projectId}/locations/{locationId}/environments/{environmentId}"
Yields
  • (result, operation) — Access the result along with the TransportOperation object
Yield Parameters
  • result (::Gapic::Operation)
  • operation (::Gapic::Rest::TransportOperation)
Returns
  • (::Gapic::Operation)
Raises
  • (::Google::Cloud::Error) — if the REST call is aborted.

#execute_airflow_command

def execute_airflow_command(request, options = nil) -> ::Google::Cloud::Orchestration::Airflow::Service::V1::ExecuteAirflowCommandResponse
def execute_airflow_command(environment: nil, command: nil, subcommand: nil, parameters: nil) -> ::Google::Cloud::Orchestration::Airflow::Service::V1::ExecuteAirflowCommandResponse

Executes Airflow CLI command.

Overloads 
def execute_airflow_command(request, options = nil) -> ::Google::Cloud::Orchestration::Airflow::Service::V1::ExecuteAirflowCommandResponse
Pass arguments to execute_airflow_command via a request object, either of type Google::Cloud::Orchestration::Airflow::Service::V1::ExecuteAirflowCommandRequest or an equivalent Hash.
Parameters 
def execute_airflow_command(environment: nil, command: nil, subcommand: nil, parameters: nil) -> ::Google::Cloud::Orchestration::Airflow::Service::V1::ExecuteAirflowCommandResponse
Pass arguments to execute_airflow_command via keyword arguments. Note that at least one keyword argument is required. To specify no parameters, or to keep all the default parameter values, pass an empty Hash as a request object (see above).
Parameters
  • environment (::String) — The resource name of the environment in the form: "projects/{projectId}/locations/{locationId}/environments/{environmentId}".
  • command (::String) — Airflow command.
  • subcommand (::String) — Airflow subcommand.
  • parameters (::Array<::String>) — Parameters for the Airflow command/subcommand as an array of arguments. It may contain positional arguments like ["my-dag-id"], key-value parameters like ["--foo=bar"] or ["--foo","bar"], or other flags like ["-f"].
Yields
  • (result, operation) — Access the result along with the TransportOperation object
Yield Parameters
Returns
Raises
  • (::Google::Cloud::Error) — if the REST call is aborted.

#fetch_database_properties

def fetch_database_properties(request, options = nil) -> ::Google::Cloud::Orchestration::Airflow::Service::V1::FetchDatabasePropertiesResponse
def fetch_database_properties(environment: nil) -> ::Google::Cloud::Orchestration::Airflow::Service::V1::FetchDatabasePropertiesResponse

Fetches database properties.

Overloads 
def fetch_database_properties(request, options = nil) -> ::Google::Cloud::Orchestration::Airflow::Service::V1::FetchDatabasePropertiesResponse
Pass arguments to fetch_database_properties via a request object, either of type FetchDatabasePropertiesRequest or an equivalent Hash.
Parameters 
def fetch_database_properties(environment: nil) -> ::Google::Cloud::Orchestration::Airflow::Service::V1::FetchDatabasePropertiesResponse
Pass arguments to fetch_database_properties via keyword arguments. Note that at least one keyword argument is required. To specify no parameters, or to keep all the default parameter values, pass an empty Hash as a request object (see above).
Parameter
  • environment (::String) — Required. The resource name of the environment, in the form: "projects/{projectId}/locations/{locationId}/environments/{environmentId}"
Yields
  • (result, operation) — Access the result along with the TransportOperation object
Yield Parameters
Returns
Raises
  • (::Google::Cloud::Error) — if the REST call is aborted.

#get_environment

def get_environment(request, options = nil) -> ::Google::Cloud::Orchestration::Airflow::Service::V1::Environment
def get_environment(name: nil) -> ::Google::Cloud::Orchestration::Airflow::Service::V1::Environment

Get an existing environment.

Overloads 
def get_environment(request, options = nil) -> ::Google::Cloud::Orchestration::Airflow::Service::V1::Environment
Pass arguments to get_environment via a request object, either of type GetEnvironmentRequest or an equivalent Hash.
Parameters
  • request (::Google::Cloud::Orchestration::Airflow::Service::V1::GetEnvironmentRequest, ::Hash) — A request object representing the call parameters. Required. To specify no parameters, or to keep all the default parameter values, pass an empty Hash.
  • options (::Gapic::CallOptions, ::Hash) — Overrides the default settings for this call, e.g, timeout, retries etc. Optional. 
def get_environment(name: nil) -> ::Google::Cloud::Orchestration::Airflow::Service::V1::Environment
Pass arguments to get_environment via keyword arguments. Note that at least one keyword argument is required. To specify no parameters, or to keep all the default parameter values, pass an empty Hash as a request object (see above).
Parameter
  • name (::String) — The resource name of the environment to get, in the form: "projects/{projectId}/locations/{locationId}/environments/{environmentId}"
Yields
  • (result, operation) — Access the result along with the TransportOperation object
Yield Parameters
Returns
Raises
  • (::Google::Cloud::Error) — if the REST call is aborted.

#initialize

def initialize() { |config| ... } -> Client

Create a new Environments REST client object.

Yields
  • (config) — Configure the Environments client.
Yield Parameter
Returns
  • (Client) — a new instance of Client
Example 
# Create a client using the default configuration
client = ::Google::Cloud::Orchestration::Airflow::Service::V1::Environments::Rest::Client.new

# Create a client using a custom configuration
client = ::Google::Cloud::Orchestration::Airflow::Service::V1::Environments::Rest::Client.new do |config|
  config.timeout = 10.0
end

#list_environments

def list_environments(request, options = nil) -> ::Gapic::Rest::PagedEnumerable<::Google::Cloud::Orchestration::Airflow::Service::V1::Environment>
def list_environments(parent: nil, page_size: nil, page_token: nil) -> ::Gapic::Rest::PagedEnumerable<::Google::Cloud::Orchestration::Airflow::Service::V1::Environment>

List environments.

Overloads 
def list_environments(request, options = nil) -> ::Gapic::Rest::PagedEnumerable<::Google::Cloud::Orchestration::Airflow::Service::V1::Environment>
Pass arguments to list_environments via a request object, either of type ListEnvironmentsRequest or an equivalent Hash.
Parameters 
def list_environments(parent: nil, page_size: nil, page_token: nil) -> ::Gapic::Rest::PagedEnumerable<::Google::Cloud::Orchestration::Airflow::Service::V1::Environment>
Pass arguments to list_environments via keyword arguments. Note that at least one keyword argument is required. To specify no parameters, or to keep all the default parameter values, pass an empty Hash as a request object (see above).
Parameters
  • parent (::String) — List environments in the given project and location, in the form: "projects/{projectId}/locations/{locationId}"
  • page_size (::Integer) — The maximum number of environments to return.
  • page_token (::String) — The next_page_token value returned from a previous List request, if any.
Yields
  • (result, operation) — Access the result along with the TransportOperation object
Yield Parameters
Returns
Raises
  • (::Google::Cloud::Error) — if the REST call is aborted.

#load_snapshot

def load_snapshot(request, options = nil) -> ::Gapic::Operation
def load_snapshot(environment: nil, snapshot_path: nil, skip_pypi_packages_installation: nil, skip_environment_variables_setting: nil, skip_airflow_overrides_setting: nil, skip_gcs_data_copying: nil) -> ::Gapic::Operation

Loads a snapshot of a Cloud Composer environment.

As a result of this operation, a snapshot of environment's specified in LoadSnapshotRequest is loaded into the environment.

Overloads 
def load_snapshot(request, options = nil) -> ::Gapic::Operation
Pass arguments to load_snapshot via a request object, either of type LoadSnapshotRequest or an equivalent Hash.
Parameters
  • request (::Google::Cloud::Orchestration::Airflow::Service::V1::LoadSnapshotRequest, ::Hash) — A request object representing the call parameters. Required. To specify no parameters, or to keep all the default parameter values, pass an empty Hash.
  • options (::Gapic::CallOptions, ::Hash) — Overrides the default settings for this call, e.g, timeout, retries etc. Optional. 
def load_snapshot(environment: nil, snapshot_path: nil, skip_pypi_packages_installation: nil, skip_environment_variables_setting: nil, skip_airflow_overrides_setting: nil, skip_gcs_data_copying: nil) -> ::Gapic::Operation
Pass arguments to load_snapshot via keyword arguments. Note that at least one keyword argument is required. To specify no parameters, or to keep all the default parameter values, pass an empty Hash as a request object (see above).
Parameters
  • environment (::String) — The resource name of the target environment in the form: "projects/{projectId}/locations/{locationId}/environments/{environmentId}"
  • snapshot_path (::String) — A Cloud Storage path to a snapshot to load, e.g.: "gs://my-bucket/snapshots/project_location_environment_timestamp".
  • skip_pypi_packages_installation (::Boolean) — Whether or not to skip installing Pypi packages when loading the environment's state.
  • skip_environment_variables_setting (::Boolean) — Whether or not to skip setting environment variables when loading the environment's state.
  • skip_airflow_overrides_setting (::Boolean) — Whether or not to skip setting Airflow overrides when loading the environment's state.
  • skip_gcs_data_copying (::Boolean) — Whether or not to skip copying Cloud Storage data when loading the environment's state.
Yields
  • (result, operation) — Access the result along with the TransportOperation object
Yield Parameters
  • result (::Gapic::Operation)
  • operation (::Gapic::Rest::TransportOperation)
Returns
  • (::Gapic::Operation)
Raises
  • (::Google::Cloud::Error) — if the REST call is aborted.

#operations_client

def operations_client() -> ::Google::Cloud::Orchestration::Airflow::Service::V1::Environments::Rest::Operations

Get the associated client for long-running operations.

Returns

#poll_airflow_command

def poll_airflow_command(request, options = nil) -> ::Google::Cloud::Orchestration::Airflow::Service::V1::PollAirflowCommandResponse
def poll_airflow_command(environment: nil, execution_id: nil, pod: nil, pod_namespace: nil, next_line_number: nil) -> ::Google::Cloud::Orchestration::Airflow::Service::V1::PollAirflowCommandResponse

Polls Airflow CLI command execution and fetches logs.

Overloads 
def poll_airflow_command(request, options = nil) -> ::Google::Cloud::Orchestration::Airflow::Service::V1::PollAirflowCommandResponse
Pass arguments to poll_airflow_command via a request object, either of type PollAirflowCommandRequest or an equivalent Hash.
Parameters 
def poll_airflow_command(environment: nil, execution_id: nil, pod: nil, pod_namespace: nil, next_line_number: nil) -> ::Google::Cloud::Orchestration::Airflow::Service::V1::PollAirflowCommandResponse
Pass arguments to poll_airflow_command via keyword arguments. Note that at least one keyword argument is required. To specify no parameters, or to keep all the default parameter values, pass an empty Hash as a request object (see above).
Parameters
  • environment (::String) — The resource name of the environment in the form: "projects/{projectId}/locations/{locationId}/environments/{environmentId}"
  • execution_id (::String) — The unique ID of the command execution.
  • pod (::String) — The name of the pod where the command is executed.
  • pod_namespace (::String) — The namespace of the pod where the command is executed.
  • next_line_number (::Integer) — Line number from which new logs should be fetched.
Yields
  • (result, operation) — Access the result along with the TransportOperation object
Yield Parameters
Returns
Raises
  • (::Google::Cloud::Error) — if the REST call is aborted.

#save_snapshot

def save_snapshot(request, options = nil) -> ::Gapic::Operation
def save_snapshot(environment: nil, snapshot_location: nil) -> ::Gapic::Operation

Creates a snapshots of a Cloud Composer environment.

As a result of this operation, snapshot of environment's state is stored in a location specified in the SaveSnapshotRequest.

Overloads 
def save_snapshot(request, options = nil) -> ::Gapic::Operation
Pass arguments to save_snapshot via a request object, either of type SaveSnapshotRequest or an equivalent Hash.
Parameters
  • request (::Google::Cloud::Orchestration::Airflow::Service::V1::SaveSnapshotRequest, ::Hash) — A request object representing the call parameters. Required. To specify no parameters, or to keep all the default parameter values, pass an empty Hash.
  • options (::Gapic::CallOptions, ::Hash) — Overrides the default settings for this call, e.g, timeout, retries etc. Optional. 
def save_snapshot(environment: nil, snapshot_location: nil) -> ::Gapic::Operation
Pass arguments to save_snapshot via keyword arguments. Note that at least one keyword argument is required. To specify no parameters, or to keep all the default parameter values, pass an empty Hash as a request object (see above).
Parameters
  • environment (::String) — The resource name of the source environment in the form: "projects/{projectId}/locations/{locationId}/environments/{environmentId}"
  • snapshot_location (::String) — Location in a Cloud Storage where the snapshot is going to be stored, e.g.: "gs://my-bucket/snapshots".
Yields
  • (result, operation) — Access the result along with the TransportOperation object
Yield Parameters
  • result (::Gapic::Operation)
  • operation (::Gapic::Rest::TransportOperation)
Returns
  • (::Gapic::Operation)
Raises
  • (::Google::Cloud::Error) — if the REST call is aborted.

#stop_airflow_command

def stop_airflow_command(request, options = nil) -> ::Google::Cloud::Orchestration::Airflow::Service::V1::StopAirflowCommandResponse
def stop_airflow_command(environment: nil, execution_id: nil, pod: nil, pod_namespace: nil, force: nil) -> ::Google::Cloud::Orchestration::Airflow::Service::V1::StopAirflowCommandResponse

Stops Airflow CLI command execution.

Overloads 
def stop_airflow_command(request, options = nil) -> ::Google::Cloud::Orchestration::Airflow::Service::V1::StopAirflowCommandResponse
Pass arguments to stop_airflow_command via a request object, either of type StopAirflowCommandRequest or an equivalent Hash.
Parameters 
def stop_airflow_command(environment: nil, execution_id: nil, pod: nil, pod_namespace: nil, force: nil) -> ::Google::Cloud::Orchestration::Airflow::Service::V1::StopAirflowCommandResponse
Pass arguments to stop_airflow_command via keyword arguments. Note that at least one keyword argument is required. To specify no parameters, or to keep all the default parameter values, pass an empty Hash as a request object (see above).
Parameters
  • environment (::String) — The resource name of the environment in the form: "projects/{projectId}/locations/{locationId}/environments/{environmentId}".
  • execution_id (::String) — The unique ID of the command execution.
  • pod (::String) — The name of the pod where the command is executed.
  • pod_namespace (::String) — The namespace of the pod where the command is executed.
  • force (::Boolean) — If true, the execution is terminated forcefully (SIGKILL). If false, the execution is stopped gracefully, giving it time for cleanup.
Yields
  • (result, operation) — Access the result along with the TransportOperation object
Yield Parameters
Returns
Raises
  • (::Google::Cloud::Error) — if the REST call is aborted.

#update_environment

def update_environment(request, options = nil) -> ::Gapic::Operation
def update_environment(name: nil, environment: nil, update_mask: nil) -> ::Gapic::Operation

Update an environment.

Overloads 
def update_environment(request, options = nil) -> ::Gapic::Operation
Pass arguments to update_environment via a request object, either of type UpdateEnvironmentRequest or an equivalent Hash.
Parameters 
def update_environment(name: nil, environment: nil, update_mask: nil) -> ::Gapic::Operation
Pass arguments to update_environment via keyword arguments. Note that at least one keyword argument is required. To specify no parameters, or to keep all the default parameter values, pass an empty Hash as a request object (see above).
Parameters
  • name (::String) — The relative resource name of the environment to update, in the form: "projects/{projectId}/locations/{locationId}/environments/{environmentId}"
  • environment (::Google::Cloud::Orchestration::Airflow::Service::V1::Environment, ::Hash) — A patch environment. Fields specified by the updateMask will be copied from the patch environment into the environment under update.
  • update_mask (::Google::Protobuf::FieldMask, ::Hash) —

    Required. A comma-separated list of paths, relative to Environment, of fields to update. For example, to set the version of scikit-learn to install in the environment to 0.19.0 and to remove an existing installation of numpy, the updateMask parameter would include the following two paths values: "config.softwareConfig.pypiPackages.scikit-learn" and "config.softwareConfig.pypiPackages.numpy". The included patch environment would specify the scikit-learn version as follows:

    {
  "config":{
    "softwareConfig":{
      "pypiPackages":{
        "scikit-learn":"==0.19.0"
      }
    }
  }
}

    Note that in the above example, any existing PyPI packages other than scikit-learn and numpy will be unaffected.

    Only one update type may be included in a single request's updateMask. For example, one cannot update both the PyPI packages and labels in the same request. However, it is possible to update multiple members of a map field simultaneously in the same request. For example, to set the labels "label1" and "label2" while clearing "label3" (assuming it already exists), one can provide the paths "labels.label1", "labels.label2", and "labels.label3" and populate the patch environment as follows:

    {
  "labels":{
    "label1":"new-label1-value"
    "label2":"new-label2-value"
  }
}

    Note that in the above example, any existing labels that are not included in the updateMask will be unaffected.

    It is also possible to replace an entire map field by providing the map field's path in the updateMask. The new value of the field will be that which is provided in the patch environment. For example, to delete all pre-existing user-specified PyPI packages and install botocore at version 1.7.14, the updateMask would contain the path "config.softwareConfig.pypiPackages", and the patch environment would be the following:

    {
  "config":{
    "softwareConfig":{
      "pypiPackages":{
        "botocore":"==1.7.14"
      }
    }
  }
}

    Note: Only the following fields can be updated:

    • config.softwareConfig.pypiPackages
      • Replace all custom custom PyPI packages. If a replacement package map is not included in environment, all custom PyPI packages are cleared. It is an error to provide both this mask and a mask specifying an individual package.
    • config.softwareConfig.pypiPackages.packagename
      • Update the custom PyPI package packagename, preserving other packages. To delete the package, include it in updateMask, and omit the mapping for it in environment.config.softwareConfig.pypiPackages. It is an error to provide both a mask of this form and the config.softwareConfig.pypiPackages mask.
    • labels
      • Replace all environment labels. If a replacement labels map is not included in environment, all labels are cleared. It is an error to provide both this mask and a mask specifying one or more individual labels.
    • labels.labelName
      • Set the label named labelName, while preserving other labels. To delete the label, include it in updateMask and omit its mapping in environment.labels. It is an error to provide both a mask of this form and the labels mask.
    • config.nodeCount
      • Horizontally scale the number of nodes in the environment. An integer greater than or equal to 3 must be provided in the config.nodeCount field. Supported for Cloud Composer environments in versions composer-1..-airflow-..*.
    • config.webServerNetworkAccessControl
      • Replace the environment's current WebServerNetworkAccessControl.
    • config.softwareConfig.airflowConfigOverrides
      • Replace all Apache Airflow config overrides. If a replacement config overrides map is not included in environment, all config overrides are cleared. It is an error to provide both this mask and a mask specifying one or more individual config overrides.
    • config.softwareConfig.airflowConfigOverrides.section-name
      • Override the Apache Airflow config property name in the section named section, preserving other properties. To delete the property override, include it in updateMask and omit its mapping in environment.config.softwareConfig.airflowConfigOverrides. It is an error to provide both a mask of this form and the config.softwareConfig.airflowConfigOverrides mask.
    • config.softwareConfig.envVariables
      • Replace all environment variables. If a replacement environment variable map is not included in environment, all custom environment variables are cleared.
    • config.softwareConfig.schedulerCount
      • Horizontally scale the number of schedulers in Airflow. A positive integer not greater than the number of nodes must be provided in the config.softwareConfig.schedulerCount field. Supported for Cloud Composer environments in versions composer-1..-airflow-2...
    • config.databaseConfig.machineType
      • Cloud SQL machine type used by Airflow database. It has to be one of: db-n1-standard-2, db-n1-standard-4, db-n1-standard-8 or db-n1-standard-16. Supported for Cloud Composer environments in versions composer-1..-airflow-..*.
    • config.webServerConfig.machineType
      • Machine type on which Airflow web server is running. It has to be one of: composer-n1-webserver-2, composer-n1-webserver-4 or composer-n1-webserver-8. Supported for Cloud Composer environments in versions composer-1..-airflow-..*.
Yields
  • (result, operation) — Access the result along with the TransportOperation object
Yield Parameters
  • result (::Gapic::Operation)
  • operation (::Gapic::Rest::TransportOperation)
Returns
  • (::Gapic::Operation)
Raises
  • (::Google::Cloud::Error) — if the REST call is aborted.