See the supported connectors for Application Integration.
Connectors task
The Connectors task lets you seamlessly connect to the various Google Cloud services and other business applications from your integration using the out-of-the-box connectors available in Integration Connectors.
For the list of all the supported connectors for Application Integration, see Connector reference.Before you begin
Ensure that you have an active connection created in Integration Connectors using the same Google Cloud project as your integration.
For information about how to create and manage connections, see Create and manage connections.
Configure the Connectors task
To configure a Connectors task, perform the following steps:
- In the Google Cloud console, go to the Application Integration page.
- In the navigation menu, click Integrations.
The Integrations List page appears.
- Select an existing integration or create a new integration by clicking Create integration.
If you are creating a new integration:
- Enter a name and description in the Create Integration dialog.
- Select a Region for the integration from the list of supported regions.
- Click Create.
This opens the integration in the integration designer.
- In the integration designer navigation bar, click +Add a task/trigger > Tasks to view the list of available tasks.
- Click and place the Connectors element in the integration designer.
- Click the Connectors task element on the designer to view the Connectors task
configuration pane.
Optionally, click
to edit the task name. This enables you to change the task name from the generic Connectors to a meaningful name for your integration. - Click Configure task, and do the following in the Configure connector task dialog:
- Select a region. Select the region of the connection.
The list of available connections for the selected region is displayed in the Connection section.
- Select a connection.
- In the Type column, select Entities or Actions.
- If you select Entities, the list of supported entities is displayed in the Entity column. Select an entity followed by the Operation that you'd want to perform on that entity.
- If you select Actions, the list of supported actions is displayed in the Action column. Select an action for the connection. For detailed information on entities and actions, see Entities, operations, and actions.
- Click Done to complete the connection configuration and close the pane.
The following image shows a sample layout of the Configure connector task dialog for an SFTP connection.
Configure task input and output variables
The Connectors task configuration pane displays Task Input and Task Output variables that are automatically generated based on the Entity and Operation or Action selected in the Configure connector task dialog. These variables are configurable and are accessible as inputs to the current task or as outputs to subsequent tasks, or conditionals in the current integration.
To configure the Task Input or Task Output variables, click the respective variable to open the Configure Variable pane and perform the following steps:
- Enter the variable value in the Default Value field.
- (Optional) Select Use as an input to integration or Use as an output to integration.
- Click Save.
For more information about the input and output parameters of the Connectors task, see Configuration properties.
Entities, operations, and actions
All the Integration Connectors provide a layer of abstraction for the objects of the connected application. You can access an application's objects only through this abstraction. The abstraction is exposed to you as entities, operations, and actions.
- Entity: An entity can be thought of as an object, or a collection of properties, in the
connected application or service. The definition of an entity differs from a connector to a
connector. For example, in a database connector, tables are the entities, in a
file server connector, folders are the entities, and in a messaging system connector,
queues are the entities.
However, it is possible that a connector doesn't support or have any entities, in which case the
Entities
list will be empty. For example, the Pub/Sub connector doesn't have any entity, but only has thepublishMessage
action. - Operation: An operation is the activity that you can perform on an entity. You can perform
any of the following operations on an entity:
- List
- Get
- Create
- Update
- Delete
Selecting an entity from the available list, generates a list of operations available for the entity. For a detailed description of the operations, see the Connectors task's entity operations. However, it is possible that a connector doesn't support any entity operations, in which case the
Operations
list will be empty. - Action: An action is a first class function that is made available to the integration
through the connector interface. An action lets you make changes to an entity or entities, and
vary from connector to connector. However, it is possible
that a connector doesn't support any action, in which case the
Actions
list will be empty.
Entity operations
You can perform CRUD (Create, Read, Update, Delete) operations on the entities of a connector. Each of these entity operations has a different set of input and output parameters. The following table lists the input and output parameters of the various entity operations.
Operation name | Input parameters | Output parameters |
---|---|---|
List |
|
|
Get | entityId | connectorOutputPayload |
Create | connectorInputPayload | connectorOutputPayload |
Update |
|
connectorOutputPayload |
Delete |
|
N/A |
Input parameters
The following table describes the input parameters for the various entity operations.
Parameter name | Data type | Description |
---|---|---|
entityId | String | A unique identifier of the row that you want to access. Normally, the For example, to get a specific row from a MySQL table, the
|
connectorInputPayload | JSON | The actual data to be added or updated in an entity. The following example shows the
JSON snippet of a row data to be added in a table:
{ "employee_first_name": "John", "employee_emailID": "test-05@test.com" } In this example, |
filterClause | String | Restricts the result of the operations based on a condition. For more information about adding a filter clause, see Add a filter for an operation. |
listEntitiesPageSize | Integer |
Specifies the number of results that should be returned in a page. A page is a logical grouping of the records in a result set. The concept of a page is useful when you are expecting a large number of records in the result set. If the result set is large, the Connectors task might fail, as there is a limit on the data size that the Connectors task can process. By breaking down the result set into smaller chunks, you can avoid this issue. For example, if you are expecting 1000 records in your result set, you can set
the |
listEntitiesPageToken | String | A page identifier (token) that lets you access a specific page. You can get the value of a page token from the |
listEntitiesSortByColumns | String array | Column name(s) by which you want to sort the result set. If you want to sort the result set by more than one column, specify multiple column names as comma-separated values. |
Output parameters
The following table describes the output parameters for the various entity operations.
Parameter name | Data type | Description |
---|---|---|
connectorOutputPayload | JSON | The output of an operation in JSON format. |
listEntitiesNextPageToken | String |
A system generated identifier for a page. You can think of the token as a pointer by which you can access a particular page of the result set. If you have broken down your
result set into multiple pages by setting the For example, consider you have set the If your result set has a large number of pages, you can consider using the
For Each Loop task
to repeatedly call the Connectors task and use
the Data Mapping
task to automatically assign token values to the
|
Filter clause for entity operations
You can restrict the records that are processed by the Connectors task using the Filter clause variable that is available as a Task Input. For example, in case of a delete
operation, you can add a filter clause to delete records with a specific orderId
.
Filter clause can be applied only for the following entity operations:
- List
- Delete
- Update
When you select any of these operations, the Task Input section of the Connectors task displays the Filter clause field automatically.
Add a filter clause
To add a filter clause, perform the following steps:
- Click the Connectors task element on the designer to view the Connectors task configuration pane.
- Expand the Task Input section and click the filterClause(Connectors) string variable.
The Configure Variable dialog appears.
- Enter the filter clause (following the clause syntax) in the Default Value field.
- Click Save.
Filter clause syntax and examples
A filter clause has the following format:
<FIELD_NAME> <CONDITION> <FILTER_VALUE>
Examples
OwnerId = '0053t000007941XAAQ'
PoNumber < 2345
OrderNumber = 00110 AND StatusCode = 'Draft'
TotalAmount > 2500
ShippingPostalCode = 94043 OR ShippingPostalCode = 77002
Use of variables in filter clause
You can't directly use an integration variable in a filter clause. If you want to use an integration variable, you must first configure a Data Mapping task to create a mapping between the integration variable and the filter clause.The following table shows a sample mapping between an integration variable and the filterClause(Connectors)
variable:
Input | Output |
---|---|
PRIMARY_KEY_ID = ' .CONCAT(INTEGRATION_VARIABLE) .CONCAT(') |
filterClause(Connectors) |
PRIMARY_KEY_ID = '
is entered as a Value in the input row.
Best practices
- For information about the usage limits that apply to the Connectors task, see Usage limits.
- For information about how to troubleshoot a failed Connectors task, see Use logs to troubleshoot and trace connector failures.
Retry on failure
You can configure various retry strategies to handle errors in a task. The retry strategies allow you to specify how to rerun the task or integration in case of an error. For more information, see Error handling strategies.