- Resource: IntegrationVersion
- JSON representation
- TaskConfig
- EventParameter
- FailurePolicy
- RetryStrategy
- NextTask
- NextTasksExecutionPolicy
- TaskExecutionStrategy
- SuccessPolicy
- FinalState
- JsonValidationOption
- ExternalTaskType
- Coordinate
- TriggerConfig
- TriggerType
- CloudSchedulerConfig
- IntegrationParameter
- InOutType
- DatabasePersistencePolicy
- ErrorCatcherConfig
- IntegrationConfigParameter
- Methods
Resource: IntegrationVersion
The integration version definition.
JSON representation |
---|
{ "name": string, "description": string, "taskConfigs": [ { object ( |
Fields | |
---|---|
name |
Output only. Auto-generated primary key. |
description |
Optional. The integration description. |
taskConfigs[] |
Optional. Task configuration for the integration. It's optional, but the integration doesn't do anything without taskConfigs. |
triggerConfigs[] |
Optional. Trigger configurations. |
integrationParameters[] |
Optional. Parameters that are expected to be passed to the integration when an event is triggered. This consists of all the parameters that are expected in the integration execution. This gives the user the ability to provide default values, add information like PII and also provide data types of each parameter. |
state |
Output only. User should not set it as an input. |
snapshotNumber |
Optional. An increasing sequence that is set when a new snapshot is created. The last created snapshot can be identified by [workflowName, org_id latest(snapshotNumber)]. However, last created snapshot need not be same as the HEAD. So users should always use "HEAD" tag to identify the head. |
updateTime |
Output only. Auto-generated. A timestamp in RFC3339 UTC "Zulu" format, with nanosecond resolution and up to nine fractional digits. Examples: |
lockHolder |
Optional. The edit lock holder's email address. Generated based on the End User Credentials/LOAS role of the user making the call. |
createTime |
Output only. Auto-generated. A timestamp in RFC3339 UTC "Zulu" format, with nanosecond resolution and up to nine fractional digits. Examples: |
lastModifierEmail |
Optional. The last modifier's email address. Generated based on the End User Credentials/LOAS role of the user making the call. |
parentTemplateId |
Optional. The id of the template which was used to create this integrationVersion. |
userLabel |
Optional. A user-defined label that annotates an integration version. Typically, this is only set when the integration version is created. |
databasePersistencePolicy |
Optional. Flag to disable database persistence for execution data, including event execution info, execution export info, execution metadata index and execution param index. |
errorCatcherConfigs[] |
Optional. Error Catch Task configuration for the integration. It's optional. |
runAsServiceAccount |
Optional. The run-as service account email, if set and auth config is not configured, that will be used to generate auth token to be used in Connector task, Rest caller task and Cloud function task. |
cloudLoggingDetails |
Optional. Cloud Logging details for the integration version |
integrationConfigParameters[] |
Optional. Config Parameters that are expected to be passed to the integration when an integration is published. This consists of all the parameters that are expected to provide configuration in the integration execution. This gives the user the ability to provide default values, value, add information like connection url, project based configuration value and also provide data types of each parameter. |
enableVariableMasking |
Optional. True if variable masking feature should be turned on for this version |
TaskConfig
The task configuration details. This is not the implementation of Task. There might be multiple TaskConfigs for the same Task.
JSON representation |
---|
{ "task": string, "taskId": string, "parameters": { string: { object ( |
Fields | |
---|---|
task |
Optional. The name for the task. |
taskId |
Required. The identifier of this task within its parent event config, specified by the client. This should be unique among all the tasks belong to the same event config. We use this field as the identifier to find next tasks (via field |
parameters |
Optional. The customized parameters the user can pass to this task. |
failurePolicy |
Optional. Determines the number of times the task will be retried on failure and with what retry strategy. This is applicable for asynchronous calls to Eventbus alone (events.post To Queue, events.schedule etc.). |
synchronousCallFailurePolicy |
Optional. Determines the number of times the task will be retried on failure and with what retry strategy. This is applicable for synchronous calls to Eventbus alone (events.post). |
nextTasks[] |
Optional. The set of tasks that are next in line to be executed as per the execution graph defined for the parent event, specified by |
nextTasksExecutionPolicy |
Optional. The policy dictating the execution of the next set of tasks for the current task. |
taskExecutionStrategy |
Optional. The policy dictating the execution strategy of this task. |
displayName |
Optional. User-provided label that is attached to this TaskConfig in the UI. |
successPolicy |
Optional. Determines what action to take upon successful task completion. |
jsonValidationOption |
Optional. If set, overrides the option configured in the Task implementation class. |
description |
Optional. User-provided description intended to give additional business context about the task. |
taskTemplate |
Optional. Used to define task-template name if task is of type task-template |
errorCatcherId |
Optional. Optional Error catcher id of the error catch flow which will be executed when execution error happens in the task |
externalTaskType |
Optional. External task type of the task |
position |
Optional. Informs the front-end application where to draw this error catcher config on the UI. |
EventParameter
This message is used for processing and persisting (when applicable) key value pair parameters for each event in the event bus. Next available id: 4
JSON representation |
---|
{
"key": string,
"value": {
object ( |
Fields | |
---|---|
key |
Key is used to retrieve the corresponding parameter value. This should be unique for a given fired event. These parameters must be predefined in the integration definition. |
value |
Values for the defined keys. Each value can either be string, int, double or any proto message. |
masked |
True if this parameter should be masked in the logs |
FailurePolicy
Policy that defines the task retry logic and failure type. If no FailurePolicy is defined for a task, all its dependent tasks will not be executed (i.e, a retryStrategy
of NONE will be applied).
JSON representation |
---|
{
"retryStrategy": enum ( |
Fields | |
---|---|
retryStrategy |
Defines what happens to the task upon failure. |
maxRetries |
Required if retryStrategy is FIXED_INTERVAL or LINEAR/EXPONENTIAL_BACKOFF/RESTART_INTEGRATION_WITH_BACKOFF. Defines the number of times the task will be retried if failed. |
intervalTime |
Required if retryStrategy is FIXED_INTERVAL or LINEAR/EXPONENTIAL_BACKOFF/RESTART_INTEGRATION_WITH_BACKOFF. Defines the initial interval in seconds for backoff. A timestamp in RFC3339 UTC "Zulu" format, with nanosecond resolution and up to nine fractional digits. Examples: |
RetryStrategy
The behavior when the taks failed.
Enums | |
---|---|
RETRY_STRATEGY_UNSPECIFIED |
UNSPECIFIED. |
IGNORE |
Ignores the failure of this task. The rest of the integration will be executed Assuming this task succeeded. |
NONE |
Causes a permanent failure of the task. However, if the last task(s) of event was successfully completed despite the failure of this task, it has no impact on the integration. |
FATAL |
Causes a permanent failure of the event. It is different from NONE because this will mark the event as FAILED by shutting down the event execution. |
FIXED_INTERVAL |
The task will be retried from the failed task onwards after a fixed delay. A max-retry count is required to be specified with this strategy. A jitter is added to each exponential interval so that concurrently failing tasks of the same type do not end up retrying after the exact same exponential interval. maxRetries and intervalInSeconds must be specified. |
LINEAR_BACKOFF |
The task will be retried from the failed task onwards after a fixed delay that linearly increases with each retry attempt. A jitter is added to each exponential interval so that concurrently failing tasks of the same type do not end up retrying after the exact same exponential interval. A max-retry count is required to be specified with this strategy. maxRetries and intervalInSeconds must be specified. |
EXPONENTIAL_BACKOFF |
The task will be retried after an exponentially increasing period of time with each failure. A jitter is added to each exponential interval so that concurrently failing tasks of the same type do not end up retrying after the exact same exponential interval. A max-retry count is required to be specified with this strategy. maxRetries and intervalInSeconds must be specified. |
RESTART_INTEGRATION_WITH_BACKOFF |
The entire integration will be restarted with the initial parameters that were set when the event was fired. A max-retry count is required to be specified with this strategy. maxRetries and intervalInSeconds must be specified. |
NextTask
The task that is next in line to be executed, if the condition specified evaluated to true.
JSON representation |
---|
{ "taskConfigId": string, "taskId": string, "condition": string, "displayName": string, "description": string } |
Fields | |
---|---|
taskConfigId |
ID of the next task. |
taskId |
Task number of the next task. |
condition |
Standard filter expression for this task to become an eligible next task. |
displayName |
User-provided label that is attached to this edge in the UI. |
description |
User-provided description intended to give additional business context about the task. |
NextTasksExecutionPolicy
Various policies for executing the next set of tasks.
Enums | |
---|---|
NEXT_TASKS_EXECUTION_POLICY_UNSPECIFIED |
Default. |
RUN_ALL_MATCH |
Execute all the tasks that satisfy their associated condition. |
RUN_FIRST_MATCH |
Execute the first task that satisfies the associated condition. |
TaskExecutionStrategy
Various policies to trigger the execution of this task.
Enums | |
---|---|
TASK_EXECUTION_STRATEGY_UNSPECIFIED |
Default. If the strategy is not set explicitly, it will default to WHEN_ALL_SUCCEED . |
WHEN_ALL_SUCCEED |
Wait until all of its previous tasks finished execution, then verify at least one of the edge conditions is met, and execute if possible. This should be considered as WHEN_ALL_TASKS_SUCCEED. |
WHEN_ANY_SUCCEED |
Start execution as long as any of its previous tasks finished execution and the corresponding edge condition is met (since we will execute if only that succeeding edge condition is met). |
WHEN_ALL_TASKS_AND_CONDITIONS_SUCCEED |
Wait until all of its previous tasks finished execution, then verify the all edge conditions are met and execute if possible. |
SuccessPolicy
Policy that dictates the behavior for the task after it completes successfully.
JSON representation |
---|
{
"finalState": enum ( |
Fields | |
---|---|
finalState |
State to which the execution snapshot status will be set if the task succeeds. |
FinalState
The state of execution.
Enums | |
---|---|
FINAL_STATE_UNSPECIFIED |
UNSPECIFIED. |
SUCCEEDED |
The default behavior, where successful tasks will be marked as SUCCEEDED. |
SUSPENDED |
Sets the state to SUSPENDED after executing. This is required for SuspensionTask; event execution will continue once the user calls ResolveSuspensions with the eventExecutionInfoId and the task number. |
JsonValidationOption
Options for how to validate json schemas.
Enums | |
---|---|
JSON_VALIDATION_OPTION_UNSPECIFIED |
As per the default behavior, no validation will be run. Will not override any option set in a Task. |
SKIP |
Do not run any validation against JSON schemas. |
PRE_EXECUTION |
Validate all potential input JSON parameters against schemas specified in IntegrationParameter. |
POST_EXECUTION |
Validate all potential output JSON parameters against schemas specified in IntegrationParameter. |
PRE_POST_EXECUTION |
Perform both PRE_EXECUTION and POST_EXECUTION validations. |
ExternalTaskType
Defines the type of the task for external customer
Enums | |
---|---|
EXTERNAL_TASK_TYPE_UNSPECIFIED |
Default value. External task type is not specified |
NORMAL_TASK |
Tasks belongs to the normal task flows |
ERROR_TASK |
Task belongs to the error catch task flows |
Coordinate
Configuration detail of coordinate, it used for UI
JSON representation |
---|
{ "x": integer, "y": integer } |
Fields | |
---|---|
x |
Required. X axis of the coordinate |
y |
Required. Y axis of the coordinate |
TriggerConfig
Configuration detail of a trigger.
JSON representation |
---|
{ "label": string, "startTasks": [ { object ( |
Fields | |
---|---|
label |
Optional. The user created label for a particular trigger. |
startTasks[] |
Optional. Set of tasks numbers from where the integration execution is started by this trigger. If this is empty, then integration is executed with default start tasks. In the list of start tasks, none of two tasks can have direct ancestor-descendant relationships (i.e. in a same integration execution graph). |
properties |
Optional. Configurable properties of the trigger, not to be confused with integration parameters. E.g. "name" is a property for API triggers and "subscription" is a property for Pub/sub triggers. |
triggerType |
Optional. type of trigger |
triggerNumber |
Required. A number to uniquely identify each trigger config within the integration on UI. |
nextTasksExecutionPolicy |
Optional. Dictates how next tasks will be executed. |
triggerId |
Optional. Auto-generated trigger ID. The ID is based on the properties that you define in the trigger config. For example, for an API trigger, the trigger ID follows the format:
Where trigger config has properties with value |
description |
Optional. User-provided description intended to give additional business context about the task. |
cloudSchedulerConfig |
Optional. Cloud Scheduler Trigger related metadata |
errorCatcherId |
Optional. Optional Error catcher id of the error catch flow which will be executed when execution error happens in the task |
position |
Optional. Informs the front-end application where to draw this error catcher config on the UI. |
trigger |
Optional. name of the trigger. Example: "API Trigger", "Cloud Pub Sub Trigger" When set will be sent out to monitoring dashabord for tracking purpose. |
TriggerType
Types of triggers.
Enums | |
---|---|
TRIGGER_TYPE_UNSPECIFIED |
Unknown. |
CRON |
Trigger by scheduled time. |
API |
Trigger by API call. |
SFDC_CHANNEL |
Trigger by Salesforce Channel. |
CLOUD_PUBSUB_EXTERNAL |
Trigger by Pub/Sub external. |
SFDC_CDC_CHANNEL |
SFDC Channel Trigger for CDC. |
CLOUD_SCHEDULER |
Trigger by Cloud Scheduler job. |
INTEGRATION_CONNECTOR_TRIGGER |
Trigger by Connector Event |
PRIVATE_TRIGGER |
Trigger for private workflow |
CloudSchedulerConfig
Cloud Scheduler Trigger configuration
JSON representation |
---|
{ "serviceAccountEmail": string, "cronTab": string, "location": string, "errorMessage": string } |
Fields | |
---|---|
serviceAccountEmail |
Required. Service account used by Cloud Scheduler to trigger the integration at scheduled time |
cronTab |
Required. The cron tab of cloud scheduler trigger. |
location |
Required. The location where associated cloud scheduler job will be created |
errorMessage |
Optional. When the job was deleted from Pantheon UI, errorMessage will be populated when Get/List integrations |
IntegrationParameter
Integration Parameter is defined in the integration config and are used to provide information about data types of the expected parameters and provide any default values if needed. They can also be used to add custom attributes. These are static in nature and should not be used for dynamic event definition.
JSON representation |
---|
{ "key": string, "dataType": enum ( |
Fields | |
---|---|
key |
Key is used to retrieve the corresponding parameter value. This should be unique for a given fired event. These parameters must be predefined in the integration definition. |
dataType |
type of the parameter. |
defaultValue |
Default values for the defined keys. Each value can either be string, int, double or any proto message or a serialized object. |
searchable |
Searchable in the execution log or not. |
displayName |
The name (without prefix) to be displayed in the UI for this parameter. E.g. if the key is "foo.bar.myName", then the name would be "myName". |
inputOutputType |
Specifies the input/output type for the parameter. |
isTransient |
Whether this parameter is a transient parameter. |
producer |
The identifier of the node (TaskConfig/TriggerConfig) this parameter was produced by, if it is a transient param or a copy of an input param. |
jsonSchema |
This schema will be used to validate runtime JSON-typed values of this parameter. |
containsLargeData |
Indicates whether this variable contains large data and need to be uploaded to Cloud Storage. |
masked |
True if this parameter should be masked in the logs |
InOutType
Is the parameter input, output of a integration.
Enums | |
---|---|
IN_OUT_TYPE_UNSPECIFIED |
Default. |
IN |
Input parameters for the integration. EventBus validates that these parameters exist in the integrations before execution. |
OUT |
Output Parameters for the integration. EventBus will only return the integration parameters tagged with OUT in the response back. |
IN_OUT |
Input and Output Parameters. These can be used as both input and output. EventBus will validate for the existence of these parameters before execution and will also return this parameter back in the response. |
DatabasePersistencePolicy
Flag to disable database persistence for execution data, including event execution info, execution export info, execution metadata index and execution param index.
Enums | |
---|---|
DATABASE_PERSISTENCE_POLICY_UNSPECIFIED |
Enables persistence for all execution data. |
DATABASE_PERSISTENCE_DISABLED |
Disables persistence for all execution data. |
DATABASE_PERSISTENCE_ASYNC |
Asynchronously persist all execution data. |
ErrorCatcherConfig
Configuration detail of a error catch task
JSON representation |
---|
{ "errorCatcherId": string, "label": string, "errorCatcherNumber": string, "startErrorTasks": [ { object ( |
Fields | |
---|---|
errorCatcherId |
Required. An error catcher id is string representation for the error catcher config. Within a workflow, errorCatcherId uniquely identifies an error catcher config among all error catcher configs for the workflow |
label |
Optional. The user created label for a particular error catcher. Optional. |
errorCatcherNumber |
Required. A number to uniquely identify each error catcher config within the workflow on UI. |
startErrorTasks[] |
Required. The set of start tasks that are to be executed for the error catch flow |
description |
Optional. User-provided description intended to give more business context about the error catcher config. |
position |
Optional. Informs the front-end application where to draw this error catcher config on the UI. |
IntegrationConfigParameter
Integration Config Parameter is defined in the integration config and are used to provide external configuration for integration. It provide information about data types of the expected parameters and provide any default values or value. They can also be used to add custom attributes.
JSON representation |
---|
{ "parameter": { object ( |
Fields | |
---|---|
parameter |
Optional. Integration Parameter to provide the default value, data type and attributes required for the Integration config variables. |
value |
Values for the defined keys. Each value can either be string, int, double or any proto message or a serialized object. |
Methods |
|
---|---|
|
Create a integration with a draft version in the specified project. |
|
Soft-deletes the integration. |
|
Downloads an integration. |
|
Downloads an Integration version package like IntegrationVersion,Integration Config etc. |
|
Get a integration in the specified project. |
|
Returns the list of all integration versions in the specified project. |
|
Update a integration with a draft version in the specified project. |
|
This RPC throws an exception if the integration is in ARCHIVED or ACTIVE state. |
|
Sets the status of the ACTIVE integration to SNAPSHOT with a new tag "PREVIOUSLY_PUBLISHED" after validating it. |
|
Uploads an integration. |