Class AwsKinesis (2.20.1)

AwsKinesis(mapping=None, *, ignore_unknown_fields=False, **kwargs)

Ingestion settings for Amazon Kinesis Data Streams.

Attributes

NameDescription
state :noindex: google.pubsub_v1.types.IngestionDataSourceSettings.AwsKinesis.State
Output only. An output-only field that indicates the state of the Kinesis ingestion source.
stream_arn :noindex: str
Required. The Kinesis stream ARN to ingest data from.
consumer_arn :noindex: str
Required. The Kinesis consumer ARN to used for ingestion in Enhanced Fan-Out mode. The consumer must be already created and ready to be used.
aws_role_arn :noindex: str
Required. AWS role ARN to be used for Federated Identity authentication with Kinesis. Check the Pub/Sub docs for how to set up this role and the required permissions that need to be attached to it.
gcp_service_account :noindex: str
Required. The GCP service account to be used for Federated Identity authentication with Kinesis (via a AssumeRoleWithWebIdentity call for the provided role). The aws_role_arn must be set up with accounts.google.com:sub equals to this service account number.

Classes

State

State(value)

Possible states for ingestion from Amazon Kinesis Data Streams.

Values: STATE_UNSPECIFIED (0): Default value. This value is unused. ACTIVE (1): Ingestion is active. KINESIS_PERMISSION_DENIED (2): Permission denied encountered while consuming data from Kinesis. This can happen if:

    -  The provided `aws_role_arn` does not exist or does not
       have the appropriate permissions attached.
    -  The provided `aws_role_arn` is not set up properly for
       Identity Federation using `gcp_service_account`.
    -  The Pub/Sub SA is not granted the
       `iam.serviceAccounts.getOpenIdToken` permission on
       `gcp_service_account`.
PUBLISH_PERMISSION_DENIED (3):
    Permission denied encountered while publishing to the topic.
    This can happen due to Pub/Sub SA has not been granted the
    `appropriate publish
    permissions <https://cloud.google.com/pubsub/docs/access-control#pubsub.publisher>`__
STREAM_NOT_FOUND (4):
    The Kinesis stream does not exist.
CONSUMER_NOT_FOUND (5):
    The Kinesis consumer does not exist.