This preview documentation is deprecated as of October 27, 2023. For GA documentation, go to the Vertex AI Search documentation.

Changes in GA:

Name: Discovery for Media is renamed to Vertex AI Search for media. Vertex AI Search includes media recommendations and media search.
Google Cloud Console page: Use the Agent Builder page in the console. The Discovery Engine console page is deprecated.
API reference: Continue to use the discoveryengine.googleapis.com service. The API remains the same but the documentation has moved. Go to the up-to-date, GA version of the Discovery Engine API reference in the Vertex AI Search documentation.
All changes: To see what else changed between preview and GA, see Switch from Discovery for Media to media recommendations in the Vertex AI Search documentation.

GcsSource

JSON representation

Cloud Storage location for input content.

JSON representation
{ "inputUris": [ string ], "dataSchema": string }

Fields

Fields
`inputUris[]`	`string` Required. Cloud Storage URIs to input files. URI can be up to 2000 characters long. URIs can match the full object path (for example, `gs://bucket/directory/object.json`) or a pattern matching one or more files, such as `gs://bucket/directory/*.json`. A request can contain at most 100 files (or 100,000 files if `dataSchema` is `content`). Each file can be up to 2 GB (or 100 MB if `dataSchema` is `content`).
`dataSchema`	`string` The schema to use when parsing the data from the source. Supported values for document imports: `document` (default): One JSON `Document` per line. Each document must have a valid `Document.id`. `content`: Unstructured data (e.g. PDF, HTML). Each file matched by `inputUris` becomes a document, with the ID set to the first 128 bits of SHA256(URI) encoded as a hex string. `custom`: One custom data JSON per row in arbitrary format that conforms to the defined `Schema` of the data store. This can only be used by Gen App Builder. `csv`: A CSV file with header conforming to the defined `Schema` of the data store. Each entry after the header is imported as a Document. This can only be used by Gen App Builder. Supported values for user even imports: `user_event` (default): One JSON `UserEvent` per line.

inputUris[]

string

Required. Cloud Storage URIs to input files. URI can be up to 2000 characters long. URIs can match the full object path (for example, gs://bucket/directory/object.json) or a pattern matching one or more files, such as gs://bucket/directory/*.json.

A request can contain at most 100 files (or 100,000 files if dataSchema is content). Each file can be up to 2 GB (or 100 MB if dataSchema is content).

dataSchema

string

The schema to use when parsing the data from the source.

Supported values for document imports:

document (default): One JSON Document per line. Each document must have a valid Document.id.
content: Unstructured data (e.g. PDF, HTML). Each file matched by inputUris becomes a document, with the ID set to the first 128 bits of SHA256(URI) encoded as a hex string.
custom: One custom data JSON per row in arbitrary format that conforms to the defined Schema of the data store. This can only be used by Gen App Builder.
csv: A CSV file with header conforming to the defined Schema of the data store. Each entry after the header is imported as a Document. This can only be used by Gen App Builder.

Supported values for user even imports:

user_event (default): One JSON UserEvent per line.