Interface CachedContent (1.8.0)

A resource used in LLM queries for users to explicitly specify what to cache and how to cache.

Package

@google-cloud/vertexai

Properties

contents

contents?: Content[];

Optional. Input only. Immutable. The content to cache.

createTime

createTime?: string;

Output only. Creatation time of the cache entry. Format: google-datetime. See https://cloud.google.com/docs/discovery/type-format

displayName

displayName?: string;

Optional. Immutable. The user-generated meaningful display name of the cached content.

expireTime

expireTime?: string;

Timestamp of when this resource is considered expired. This is *always* provided on output, regardless of what was sent on input.

model

model?: string;

Immutable. The name of the publisher model to use for cached content. Format: projects/{project}/locations/{location}/publishers/{publisher}/models/{model}

name

name?: string;

Immutable. Identifier. The server-generated resource name of the cached content. Format: projects/{project}/locations/{location}/cachedContents/{cached_content}

systemInstruction

systemInstruction?: Content | string;

Developer set system instruction. Currently, text only.

toolConfig

toolConfig?: ToolConfig;

Optional. Input only. Immutable. Tool config. This config is shared for all tools.

tools

tools?: Tool[];

Optional. Input only. Immutable. A list of Tools the model may use to generate the next response.

ttl

ttl?: string;

Input only. The TTL seconds for this resource. The expiration time is computed: now + TTL. Format: google-duration. See https://cloud.google.com/docs/discovery/type-format

updateTime

updateTime?: string;

Output only. When the cache entry was last updated in UTC time. Format: google-datetime. See https://cloud.google.com/docs/discovery/type-format

usageMetadata

usageMetadata?: CachedContentUsageMetadata;

Output only. Metadata on the usage of the cached content.