Classes
ChatSession
The ChatSession
class is used to make multiturn send message requests. You can instantiate this class by using the startChat
method in the GenerativeModel
class. The sendMessage
method makes an async call to get the response of a chat message at at once. The sendMessageStream
method makes an async call to stream the response of a chat message as it's being generated.
ChatSessionPreview
The ChatSessionPreview
class is used to make multiturn send message requests. You can instantiate this class by using the startChat
method in the GenerativeModelPreview
class. The sendMessage
method makes an async call to get the response of a chat message at at once. The sendMessageStream
method makes an async call to stream the response of a chat message as it's being generated.
ClientError
ClientError is thrown when http 4XX status is received. For details please refer to https://developer.mozilla.org/en-US/docs/Web/HTTP/Status#client_error_responses
GenerateContentResponseHandler
Helper class to render any extra properties out of GenerateContentResponse or properties of GenerateContentResponse
GenerativeModel
The GenerativeModel
class is the base class for the generative models on Vertex AI. NOTE: Don't instantiate this class directly. Use vertexai.getGenerativeModel()
instead.
GenerativeModelPreview
The GenerativeModelPreview
class is the base class for the generative models that are in preview. NOTE: Don't instantiate this class directly. Use vertexai.preview.getGenerativeModel()
instead.
GoogleAuthError
GoogleAuthError is thrown when there is authentication issue with the request
GoogleGenerativeAIError
GoogleGenerativeAIError is thrown when http response is not ok and status code is not 4XX For details please refer to https://developer.mozilla.org/en-US/docs/Web/HTTP/Status
VertexAI
The VertexAI
class is the base class for authenticating to Vertex AI. To use Vertex AI's generative AI models, use the getGenerativeModel
method. To use generative AI features that are in Preview, use the preview
namespace.
Interfaces
BaseModelParams
Base params for initializing a model or calling GenerateContent.
BasePart
A part of a turn in a conversation with the model with a fixed MIME type. It has one of the following mutually exclusive fields: 1. text 2. inlineData 3. fileData 4. functionResponse 5. functionCall
Citation
Source attributions for content.
CitationMetadata
A collection of source attributions for a piece of content.
Content
The base structured datatype containing multi-part content of a message.
CountTokensRequest
Params used to call the countTokens method.
CountTokensResponse
Response returned from countTokens method.
FileData
URI based data.
FileDataPart
A file data part of a conversation with the model.
FunctionCall
A predicted FunctionCall returned from the model that contains a string representating the FunctionDeclaration.name with the parameters and their values.
FunctionCallPart
A function call part of a conversation with the model.
FunctionDeclaration
Structured representation of a function declaration as defined by the [OpenAPI 3.0 specification](https://spec.openapis.org/oas/v3.0.3). Included in this declaration are the function name and parameters. This FunctionDeclaration is a representation of a block of code that can be used as a Tool by the model and executed by the client.
FunctionDeclarationSchema
Schema for parameters passed to FunctionDeclaration.parameters.
FunctionDeclarationSchemaProperty
Schema is used to define the format of input/output data. Represents a select subset of an OpenAPI 3.0 schema object. More fields may be added in the future as needed.
FunctionDeclarationsTool
A FunctionDeclarationsTool is a piece of code that enables the system to interact with external systems to perform an action, or set of actions, outside of knowledge and scope of the model.
FunctionResponse
The result output of a FunctionCall that contains a string representing the FunctionDeclaration.name and a structured JSON object containing any output from the function call. It is used as context to the model.
FunctionResponsePart
A function response part of a conversation with the model.
GenerateContentCandidate
A response candidate generated from the model.
GenerateContentRequest
Params used to call the generateContent method.
GenerateContentResponse
Response from the model supporting multiple candidates.
GenerateContentResult
Wrapper for respones from a generateContent request.
GenerationConfig
Configuration options for model generation and outputs.
GenerativeContentBlob
Raw media bytes sent directly in the request. Text should not be sent as raw bytes.
GetGenerativeModelParams
Params used to call the getGenerativeModel method.
GoogleDate
Represents a whole or partial calendar date, such as a birthday. The time of day and time zone are either specified elsewhere or are insignificant. The date is relative to the Gregorian Calendar. This can represent one of the following:
A full date, with non-zero year, month, and day values. A month and day, with a zero year (for example, an anniversary). A year on its own, with a zero month and a zero day. A year and month, with a zero day (for example, a credit card expiration date).
GoogleSearchRetrieval
Tool to retrieve public web data for grounding, powered by Google.
GoogleSearchRetrievalTool
Defines a retrieval tool that model can call to access external knowledge.
GroundingAttribution
Grounding attribution.
GroundingAttributionRetrievedContext
Attribution from context retrieved by the retrieval tools.
GroundingAttributionSegment
Segment of the content this attribution belongs to.
GroundingAttributionWeb
Attribution from the web.
GroundingMetadata
A collection of grounding attributions for a piece of content.
InlineDataPart
An inline data part of a conversation with the model.
ModelParams
Configuration for initializing a model, for example via getGenerativeModel in VertexAI class.
PromptFeedback
Content filter results for a prompt sent in the request.
RequestOptions
Request options params passed to getGenerativeModel method in VertexAI class.
Retrieval
Defines a retrieval tool that model can call to access external knowledge.
RetrievalTool
Defines a retrieval tool that model can call to access external knowledge.
SafetyRating
Safety rating corresponding to the generated content.
SafetySetting
Safety feedback for an entire request.
StartChatParams
Params to initiate a multiturn chat with the model via startChat.
StartChatSessionRequest
All params passed to initiate multiturn chat via startChat.
StreamGenerateContentResult
Wrapper for respones from a generateContentStream method.
TextPart
A text part of a conversation with the model.
UsageMetadata
Usage metadata about response(s).
VertexAISearch
Retrieve from Vertex AI Search datastore for grounding.
VertexInit
Params used to initialize the Vertex SDK.
Enums
BlockedReason
The reason why the reponse is blocked.
FinishReason
The reason why the model stopped generating tokens. If empty, the model has not stopped generating the tokens.
FunctionDeclarationSchemaType
Contains the list of OpenAPI data types as defined by https://swagger.io/docs/specification/data-models/data-types/
HarmBlockThreshold
Probability based thresholds levels for blocking.
HarmCategory
Harm categories that will block the content.
HarmProbability
Harm probability levels in the content.
HarmSeverity
Harm severity levels
Type Aliases
Part
export declare type Part = TextPart | InlineDataPart | FileDataPart | FunctionResponsePart | FunctionCallPart;
A datatype containing media that is part of a multi-part Content message. A Part
is a union type of TextPart, InlineDataPart, FileDataPart, and FunctionResponsePart. A Part
has one of the following mutually exclusive fields: 1. text 2. inlineData 3. fileData 4. functionResponse
Tool
export declare type Tool = FunctionDeclarationsTool | RetrievalTool | GoogleSearchRetrievalTool;
Defines a tool that model can call to access external knowledge.