Package types (0.1.0)

API documentation for gkerecommender_v1.types package.

Classes

Amount

Represents an amount of money in a specific currency.

Cost

Cost for running a model deployment on a given instance type. Currently, only USD currency code is supported.

.. _oneof: https://proto-plus-python.readthedocs.io/en/stable/fields.html#oneofs-mutually-exclusive-fields

FetchBenchmarkingDataRequest

Request message for GkeInferenceQuickstart.FetchBenchmarkingData.

FetchBenchmarkingDataResponse

Response message for GkeInferenceQuickstart.FetchBenchmarkingData.

FetchModelServerVersionsRequest

Request message for GkeInferenceQuickstart.FetchModelServerVersions.

.. _oneof: https://proto-plus-python.readthedocs.io/en/stable/fields.html#oneofs-mutually-exclusive-fields

FetchModelServerVersionsResponse

Response message for GkeInferenceQuickstart.FetchModelServerVersions.

FetchModelServersRequest

Request message for GkeInferenceQuickstart.FetchModelServers.

.. _oneof: https://proto-plus-python.readthedocs.io/en/stable/fields.html#oneofs-mutually-exclusive-fields

FetchModelServersResponse

Response message for GkeInferenceQuickstart.FetchModelServers.

FetchModelsRequest

Request message for GkeInferenceQuickstart.FetchModels.

.. _oneof: https://proto-plus-python.readthedocs.io/en/stable/fields.html#oneofs-mutually-exclusive-fields

FetchModelsResponse

Response message for GkeInferenceQuickstart.FetchModels.

FetchProfilesRequest

Request message for GkeInferenceQuickstart.FetchProfiles.

.. _oneof: https://proto-plus-python.readthedocs.io/en/stable/fields.html#oneofs-mutually-exclusive-fields

FetchProfilesResponse

Response message for GkeInferenceQuickstart.FetchProfiles.

GenerateOptimizedManifestRequest

Request message for GkeInferenceQuickstart.GenerateOptimizedManifest.

GenerateOptimizedManifestResponse

Response message for GkeInferenceQuickstart.GenerateOptimizedManifest.

KubernetesManifest

A Kubernetes manifest.

MillisecondRange

Represents a range of latency values in milliseconds.

ModelServerInfo

Model server information gives. Valid model server info combinations can be found using GkeInferenceQuickstart.FetchProfiles.

PerformanceRange

Performance range for a model deployment.

PerformanceRequirements

Performance requirements for a profile and or model deployment.

.. _oneof: https://proto-plus-python.readthedocs.io/en/stable/fields.html#oneofs-mutually-exclusive-fields

PerformanceStats

Performance statistics for a model deployment.

Profile

A profile containing information about a model deployment.

ResourcesUsed

Resources used by a model deployment.

StorageConfig

Storage configuration for a model deployment.

TokensPerSecondRange

Represents a range of throughput values in tokens per second.