- 0.61.0 (latest)
- 0.60.0
- 0.59.0
- 0.58.0
- 0.57.0
- 0.56.0
- 0.55.0
- 0.54.0
- 0.53.0
- 0.52.0
- 0.51.0
- 0.50.0
- 0.49.0
- 0.48.0
- 0.47.0
- 0.46.0
- 0.45.0
- 0.44.0
- 0.43.0
- 0.42.0
- 0.41.0
- 0.40.0
- 0.39.0
- 0.38.0
- 0.37.0
- 0.36.0
- 0.35.0
- 0.34.0
- 0.33.0
- 0.32.0
- 0.31.0
- 0.30.0
- 0.29.0
- 0.28.0
- 0.27.0
- 0.26.0
- 0.25.0
- 0.24.0
- 0.23.0
- 0.22.0
- 0.21.0
- 0.20.0
- 0.19.0
- 0.18.0
- 0.17.0
- 0.16.0
- 0.15.0
- 0.14.0
- 0.13.0
- 0.12.0
- 0.11.0
- 0.10.0
- 0.9.1
- 0.8.0
- 0.7.0
- 0.6.0
- 0.5.0
- 0.4.0
- 0.3.0
- 0.2.0
- 0.1.0
Reference documentation and code samples for the Vertex AI V1 API class Google::Cloud::AIPlatform::V1::EvaluationService::Rest::Client.
REST client for the EvaluationService service.
Vertex AI Online Evaluation Service.
Inherits
- Object
Methods
.configure
def self.configure() { |config| ... } -> Client::Configuration
Configure the EvaluationService Client class.
See Configuration for a description of the configuration fields.
- (config) — Configure the Client client.
- config (Client::Configuration)
# Modify the configuration for all EvaluationService clients ::Google::Cloud::AIPlatform::V1::EvaluationService::Rest::Client.configure do |config| config.timeout = 10.0 end
#configure
def configure() { |config| ... } -> Client::Configuration
Configure the EvaluationService Client instance.
The configuration is set to the derived mode, meaning that values can be changed, but structural changes (adding new fields, etc.) are not allowed. Structural changes should be made on Client.configure.
See Configuration for a description of the configuration fields.
- (config) — Configure the Client client.
- config (Client::Configuration)
#evaluate_instances
def evaluate_instances(request, options = nil) -> ::Google::Cloud::AIPlatform::V1::EvaluateInstancesResponse
def evaluate_instances(exact_match_input: nil, bleu_input: nil, rouge_input: nil, fluency_input: nil, coherence_input: nil, safety_input: nil, groundedness_input: nil, fulfillment_input: nil, summarization_quality_input: nil, pairwise_summarization_quality_input: nil, summarization_helpfulness_input: nil, summarization_verbosity_input: nil, question_answering_quality_input: nil, pairwise_question_answering_quality_input: nil, question_answering_relevance_input: nil, question_answering_helpfulness_input: nil, question_answering_correctness_input: nil, pointwise_metric_input: nil, pairwise_metric_input: nil, tool_call_valid_input: nil, tool_name_match_input: nil, tool_parameter_key_match_input: nil, tool_parameter_kv_match_input: nil, location: nil) -> ::Google::Cloud::AIPlatform::V1::EvaluateInstancesResponse
Evaluates instances based on a given metric.
def evaluate_instances(request, options = nil) -> ::Google::Cloud::AIPlatform::V1::EvaluateInstancesResponse
evaluate_instances
via a request object, either of type
Google::Cloud::AIPlatform::V1::EvaluateInstancesRequest or an equivalent Hash.
- request (::Google::Cloud::AIPlatform::V1::EvaluateInstancesRequest, ::Hash) — A request object representing the call parameters. Required. To specify no parameters, or to keep all the default parameter values, pass an empty Hash.
- options (::Gapic::CallOptions, ::Hash) — Overrides the default settings for this call, e.g, timeout, retries etc. Optional.
def evaluate_instances(exact_match_input: nil, bleu_input: nil, rouge_input: nil, fluency_input: nil, coherence_input: nil, safety_input: nil, groundedness_input: nil, fulfillment_input: nil, summarization_quality_input: nil, pairwise_summarization_quality_input: nil, summarization_helpfulness_input: nil, summarization_verbosity_input: nil, question_answering_quality_input: nil, pairwise_question_answering_quality_input: nil, question_answering_relevance_input: nil, question_answering_helpfulness_input: nil, question_answering_correctness_input: nil, pointwise_metric_input: nil, pairwise_metric_input: nil, tool_call_valid_input: nil, tool_name_match_input: nil, tool_parameter_key_match_input: nil, tool_parameter_kv_match_input: nil, location: nil) -> ::Google::Cloud::AIPlatform::V1::EvaluateInstancesResponse
evaluate_instances
via keyword arguments. Note that at
least one keyword argument is required. To specify no parameters, or to keep all
the default parameter values, pass an empty Hash as a request object (see above).
- exact_match_input (::Google::Cloud::AIPlatform::V1::ExactMatchInput, ::Hash) — Auto metric instances. Instances and metric spec for exact match metric.
- bleu_input (::Google::Cloud::AIPlatform::V1::BleuInput, ::Hash) — Instances and metric spec for bleu metric.
- rouge_input (::Google::Cloud::AIPlatform::V1::RougeInput, ::Hash) — Instances and metric spec for rouge metric.
- fluency_input (::Google::Cloud::AIPlatform::V1::FluencyInput, ::Hash) — LLM-based metric instance. General text generation metrics, applicable to other categories. Input for fluency metric.
- coherence_input (::Google::Cloud::AIPlatform::V1::CoherenceInput, ::Hash) — Input for coherence metric.
- safety_input (::Google::Cloud::AIPlatform::V1::SafetyInput, ::Hash) — Input for safety metric.
- groundedness_input (::Google::Cloud::AIPlatform::V1::GroundednessInput, ::Hash) — Input for groundedness metric.
- fulfillment_input (::Google::Cloud::AIPlatform::V1::FulfillmentInput, ::Hash) — Input for fulfillment metric.
- summarization_quality_input (::Google::Cloud::AIPlatform::V1::SummarizationQualityInput, ::Hash) — Input for summarization quality metric.
- pairwise_summarization_quality_input (::Google::Cloud::AIPlatform::V1::PairwiseSummarizationQualityInput, ::Hash) — Input for pairwise summarization quality metric.
- summarization_helpfulness_input (::Google::Cloud::AIPlatform::V1::SummarizationHelpfulnessInput, ::Hash) — Input for summarization helpfulness metric.
- summarization_verbosity_input (::Google::Cloud::AIPlatform::V1::SummarizationVerbosityInput, ::Hash) — Input for summarization verbosity metric.
- question_answering_quality_input (::Google::Cloud::AIPlatform::V1::QuestionAnsweringQualityInput, ::Hash) — Input for question answering quality metric.
- pairwise_question_answering_quality_input (::Google::Cloud::AIPlatform::V1::PairwiseQuestionAnsweringQualityInput, ::Hash) — Input for pairwise question answering quality metric.
- question_answering_relevance_input (::Google::Cloud::AIPlatform::V1::QuestionAnsweringRelevanceInput, ::Hash) — Input for question answering relevance metric.
- question_answering_helpfulness_input (::Google::Cloud::AIPlatform::V1::QuestionAnsweringHelpfulnessInput, ::Hash) — Input for question answering helpfulness metric.
- question_answering_correctness_input (::Google::Cloud::AIPlatform::V1::QuestionAnsweringCorrectnessInput, ::Hash) — Input for question answering correctness metric.
- pointwise_metric_input (::Google::Cloud::AIPlatform::V1::PointwiseMetricInput, ::Hash) — Input for pointwise metric.
- pairwise_metric_input (::Google::Cloud::AIPlatform::V1::PairwiseMetricInput, ::Hash) — Input for pairwise metric.
- tool_call_valid_input (::Google::Cloud::AIPlatform::V1::ToolCallValidInput, ::Hash) — Tool call metric instances. Input for tool call valid metric.
- tool_name_match_input (::Google::Cloud::AIPlatform::V1::ToolNameMatchInput, ::Hash) — Input for tool name match metric.
- tool_parameter_key_match_input (::Google::Cloud::AIPlatform::V1::ToolParameterKeyMatchInput, ::Hash) — Input for tool parameter key match metric.
- tool_parameter_kv_match_input (::Google::Cloud::AIPlatform::V1::ToolParameterKVMatchInput, ::Hash) — Input for tool parameter key value match metric.
-
location (::String) — Required. The resource name of the Location to evaluate the instances.
Format:
projects/{project}/locations/{location}
- (result, operation) — Access the result along with the TransportOperation object
- result (::Google::Cloud::AIPlatform::V1::EvaluateInstancesResponse)
- operation (::Gapic::Rest::TransportOperation)
- (::Google::Cloud::Error) — if the REST call is aborted.
Basic example
require "google/cloud/ai_platform/v1" # Create a client object. The client can be reused for multiple calls. client = Google::Cloud::AIPlatform::V1::EvaluationService::Rest::Client.new # Create a request. To set request fields, pass in keyword arguments. request = Google::Cloud::AIPlatform::V1::EvaluateInstancesRequest.new # Call the evaluate_instances method. result = client.evaluate_instances request # The returned object is of type Google::Cloud::AIPlatform::V1::EvaluateInstancesResponse. p result
#iam_policy_client
def iam_policy_client() -> Google::Iam::V1::IAMPolicy::Rest::Client
Get the associated client for mix-in of the IAMPolicy.
- (Google::Iam::V1::IAMPolicy::Rest::Client)
#initialize
def initialize() { |config| ... } -> Client
Create a new EvaluationService REST client object.
- (config) — Configure the EvaluationService client.
- config (Client::Configuration)
- (Client) — a new instance of Client
# Create a client using the default configuration client = ::Google::Cloud::AIPlatform::V1::EvaluationService::Rest::Client.new # Create a client using a custom configuration client = ::Google::Cloud::AIPlatform::V1::EvaluationService::Rest::Client.new do |config| config.timeout = 10.0 end
#location_client
def location_client() -> Google::Cloud::Location::Locations::Rest::Client
Get the associated client for mix-in of the Locations.
- (Google::Cloud::Location::Locations::Rest::Client)
#universe_domain
def universe_domain() -> String
The effective universe domain
- (String)