GoogleApi.AIPlatform.V1.Model.GoogleCloudAiplatformV1AutoraterConfig (google_api_ai_platform v0.27.0)

View Source

The configs for autorater. This is applicable to both EvaluateInstances and EvaluateDataset.

Attributes

  • autoraterModel (type: String.t, default: nil) - Optional. The fully qualified name of the publisher model or tuned autorater endpoint to use. Publisher model format: projects/{project}/locations/{location}/publishers/*/models/* Tuned model endpoint format: projects/{project}/locations/{location}/endpoints/{endpoint}
  • flipEnabled (type: boolean(), default: nil) - Optional. Whether to flip the candidate and baseline responses. This is only applicable to the pairwise metric. If enabled, also provide PairwiseMetricSpec.candidate_response_field_name and PairwiseMetricSpec.baseline_response_field_name. When rendering PairwiseMetricSpec.metric_prompt_template, the candidate and baseline fields will be flipped for half of the samples to reduce bias.
  • samplingCount (type: integer(), default: nil) - Optional. Number of samples for each instance in the dataset. If not specified, the default is 4. Minimum value is 1, maximum value is 32.

Summary

Types

t()

Functions

decode(value, options)

Unwrap a decoded JSON object into its complex fields.

Types

t()

@type t() :: %GoogleApi.AIPlatform.V1.Model.GoogleCloudAiplatformV1AutoraterConfig{
  autoraterModel: String.t() | nil,
  flipEnabled: boolean() | nil,
  samplingCount: integer() | nil
}

Functions

decode(value, options)

@spec decode(struct(), keyword()) :: struct()

Unwrap a decoded JSON object into its complex fields.