AutomatedEvaluationConfig
The configuration details of an automated evaluation job. The EvaluationDatasetMetricConfig
object is used to specify the prompt datasets, task type, and metric names.
Types
Properties
Link copied to clipboard
Defines the configuration of custom metrics to be used in an evaluation job.
Link copied to clipboard
Configuration details of the prompt datasets and metrics you want to use for your evaluation job.
Link copied to clipboard
Contains the evaluator model configuration details. EvaluatorModelConfig
is required for evaluation jobs that use a knowledge base or in model evaluation job that use a model as judge. This model computes all evaluation related metrics.
Functions
Link copied to clipboard
inline fun copy(block: AutomatedEvaluationConfig.Builder.() -> Unit = {}): AutomatedEvaluationConfig