Builder

class Builder

Properties

Link copied to clipboard

Additional model parameters and their corresponding values not included in the textInferenceConfig structure for an external source. Takes in custom model parameters specific to the language model being used.

Link copied to clipboard

The configuration details for the guardrail.

Link copied to clipboard

Configuration settings for inference when using RetrieveAndGenerate to generate responses while using an external source.

Link copied to clipboard

The latency configuration for the model.

Link copied to clipboard

Contain the textPromptTemplate string for the external source wrapper object.

Functions