Interface AsyncInferenceClientConfig.Builder

All Superinterfaces:

Buildable, CopyableBuilder<AsyncInferenceClientConfig.Builder,AsyncInferenceClientConfig>, SdkBuilder<AsyncInferenceClientConfig.Builder,AsyncInferenceClientConfig>, SdkPojo

Enclosing class:

AsyncInferenceClientConfig

@Mutable
@NotThreadSafe
public static interface AsyncInferenceClientConfig.Builder
extends SdkPojo, CopyableBuilder<AsyncInferenceClientConfig.Builder,AsyncInferenceClientConfig>

Method Summary

Modifier and Type	Method	Description
AsyncInferenceClientConfig.Builder	maxConcurrentInvocationsPerInstance(Integer maxConcurrentInvocationsPerInstance)	The maximum number of concurrent requests sent by the SageMaker client to the model container.

Methods inherited from interface software.amazon.awssdk.utils.builder.CopyableBuilder

copy

Methods inherited from interface software.amazon.awssdk.utils.builder.SdkBuilder

applyMutation, build

Methods inherited from interface software.amazon.awssdk.core.SdkPojo

equalsBySdkFields, sdkFieldNameToField, sdkFields

Method Details

maxConcurrentInvocationsPerInstance

AsyncInferenceClientConfig.Builder maxConcurrentInvocationsPerInstance(Integer maxConcurrentInvocationsPerInstance)

The maximum number of concurrent requests sent by the SageMaker client to the model container. If no value is provided, SageMaker chooses an optimal value.

Parameters:

maxConcurrentInvocationsPerInstance - The maximum number of concurrent requests sent by the SageMaker client to the model container. If no value is provided, SageMaker chooses an optimal value.

Returns:

Returns a reference to this object so that method calls can be chained together.