Interface SparkConnectorSource.Builder

All Superinterfaces:
Buildable, CopyableBuilder<SparkConnectorSource.Builder,SparkConnectorSource>, SdkBuilder<SparkConnectorSource.Builder,SparkConnectorSource>, SdkPojo
Enclosing class:
SparkConnectorSource
@Mutable @NotThreadSafe public static interface SparkConnectorSource.Builder extends SdkPojo, CopyableBuilder<SparkConnectorSource.Builder,SparkConnectorSource>

  • Method Details

    • name

      SparkConnectorSource.Builder name(String name)

      The name of the data source.

      Parameters:
      name - The name of the data source.
      Returns:
      Returns a reference to this object so that method calls can be chained together.

    • connectionName

      SparkConnectorSource.Builder connectionName(String connectionName)

      The name of the connection that is associated with the connector.

      Parameters:
      connectionName - The name of the connection that is associated with the connector.
      Returns:
      Returns a reference to this object so that method calls can be chained together.

    • connectorName

      SparkConnectorSource.Builder connectorName(String connectorName)

      The name of a connector that assists with accessing the data store in Glue Studio.

      Parameters:
      connectorName - The name of a connector that assists with accessing the data store in Glue Studio.
      Returns:
      Returns a reference to this object so that method calls can be chained together.

    • connectionType

      SparkConnectorSource.Builder connectionType(String connectionType)

      The type of connection, such as marketplace.spark or custom.spark, designating a connection to an Apache Spark data store.

      Parameters:
      connectionType - The type of connection, such as marketplace.spark or custom.spark, designating a connection to an Apache Spark data store.
      Returns:
      Returns a reference to this object so that method calls can be chained together.

    • additionalOptions

      SparkConnectorSource.Builder additionalOptions(Map<String,String> additionalOptions)

      Additional connection options for the connector.

      Parameters:
      additionalOptions - Additional connection options for the connector.
      Returns:
      Returns a reference to this object so that method calls can be chained together.

    • outputSchemas

      SparkConnectorSource.Builder outputSchemas(Collection<GlueSchema> outputSchemas)

      Specifies data schema for the custom spark source.

      Parameters:
      outputSchemas - Specifies data schema for the custom spark source.
      Returns:
      Returns a reference to this object so that method calls can be chained together.

    • outputSchemas

      SparkConnectorSource.Builder outputSchemas(GlueSchema... outputSchemas)

      Specifies data schema for the custom spark source.

      Parameters:
      outputSchemas - Specifies data schema for the custom spark source.
      Returns:
      Returns a reference to this object so that method calls can be chained together.

    • outputSchemas

      SparkConnectorSource.Builder outputSchemas(Consumer<GlueSchema.Builder>... outputSchemas)

      Specifies data schema for the custom spark source.

      This is a convenience method that creates an instance of the GlueSchema.Builder avoiding the need to create one manually via GlueSchema.builder().

      When the Consumer completes, SdkBuilder.build() is called immediately and its result is passed to outputSchemas(List<GlueSchema>).

      Parameters:
      outputSchemas - a consumer that will call methods on GlueSchema.Builder
      Returns:
      Returns a reference to this object so that method calls can be chained together.
      See Also: