Interface DevEndpoint.Builder

All Superinterfaces:
Buildable, CopyableBuilder<DevEndpoint.Builder,DevEndpoint>, SdkBuilder<DevEndpoint.Builder,DevEndpoint>, SdkPojo
Enclosing class:
DevEndpoint
@Mutable @NotThreadSafe public static interface DevEndpoint.Builder extends SdkPojo, CopyableBuilder<DevEndpoint.Builder,DevEndpoint>

  • Method Details

    • endpointName

      DevEndpoint.Builder endpointName(String endpointName)

      The name of the DevEndpoint.

      Parameters:
      endpointName - The name of the DevEndpoint.
      Returns:
      Returns a reference to this object so that method calls can be chained together.

    • roleArn

      DevEndpoint.Builder roleArn(String roleArn)

      The Amazon Resource Name (ARN) of the IAM role used in this DevEndpoint.

      Parameters:
      roleArn - The Amazon Resource Name (ARN) of the IAM role used in this DevEndpoint.
      Returns:
      Returns a reference to this object so that method calls can be chained together.

    • securityGroupIds

      DevEndpoint.Builder securityGroupIds(Collection<String> securityGroupIds)

      A list of security group identifiers used in this DevEndpoint.

      Parameters:
      securityGroupIds - A list of security group identifiers used in this DevEndpoint.
      Returns:
      Returns a reference to this object so that method calls can be chained together.

    • securityGroupIds

      DevEndpoint.Builder securityGroupIds(String... securityGroupIds)

      A list of security group identifiers used in this DevEndpoint.

      Parameters:
      securityGroupIds - A list of security group identifiers used in this DevEndpoint.
      Returns:
      Returns a reference to this object so that method calls can be chained together.

    • subnetId

      DevEndpoint.Builder subnetId(String subnetId)

      The subnet ID for this DevEndpoint.

      Parameters:
      subnetId - The subnet ID for this DevEndpoint.
      Returns:
      Returns a reference to this object so that method calls can be chained together.

    • yarnEndpointAddress

      DevEndpoint.Builder yarnEndpointAddress(String yarnEndpointAddress)

      The YARN endpoint address used by this DevEndpoint.

      Parameters:
      yarnEndpointAddress - The YARN endpoint address used by this DevEndpoint.
      Returns:
      Returns a reference to this object so that method calls can be chained together.

    • privateAddress

      DevEndpoint.Builder privateAddress(String privateAddress)

      A private IP address to access the DevEndpoint within a VPC if the DevEndpoint is created within one. The PrivateAddress field is present only when you create the DevEndpoint within your VPC.

      Parameters:
      privateAddress - A private IP address to access the DevEndpoint within a VPC if the DevEndpoint is created within one. The PrivateAddress field is present only when you create the DevEndpoint within your VPC.
      Returns:
      Returns a reference to this object so that method calls can be chained together.

    • zeppelinRemoteSparkInterpreterPort

      DevEndpoint.Builder zeppelinRemoteSparkInterpreterPort(Integer zeppelinRemoteSparkInterpreterPort)

      The Apache Zeppelin port for the remote Apache Spark interpreter.

      Parameters:
      zeppelinRemoteSparkInterpreterPort - The Apache Zeppelin port for the remote Apache Spark interpreter.
      Returns:
      Returns a reference to this object so that method calls can be chained together.

    • publicAddress

      DevEndpoint.Builder publicAddress(String publicAddress)

      The public IP address used by this DevEndpoint. The PublicAddress field is present only when you create a non-virtual private cloud (VPC) DevEndpoint.

      Parameters:
      publicAddress - The public IP address used by this DevEndpoint. The PublicAddress field is present only when you create a non-virtual private cloud (VPC) DevEndpoint.
      Returns:
      Returns a reference to this object so that method calls can be chained together.

    • status

      DevEndpoint.Builder status(String status)

      The current status of this DevEndpoint.

      Parameters:
      status - The current status of this DevEndpoint.
      Returns:
      Returns a reference to this object so that method calls can be chained together.

    • workerType

      DevEndpoint.Builder workerType(String workerType)

      The type of predefined worker that is allocated to the development endpoint. Accepts a value of Standard, G.1X, or G.2X.

      • For the Standard worker type, each worker provides 4 vCPU, 16 GB of memory and a 50GB disk, and 2 executors per worker.

      • For the G.1X worker type, each worker maps to 1 DPU (4 vCPU, 16 GB of memory, 64 GB disk), and provides 1 executor per worker. We recommend this worker type for memory-intensive jobs.

      • For the G.2X worker type, each worker maps to 2 DPU (8 vCPU, 32 GB of memory, 128 GB disk), and provides 1 executor per worker. We recommend this worker type for memory-intensive jobs.

      Known issue: when a development endpoint is created with the G.2X WorkerType configuration, the Spark drivers for the development endpoint will run on 4 vCPU, 16 GB of memory, and a 64 GB disk.

      Parameters:
      workerType - The type of predefined worker that is allocated to the development endpoint. Accepts a value of Standard, G.1X, or G.2X.

      • For the Standard worker type, each worker provides 4 vCPU, 16 GB of memory and a 50GB disk, and 2 executors per worker.

      • For the G.1X worker type, each worker maps to 1 DPU (4 vCPU, 16 GB of memory, 64 GB disk), and provides 1 executor per worker. We recommend this worker type for memory-intensive jobs.

      • For the G.2X worker type, each worker maps to 2 DPU (8 vCPU, 32 GB of memory, 128 GB disk), and provides 1 executor per worker. We recommend this worker type for memory-intensive jobs.

      Known issue: when a development endpoint is created with the G.2X WorkerType configuration, the Spark drivers for the development endpoint will run on 4 vCPU, 16 GB of memory, and a 64 GB disk.

      Returns:
      Returns a reference to this object so that method calls can be chained together.
      See Also:

    • workerType

      DevEndpoint.Builder workerType(WorkerType workerType)

      The type of predefined worker that is allocated to the development endpoint. Accepts a value of Standard, G.1X, or G.2X.

      • For the Standard worker type, each worker provides 4 vCPU, 16 GB of memory and a 50GB disk, and 2 executors per worker.

      • For the G.1X worker type, each worker maps to 1 DPU (4 vCPU, 16 GB of memory, 64 GB disk), and provides 1 executor per worker. We recommend this worker type for memory-intensive jobs.

      • For the G.2X worker type, each worker maps to 2 DPU (8 vCPU, 32 GB of memory, 128 GB disk), and provides 1 executor per worker. We recommend this worker type for memory-intensive jobs.

      Known issue: when a development endpoint is created with the G.2X WorkerType configuration, the Spark drivers for the development endpoint will run on 4 vCPU, 16 GB of memory, and a 64 GB disk.

      Parameters:
      workerType - The type of predefined worker that is allocated to the development endpoint. Accepts a value of Standard, G.1X, or G.2X.

      • For the Standard worker type, each worker provides 4 vCPU, 16 GB of memory and a 50GB disk, and 2 executors per worker.

      • For the G.1X worker type, each worker maps to 1 DPU (4 vCPU, 16 GB of memory, 64 GB disk), and provides 1 executor per worker. We recommend this worker type for memory-intensive jobs.

      • For the G.2X worker type, each worker maps to 2 DPU (8 vCPU, 32 GB of memory, 128 GB disk), and provides 1 executor per worker. We recommend this worker type for memory-intensive jobs.

      Known issue: when a development endpoint is created with the G.2X WorkerType configuration, the Spark drivers for the development endpoint will run on 4 vCPU, 16 GB of memory, and a 64 GB disk.

      Returns:
      Returns a reference to this object so that method calls can be chained together.
      See Also:

    • glueVersion

      DevEndpoint.Builder glueVersion(String glueVersion)

      Glue version determines the versions of Apache Spark and Python that Glue supports. The Python version indicates the version supported for running your ETL scripts on development endpoints.

      For more information about the available Glue versions and corresponding Spark and Python versions, see Glue version in the developer guide.

      Development endpoints that are created without specifying a Glue version default to Glue 0.9.

      You can specify a version of Python support for development endpoints by using the Arguments parameter in the CreateDevEndpoint or UpdateDevEndpoint APIs. If no arguments are provided, the version defaults to Python 2.

      Parameters:
      glueVersion - Glue version determines the versions of Apache Spark and Python that Glue supports. The Python version indicates the version supported for running your ETL scripts on development endpoints.

      For more information about the available Glue versions and corresponding Spark and Python versions, see Glue version in the developer guide.

      Development endpoints that are created without specifying a Glue version default to Glue 0.9.

      You can specify a version of Python support for development endpoints by using the Arguments parameter in the CreateDevEndpoint or UpdateDevEndpoint APIs. If no arguments are provided, the version defaults to Python 2.

      Returns:
      Returns a reference to this object so that method calls can be chained together.

    • numberOfWorkers

      DevEndpoint.Builder numberOfWorkers(Integer numberOfWorkers)

      The number of workers of a defined workerType that are allocated to the development endpoint.

      The maximum number of workers you can define are 299 for G.1X, and 149 for G.2X.

      Parameters:
      numberOfWorkers - The number of workers of a defined workerType that are allocated to the development endpoint.

      The maximum number of workers you can define are 299 for G.1X, and 149 for G.2X.

      Returns:
      Returns a reference to this object so that method calls can be chained together.

    • numberOfNodes

      DevEndpoint.Builder numberOfNodes(Integer numberOfNodes)

      The number of Glue Data Processing Units (DPUs) allocated to this DevEndpoint.

      Parameters:
      numberOfNodes - The number of Glue Data Processing Units (DPUs) allocated to this DevEndpoint.
      Returns:
      Returns a reference to this object so that method calls can be chained together.

    • availabilityZone

      DevEndpoint.Builder availabilityZone(String availabilityZone)

      The Amazon Web Services Availability Zone where this DevEndpoint is located.

      Parameters:
      availabilityZone - The Amazon Web Services Availability Zone where this DevEndpoint is located.
      Returns:
      Returns a reference to this object so that method calls can be chained together.

    • vpcId

      DevEndpoint.Builder vpcId(String vpcId)

      The ID of the virtual private cloud (VPC) used by this DevEndpoint.

      Parameters:
      vpcId - The ID of the virtual private cloud (VPC) used by this DevEndpoint.
      Returns:
      Returns a reference to this object so that method calls can be chained together.

    • extraPythonLibsS3Path

      DevEndpoint.Builder extraPythonLibsS3Path(String extraPythonLibsS3Path)

      The paths to one or more Python libraries in an Amazon S3 bucket that should be loaded in your DevEndpoint. Multiple values must be complete paths separated by a comma.

      You can only use pure Python libraries with a DevEndpoint. Libraries that rely on C extensions, such as the pandas Python data analysis library, are not currently supported.

      Parameters:
      extraPythonLibsS3Path - The paths to one or more Python libraries in an Amazon S3 bucket that should be loaded in your DevEndpoint. Multiple values must be complete paths separated by a comma.

      You can only use pure Python libraries with a DevEndpoint. Libraries that rely on C extensions, such as the pandas Python data analysis library, are not currently supported.

      Returns:
      Returns a reference to this object so that method calls can be chained together.

    • extraJarsS3Path

      DevEndpoint.Builder extraJarsS3Path(String extraJarsS3Path)

      The path to one or more Java .jar files in an S3 bucket that should be loaded in your DevEndpoint.

      You can only use pure Java/Scala libraries with a DevEndpoint.

      Parameters:
      extraJarsS3Path - The path to one or more Java .jar files in an S3 bucket that should be loaded in your DevEndpoint.

      You can only use pure Java/Scala libraries with a DevEndpoint.

      Returns:
      Returns a reference to this object so that method calls can be chained together.

    • failureReason

      DevEndpoint.Builder failureReason(String failureReason)

      The reason for a current failure in this DevEndpoint.

      Parameters:
      failureReason - The reason for a current failure in this DevEndpoint.
      Returns:
      Returns a reference to this object so that method calls can be chained together.

    • lastUpdateStatus

      DevEndpoint.Builder lastUpdateStatus(String lastUpdateStatus)

      The status of the last update.

      Parameters:
      lastUpdateStatus - The status of the last update.
      Returns:
      Returns a reference to this object so that method calls can be chained together.

    • createdTimestamp

      DevEndpoint.Builder createdTimestamp(Instant createdTimestamp)

      The point in time at which this DevEndpoint was created.

      Parameters:
      createdTimestamp - The point in time at which this DevEndpoint was created.
      Returns:
      Returns a reference to this object so that method calls can be chained together.

    • lastModifiedTimestamp

      DevEndpoint.Builder lastModifiedTimestamp(Instant lastModifiedTimestamp)

      The point in time at which this DevEndpoint was last modified.

      Parameters:
      lastModifiedTimestamp - The point in time at which this DevEndpoint was last modified.
      Returns:
      Returns a reference to this object so that method calls can be chained together.

    • publicKey

      DevEndpoint.Builder publicKey(String publicKey)

      The public key to be used by this DevEndpoint for authentication. This attribute is provided for backward compatibility because the recommended attribute to use is public keys.

      Parameters:
      publicKey - The public key to be used by this DevEndpoint for authentication. This attribute is provided for backward compatibility because the recommended attribute to use is public keys.
      Returns:
      Returns a reference to this object so that method calls can be chained together.

    • publicKeys

      DevEndpoint.Builder publicKeys(Collection<String> publicKeys)

      A list of public keys to be used by the DevEndpoints for authentication. Using this attribute is preferred over a single public key because the public keys allow you to have a different private key per client.

      If you previously created an endpoint with a public key, you must remove that key to be able to set a list of public keys. Call the UpdateDevEndpoint API operation with the public key content in the deletePublicKeys attribute, and the list of new keys in the addPublicKeys attribute.

      Parameters:
      publicKeys - A list of public keys to be used by the DevEndpoints for authentication. Using this attribute is preferred over a single public key because the public keys allow you to have a different private key per client.

      If you previously created an endpoint with a public key, you must remove that key to be able to set a list of public keys. Call the UpdateDevEndpoint API operation with the public key content in the deletePublicKeys attribute, and the list of new keys in the addPublicKeys attribute.

      Returns:
      Returns a reference to this object so that method calls can be chained together.

    • publicKeys

      DevEndpoint.Builder publicKeys(String... publicKeys)

      A list of public keys to be used by the DevEndpoints for authentication. Using this attribute is preferred over a single public key because the public keys allow you to have a different private key per client.

      If you previously created an endpoint with a public key, you must remove that key to be able to set a list of public keys. Call the UpdateDevEndpoint API operation with the public key content in the deletePublicKeys attribute, and the list of new keys in the addPublicKeys attribute.

      Parameters:
      publicKeys - A list of public keys to be used by the DevEndpoints for authentication. Using this attribute is preferred over a single public key because the public keys allow you to have a different private key per client.

      If you previously created an endpoint with a public key, you must remove that key to be able to set a list of public keys. Call the UpdateDevEndpoint API operation with the public key content in the deletePublicKeys attribute, and the list of new keys in the addPublicKeys attribute.

      Returns:
      Returns a reference to this object so that method calls can be chained together.

    • securityConfiguration

      DevEndpoint.Builder securityConfiguration(String securityConfiguration)

      The name of the SecurityConfiguration structure to be used with this DevEndpoint.

      Parameters:
      securityConfiguration - The name of the SecurityConfiguration structure to be used with this DevEndpoint.
      Returns:
      Returns a reference to this object so that method calls can be chained together.

    • arguments

      DevEndpoint.Builder arguments(Map<String,String> arguments)

      A map of arguments used to configure the DevEndpoint.

      Valid arguments are:

      • "--enable-glue-datacatalog": ""

      You can specify a version of Python support for development endpoints by using the Arguments parameter in the CreateDevEndpoint or UpdateDevEndpoint APIs. If no arguments are provided, the version defaults to Python 2.

      Parameters:
      arguments - A map of arguments used to configure the DevEndpoint.

      Valid arguments are:

      • "--enable-glue-datacatalog": ""

      You can specify a version of Python support for development endpoints by using the Arguments parameter in the CreateDevEndpoint or UpdateDevEndpoint APIs. If no arguments are provided, the version defaults to Python 2.

      Returns:
      Returns a reference to this object so that method calls can be chained together.