Package software.amazon.awscdk.services.glue.alpha

Class ScalaSparkEtlJob

java.lang.Object
software.amazon.jsii.JsiiObject
software.constructs.Construct
software.amazon.awscdk.Resource
software.amazon.awscdk.services.glue.alpha.JobBase
software.amazon.awscdk.services.glue.alpha.Job
software.amazon.awscdk.services.glue.alpha.SparkJob
software.amazon.awscdk.services.glue.alpha.ScalaSparkEtlJob
All Implemented Interfaces:
IJobRef, IEnvironmentAware, IResource, IJob, IGrantable, software.amazon.jsii.JsiiSerializable, software.constructs.IConstruct, software.constructs.IDependable
@Generated(value="jsii-pacmak/1.139.0 (build 26a6b54)", date="2026-09-17T14:54:30.162Z") @Stability(Deprecated) @Deprecated public class ScalaSparkEtlJob extends SparkJob
Deprecated.
(deprecated) Spark ETL Jobs class.

ETL jobs support pySpark and Scala languages, for which there are separate but similar constructors. ETL jobs default to the G1 worker type, but you can override this default with other supported worker type values (G1, G2, G4 and G8). ETL jobs defaults to Glue version 4.0, which you can override to 3.0. The following ETL features are enabled by default: --enable-metrics, --enable-continuous-cloudwatch-log. The Spark UI (--enable-spark-ui) is off by default; enable it by setting the sparkUI prop. You can find more details about version, worker type and other features in Glue's public documentation.

Example: 

 // The code below shows an example of how to instantiate this type.
 // The values are placeholders you should change.
 import software.amazon.awscdk.services.glue.alpha.*;
 import software.amazon.awscdk.*;
 import software.amazon.awscdk.services.iam.*;
 import software.amazon.awscdk.services.logs.*;
 import software.amazon.awscdk.services.s3.*;
 Bucket bucket;
 Code code;
 Connection connection;
 LogGroup logGroup;
 Role role;
 SecurityConfiguration securityConfiguration;
 ScalaSparkEtlJob scalaSparkEtlJob = ScalaSparkEtlJob.Builder.create(this, "MyScalaSparkEtlJob")
         .className("className")
         .role(role)
         .script(code)
         // the properties below are optional
         .connections(List.of(connection))
         .continuousLogging(ContinuousLoggingProps.builder()
                 .enabled(false)
                 // the properties below are optional
                 .conversionPattern("conversionPattern")
                 .logGroup(logGroup)
                 .logStreamPrefix("logStreamPrefix")
                 .quiet(false)
                 .build())
         .defaultArguments(Map.of(
                 "defaultArgumentsKey", "defaultArguments"))
         .description("description")
         .enableMetrics(false)
         .enableObservabilityMetrics(false)
         .extraFiles(List.of(code))
         .extraJars(List.of(code))
         .extraJarsFirst(false)
         .glueVersion(GlueVersion.V0_9)
         .jobName("jobName")
         .jobRunQueuingEnabled(false)
         .maxConcurrentRuns(123)
         .maxRetries(123)
         .notifyDelayAfter(Duration.minutes(30))
         .securityConfiguration(securityConfiguration)
         .sparkUI(SparkUIProps.builder()
                 .bucket(bucket)
                 .prefix("prefix")
                 .build())
         .tags(Map.of(
                 "tagsKey", "tags"))
         .timeout(Duration.minutes(30))
         .workerConfiguration(WorkerConfiguration.builder()
                 .numberOfWorkers(123)
                 .workerType(WorkerType.STANDARD)
                 .build())
         .build();

  • Field Details

    • PROPERTY_INJECTION_ID

      @Stability(Deprecated) @Deprecated public static final String PROPERTY_INJECTION_ID
      Deprecated.
      (deprecated) Uniquely identifies this class.

  • Constructor Details

    • ScalaSparkEtlJob

      protected ScalaSparkEtlJob(software.amazon.jsii.JsiiObjectRef objRef)
      Deprecated.

    • ScalaSparkEtlJob

      protected ScalaSparkEtlJob(software.amazon.jsii.JsiiObject.InitializationMode initializationMode)
      Deprecated.

    • ScalaSparkEtlJob

      @Stability(Deprecated) @Deprecated public ScalaSparkEtlJob(@NotNull software.constructs.Construct scope, @NotNull String id, @NotNull ScalaSparkEtlJobProps props)
      Deprecated.
      (deprecated) ScalaSparkEtlJob constructor.

      Parameters:
      scope - This parameter is required.
      id - This parameter is required.
      props - This parameter is required.

  • Method Details