Package software.amazon.awscdk.services.glue.alpha

Class PySparkEtlJob

java.lang.Object
software.amazon.jsii.JsiiObject
software.constructs.Construct
software.amazon.awscdk.Resource
software.amazon.awscdk.services.glue.alpha.JobBase
software.amazon.awscdk.services.glue.alpha.Job
software.amazon.awscdk.services.glue.alpha.SparkJob
software.amazon.awscdk.services.glue.alpha.PySparkEtlJob
All Implemented Interfaces:
IJobRef, IEnvironmentAware, IResource, IJob, IGrantable, software.amazon.jsii.JsiiSerializable, software.constructs.IConstruct, software.constructs.IDependable
@Generated(value="jsii-pacmak/1.139.0 (build 26a6b54)", date="2026-09-17T14:54:30.094Z") @Stability(Deprecated) @Deprecated public class PySparkEtlJob extends SparkJob
Deprecated.
(deprecated) PySpark ETL Jobs class.

ETL jobs support pySpark and Scala languages, for which there are separate but similar constructors. ETL jobs default to the G1 worker type, but you can override this default with other supported worker type values (G1, G2, G4 and G8). ETL jobs defaults to Glue version 4.0, which you can override to 3.0. The following ETL features are enabled by default: --enable-metrics, --enable-continuous-cloudwatch-log. The Spark UI (--enable-spark-ui) is off by default; enable it by setting the sparkUI prop. You can find more details about version, worker type and other features in Glue's public documentation.

Example: 

 import software.amazon.awscdk.*;
 import software.amazon.awscdk.services.iam.*;
 Stack stack;
 IRole role;
 Code script;
 // Create a job to run from the workflow
 PySparkEtlJob job = PySparkEtlJob.Builder.create(stack, "Job").role(role).script(script).build();
 // Create a workflow and add a trigger that runs the job
 Workflow workflow = new Workflow(stack, "Workflow");
 workflow.addOnDemandTrigger("OnDemandTrigger", OnDemandTriggerOptions.builder()
         .actions(List.of(Action.job(job)))
         .build());

  • Field Details

    • PROPERTY_INJECTION_ID

      @Stability(Deprecated) @Deprecated public static final String PROPERTY_INJECTION_ID
      Deprecated.
      (deprecated) Uniquely identifies this class.

  • Constructor Details

    • PySparkEtlJob

      protected PySparkEtlJob(software.amazon.jsii.JsiiObjectRef objRef)
      Deprecated.

    • PySparkEtlJob

      protected PySparkEtlJob(software.amazon.jsii.JsiiObject.InitializationMode initializationMode)
      Deprecated.

    • PySparkEtlJob

      @Stability(Deprecated) @Deprecated public PySparkEtlJob(@NotNull software.constructs.Construct scope, @NotNull String id, @NotNull PySparkEtlJobProps props)
      Deprecated.
      (deprecated) PySparkEtlJob constructor.

      Parameters:
      scope - This parameter is required.
      id - This parameter is required.
      props - This parameter is required.

  • Method Details