Class PySparkStreamingJob

java.lang.Object
software.amazon.jsii.JsiiObject
All Implemented Interfaces:
IJobRef, IEnvironmentAware, IResource, IJob, IGrantable, software.amazon.jsii.JsiiSerializable, software.constructs.IConstruct, software.constructs.IDependable

@Generated(value="jsii-pacmak/1.139.0 (build 26a6b54)", date="2026-09-17T14:54:30.106Z") @Stability(Deprecated) @Deprecated public class PySparkStreamingJob extends SparkJob
Deprecated.
(deprecated) Python Spark Streaming Jobs class.

A Streaming job is similar to an ETL job, except that it performs ETL on data streams using the Apache Spark Structured Streaming framework. These jobs will default to use Python 3.9.

Similar to ETL jobs, streaming job supports Scala and Python languages. Similar to ETL, it supports G1 and G2 worker type and 2.0, 3.0 and 4.0 version. We’ll default to G1 worker and 4.0 version for streaming jobs which developers can override. We will enable --enable-metrics, --enable-continuous-cloudwatch-log. The Spark UI (--enable-spark-ui) is off by default; enable it by setting the sparkUI prop.

Example:

 import software.amazon.awscdk.*;
 import software.amazon.awscdk.services.iam.*;
 Stack stack;
 IRole role;
 Code script;
 PySparkStreamingJob.Builder.create(stack, "ImportedJob").role(role).script(script).build();
 
  • Field Details

    • PROPERTY_INJECTION_ID

      @Stability(Deprecated) @Deprecated public static final String PROPERTY_INJECTION_ID
      Deprecated.
      (deprecated) Uniquely identifies this class.
  • Constructor Details

    • PySparkStreamingJob

      protected PySparkStreamingJob(software.amazon.jsii.JsiiObjectRef objRef)
      Deprecated.
    • PySparkStreamingJob

      protected PySparkStreamingJob(software.amazon.jsii.JsiiObject.InitializationMode initializationMode)
      Deprecated.
    • PySparkStreamingJob

      @Stability(Deprecated) @Deprecated public PySparkStreamingJob(@NotNull software.constructs.Construct scope, @NotNull String id, @NotNull PySparkStreamingJobProps props)
      Deprecated.
      (deprecated) PySparkStreamingJob constructor.

      Parameters:
      scope - This parameter is required.
      id - This parameter is required.
      props - This parameter is required.
  • Method Details