Package software.amazon.awscdk.services.glue

Class PySparkStreamingJob

java.lang.Object

software.amazon.jsii.JsiiObject

software.constructs.Construct

software.amazon.awscdk.Resource

software.amazon.awscdk.services.glue.JobBase

software.amazon.awscdk.services.glue.Job

software.amazon.awscdk.services.glue.SparkJob

software.amazon.awscdk.services.glue.PySparkStreamingJob

All Implemented Interfaces:

IJobRef, IEnvironmentAware, IResource, IJob, IGrantable, software.amazon.jsii.JsiiSerializable, software.constructs.IConstruct, software.constructs.IDependable

@Generated(value="jsii-pacmak/1.139.0 (build 26a6b54)",
           date="2026-09-17T14:54:05.063Z")
@Stability(Stable)
public class PySparkStreamingJob
extends SparkJob

Python Spark Streaming Jobs class.

A Streaming job is similar to an ETL job, except that it performs ETL on data streams using the Apache Spark Structured Streaming framework. These jobs run on Python 3.

Similar to ETL jobs, streaming job supports Scala and Python languages. Streaming jobs default to the G_1X worker type and Glue version 4.0, both of which developers can override with any supported WorkerType or GlueVersion. We will enable --enable-metrics, --enable-continuous-cloudwatch-log. The Spark UI (--enable-spark-ui) is off by default; enable it by setting the sparkUI prop.

Example:

 import software.amazon.awscdk.*;
 import software.amazon.awscdk.services.iam.*;
 Stack stack;
 IRole role;
 Code script;
 PySparkStreamingJob.Builder.create(stack, "ImportedJob").role(role).script(script).build();
 

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static final class	PySparkStreamingJob.Builder	A fluent builder for PySparkStreamingJob.

Nested classes/interfaces inherited from class software.amazon.jsii.JsiiObject

software.amazon.jsii.JsiiObject.InitializationMode

Nested classes/interfaces inherited from interface software.constructs.IConstruct

software.constructs.IConstruct.Jsii$Default

Nested classes/interfaces inherited from interface software.amazon.awscdk.services.glue.IJob

IJob.Jsii$Default

Nested classes/interfaces inherited from interface software.amazon.awscdk.IResource

IResource.Jsii$Default

Field Summary

Fields

Modifier and Type	Field	Description
static final String	PROPERTY_INJECTION_ID	Uniquely identifies this class.

Constructor Summary

Constructors

Modifier	Constructor	Description
protected	PySparkStreamingJob(software.amazon.jsii.JsiiObject.InitializationMode initializationMode)
protected	PySparkStreamingJob(software.amazon.jsii.JsiiObjectRef objRef)
	PySparkStreamingJob(software.constructs.Construct scope, String id, PySparkStreamingJobProps props)	PySparkStreamingJob constructor.

Method Summary

Modifier and Type	Method	Description
String	getJobArn()	The ARN of the job.
String	getJobName()	The name of the job.

Methods inherited from class software.amazon.awscdk.services.glue.SparkJob

getGrantPrincipal, getRole, getSparkUILoggingLocation, nonExecutableCommonArguments, setupExtraCodeArguments

Methods inherited from class software.amazon.awscdk.services.glue.Job

codeS3ObjectUrl, fromJobAttributes, mergeDefaultArguments, mergeDefaultArguments, setManagedArgument, setManagedArgument, setupContinuousLogging, setupContinuousLogging, setupContinuousLogging

Methods inherited from class software.amazon.awscdk.services.glue.JobBase

buildJobArn, getJobRef, metric, metric, metricFailure, metricFailure, metricSuccess, metricSuccess, metricTimeout, metricTimeout, onEvent, onEvent, onFailure, onFailure, onStateChange, onStateChange, onSuccess, onSuccess, onTimeout, onTimeout

Methods inherited from class software.amazon.awscdk.Resource

applyCrossStackReferenceStrength, applyRemovalPolicy, generatePhysicalName, getEnv, getPhysicalName, getResourceArnAttribute, getResourceNameAttribute, getStack, isOwnedResource, isResource, with

Methods inherited from class software.constructs.Construct

getNode, isConstruct, toString

Methods inherited from class software.amazon.jsii.JsiiObject

jsiiAsyncCall, jsiiAsyncCall, jsiiCall, jsiiCall, jsiiGet, jsiiGet, jsiiSet, jsiiStaticCall, jsiiStaticCall, jsiiStaticGet, jsiiStaticGet, jsiiStaticSet, jsiiStaticSet

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Methods inherited from interface software.constructs.IConstruct

getNode, with

Methods inherited from interface software.amazon.awscdk.interfaces.IEnvironmentAware

getEnv

Methods inherited from interface software.amazon.awscdk.IResource

applyRemovalPolicy, getStack

Methods inherited from interface software.amazon.jsii.JsiiSerializable

$jsii$toJson

Field Details

PROPERTY_INJECTION_ID

@Stability(Stable)
public static final String PROPERTY_INJECTION_ID

Uniquely identifies this class.

Constructor Details

PySparkStreamingJob

protected PySparkStreamingJob(software.amazon.jsii.JsiiObjectRef objRef)

PySparkStreamingJob

protected PySparkStreamingJob(software.amazon.jsii.JsiiObject.InitializationMode initializationMode)

PySparkStreamingJob

@Stability(Stable)
public PySparkStreamingJob(@NotNull
 software.constructs.Construct scope,
 @NotNull
 String id,
 @NotNull
 PySparkStreamingJobProps props)

PySparkStreamingJob constructor.

Parameters:

scope - This parameter is required.

id - This parameter is required.

props - This parameter is required.

Method Details

getJobArn

@Stability(Stable)
@NotNull
public String getJobArn()

The ARN of the job.

Specified by:

getJobArn in interface IJob

Specified by:

getJobArn in class JobBase

getJobName

@Stability(Stable)
@NotNull
public String getJobName()

The name of the job.

Specified by:

getJobName in interface IJob

Specified by:

getJobName in class JobBase