Interface SparkJobProps
- All Superinterfaces:
JobProps,software.amazon.jsii.JsiiSerializable
- All Known Subinterfaces:
PySparkEtlJobProps,PySparkFlexEtlJobProps,PySparkStreamingJobProps,ScalaSparkEtlJobProps,ScalaSparkFlexEtlJobProps,ScalaSparkStreamingJobProps
- All Known Implementing Classes:
PySparkEtlJobProps.Jsii$Proxy,PySparkFlexEtlJobProps.Jsii$Proxy,PySparkStreamingJobProps.Jsii$Proxy,ScalaSparkEtlJobProps.Jsii$Proxy,ScalaSparkFlexEtlJobProps.Jsii$Proxy,ScalaSparkStreamingJobProps.Jsii$Proxy,SparkJobProps.Jsii$Proxy
@Generated(value="jsii-pacmak/1.139.0 (build 26a6b54)",
date="2026-09-17T14:54:30.193Z")
@Stability(Deprecated)
@Deprecated
public interface SparkJobProps
extends software.amazon.jsii.JsiiSerializable, JobProps
Deprecated.
(deprecated) Common properties for different types of Spark jobs.
Example:
// The code below shows an example of how to instantiate this type.
// The values are placeholders you should change.
import software.amazon.awscdk.services.glue.alpha.*;
import software.amazon.awscdk.*;
import software.amazon.awscdk.services.iam.*;
import software.amazon.awscdk.services.logs.*;
import software.amazon.awscdk.services.s3.*;
Bucket bucket;
Code code;
Connection connection;
LogGroup logGroup;
Role role;
SecurityConfiguration securityConfiguration;
SparkJobProps sparkJobProps = SparkJobProps.builder()
.role(role)
.script(code)
// the properties below are optional
.connections(List.of(connection))
.continuousLogging(ContinuousLoggingProps.builder()
.enabled(false)
// the properties below are optional
.conversionPattern("conversionPattern")
.logGroup(logGroup)
.logStreamPrefix("logStreamPrefix")
.quiet(false)
.build())
.defaultArguments(Map.of(
"defaultArgumentsKey", "defaultArguments"))
.description("description")
.enableMetrics(false)
.enableObservabilityMetrics(false)
.glueVersion(GlueVersion.V0_9)
.jobName("jobName")
.maxConcurrentRuns(123)
.maxRetries(123)
.securityConfiguration(securityConfiguration)
.sparkUI(SparkUIProps.builder()
.bucket(bucket)
.prefix("prefix")
.build())
.tags(Map.of(
"tagsKey", "tags"))
.timeout(Duration.minutes(30))
.workerConfiguration(WorkerConfiguration.builder()
.numberOfWorkers(123)
.workerType(WorkerType.STANDARD)
.build())
.build();
-
Nested Class Summary
Nested ClassesModifier and TypeInterfaceDescriptionstatic final classDeprecated.static final classDeprecated. -
Method Summary
Modifier and TypeMethodDescriptionstatic SparkJobProps.Builderbuilder()Deprecated.default BooleanDeprecated.default BooleanDeprecated.default SparkUIPropsDeprecated.default WorkerConfigurationDeprecated.Methods inherited from interface software.amazon.awscdk.services.glue.alpha.JobProps
getConnections, getContinuousLogging, getDefaultArguments, getDescription, getGlueVersion, getJobName, getMaxConcurrentRuns, getMaxRetries, getRole, getScript, getSecurityConfiguration, getTags, getTimeoutMethods inherited from interface software.amazon.jsii.JsiiSerializable
$jsii$toJson
-
Method Details
-
getEnableMetrics
Deprecated.(deprecated) Enable profiling metrics for the Glue job.When enabled, adds '--enable-metrics' to job arguments.
Default: true
-
getEnableObservabilityMetrics
Deprecated.(deprecated) Enable observability metrics for the Glue job.When enabled, adds '--enable-observability-metrics': 'true' to job arguments.
Default: true
-
getSparkUI
Deprecated.(deprecated) Enables the Spark UI debugging and monitoring with the specified props.Default: - Spark UI debugging and monitoring is disabled.
- See Also:
-
getWorkerConfiguration
Deprecated.(deprecated) The worker type and the number of workers allocated when a job runs.Default: - the job runs with the G_1X worker type and 10 workers.
-
builder
Deprecated.- Returns:
- a
SparkJobProps.BuilderofSparkJobProps
-