aws_cdk.aws_glue

Package Overview

Action

An action initiated by a trigger.

AssetCode

Job Code from a local file.

Catalog

A Glue Data Catalog.

CatalogBase

Base class for all ICatalog implementations.

CatalogEncryptionMode

The encryption-at-rest mode for a Glue Data Catalog.

CatalogEncryptionOptions

CatalogProps

CfnBlueprint

Resource Type definition for AWS::Glue::Blueprint.

CfnBlueprintProps

CfnCatalog

Creates a catalog in the Glue Data Catalog.

CfnCatalogProps

CfnClassifier

The AWS::Glue::Classifier resource creates an AWS Glue classifier that categorizes data sources and specifies schemas.

CfnClassifierProps

CfnConnection

The AWS::Glue::Connection resource specifies an AWS Glue connection to a data source.

CfnConnectionProps

CfnCrawler

The AWS::Glue::Crawler resource specifies an AWS Glue crawler.

CfnCrawlerProps

CfnCustomEntityType

Creates a custom pattern that is used to detect sensitive data across the columns and rows of your structured data.

CfnCustomEntityTypeProps

CfnDataCatalogEncryptionSettings

Sets the security configuration for a specified catalog.

CfnDataCatalogEncryptionSettingsProps

CfnDataQualityRuleset

The AWS::Glue::DataQualityRuleset resource specifies a data quality ruleset with DQDL rules applied to a specified AWS Glue table.

CfnDataQualityRulesetProps

CfnDatabase

The AWS::Glue::Database resource specifies a logical grouping of tables in AWS Glue .

CfnDatabaseProps

CfnDevEndpoint

The AWS::Glue::DevEndpoint resource specifies a development endpoint where a developer can remotely debug ETL scripts for AWS Glue .

CfnDevEndpointProps

CfnIdentityCenterConfiguration

Creates a new AWS Glue Identity Center configuration to enable integration between AWS Glue and AWS IAM Identity Center for authentication and authorization.

CfnIdentityCenterConfigurationProps

CfnIntegration

The AWS::Glue::Integration resource specifies an AWS Glue zero-ETL integration from a data source to a target.

CfnIntegrationProps

CfnIntegrationResourceProperty

The AWS::Glue::IntegrationResourceProperty resource type can be used to setup ResourceProperty of the AWS Glue connection (for the SaaS source), DynamoDB Database (for DynamoDB source), or AWS Glue database ARN (for the target).

CfnIntegrationResourcePropertyProps

CfnJob

The AWS::Glue::Job resource specifies an AWS Glue job in the data catalog.

CfnJobProps

CfnMLTransform

The AWS::Glue::MLTransform is an AWS Glue resource type that manages machine learning transforms.

CfnMLTransformProps

CfnPartition

The AWS::Glue::Partition resource creates an AWS Glue partition, which represents a slice of table data.

CfnPartitionProps

CfnRegistry

The AWS::Glue::Registry is an AWS Glue resource type that manages registries of schemas in the AWS Glue Schema Registry.

CfnRegistryProps

CfnSchema

The AWS::Glue::Schema is an AWS Glue resource type that manages schemas in the AWS Glue Schema Registry.

CfnSchemaProps

CfnSchemaVersion

The AWS::Glue::SchemaVersion is an AWS Glue resource type that manages schema versions of schemas in the AWS Glue Schema Registry.

CfnSchemaVersionMetadata

The AWS::Glue::SchemaVersionMetadata is an AWS Glue resource type that defines the metadata key-value pairs for a schema version in AWS Glue Schema Registry.

CfnSchemaVersionMetadataProps

CfnSchemaVersionProps

CfnSecurityConfiguration

Creates a new security configuration.

CfnSecurityConfigurationProps

CfnSession

Resource Type definition for AWS::Glue::Session.

CfnSessionProps

CfnTable

The AWS::Glue::Table resource specifies tabular data in the AWS Glue data catalog.

CfnTableOptimizer

An AWS Glue resource for enabling table optimizers to improve read performance for open table formats.

CfnTableOptimizerProps

CfnTableProps

CfnTrigger

The AWS::Glue::Trigger resource specifies triggers that run AWS Glue jobs.

CfnTriggerProps

CfnUsageProfile

Creates an AWS Glue usage profile.

CfnUsageProfileProps

CfnUserDefinedFunction

Represents a user-defined function (UDF) definition in the AWS Glue Data Catalog.

CfnUserDefinedFunctionProps

CfnWorkflow

The AWS::Glue::Workflow is an AWS Glue resource type that manages AWS Glue workflows.

CfnWorkflowProps

ClassificationString

Classification string given to tables with this data format.

CloudWatchEncryption

CloudWatch Logs encryption configuration for a SecurityConfiguration.

Code

Represents a Glue Job’s Code assets (an asset can be a scripts, a jar, a python file or any other file).

CodeConfig

Column

ColumnCountMismatchHandlingAction

Identifies if the file contains less or more values for a row than the number of columns specified in the external table definition.

CompressionType

The compression type.

Condition

A condition that determines when a conditional trigger fires.

ConditionLogicalOperator

Represents the logical operator for evaluating a single condition in the Glue Trigger API.

ConditionOptions

ConditionalTriggerOptions

Connection

An AWS Glue connection to a data source.

ConnectionNetwork

VPC network placement for a Glue Connection.

ConnectionOptions

ConnectionPasswordEncryption

ConnectionProps

ConnectionType

The type of the glue connection.

ContinuousLoggingProps

CrawlerActionOptions

CrawlerState

Represents the state of a crawler for a condition in the Glue Trigger API.

DataCatalogEncryptionAtRest

Encryption-at-rest configuration for a Glue Data Catalog.

DataFormat

Defines the input/output formats and ser/de for a single DataFormat.

DataFormatProps

DataQualityRuleset

A Glue Data Quality ruleset.

DataQualityRulesetProps

DataQualityTargetTable

The Glue table a DataQualityRuleset evaluates.

Database

A Glue database.

DatabaseProps

DateIntervalUnit

Date interval unit for partition projection.

DatePartitionProjectionConfigurationProps

DateProjectionStep

Dqdl

The Data Quality Definition Language (DQDL) document for a DataQualityRuleset.

EnumPartitionProjectionConfigurationProps

EventBatchingCondition

EventTriggerOptions

ExecutionClass

The ExecutionClass whether the job is run with a standard or flexible execution class.

ExternalTable

A Glue table that targets an external data location (e.g. A table in a Redshift Cluster).

ExternalTableProps

GlueVersion

AWS Glue version determines the versions of Apache Spark and Python that are available to the job.

ICatalog

A Glue Data Catalog, either the implicit account-wide catalog or one created as an AWS::Glue::Catalog resource.

IConnection

Interface representing a created or an imported Connection.

IDataQualityRuleset

IDatabase

IJob

Interface representing a new or an imported Glue Job.

ISecurityConfiguration

Interface representing a created or an imported SecurityConfiguration.

ITable

IWorkflow

The base interface for Glue Workflow.

InputFormat

Absolute class name of the Hadoop InputFormat to use when reading table files.

IntegerPartitionProjectionConfigurationProps

InvalidCharHandlingAction

Specifies the action to perform when query results contain invalid UTF-8 character values.

Job

A Glue Job.

JobActionOptions

JobAttributes

JobBase

A base class is needed to be able to import existing Jobs into a CDK app to reference as part of a larger stack or construct.

JobBookmarksEncryption

Job bookmarks encryption configuration for a SecurityConfiguration.

JobLanguage

Runtime language of the Glue job.

JobProps

JobState

Job states emitted by Glue to CloudWatch Events.

JobType

The job type.

LibrarySet

The set of pre-installed Python libraries available to a Python shell job running Python 3.9.

MaxCapacity

The number of AWS Glue data processing units (DPUs) that can be allocated when this job runs.

MetricType

The Glue CloudWatch metric type.

NumericOverflowHandlingAction

Specifies the action to perform when ORC data contains an integer (for example, BIGINT or int64) that is larger than the column definition (for example, SMALLINT or int16).

OnDemandTriggerOptions

OrcColumnMappingType

Specifies how to map columns when the table uses ORC data format.

OutputFormat

Absolute class name of the Hadoop OutputFormat to use when writing table files.

PartitionIndex

PartitionProjectionConfiguration

Factory class for creating partition projection configurations.

PartitionProjectionType

Partition projection type.

Predicate

PredicateLogical

PySparkEtlJob

PySpark ETL Jobs class.

PySparkEtlJobProps

PySparkFlexEtlJob

Flex Jobs class.

PySparkFlexEtlJobProps

PySparkStreamingJob

Python Spark Streaming Jobs class.

PySparkStreamingJobProps

PythonShellJob

Python Shell Jobs class.

PythonShellJobProps

PythonVersion

Python version.

S3Code

Glue job Code from an S3 bucket.

S3Encryption

S3 encryption configuration for a SecurityConfiguration.

S3EncryptionMode

Encryption mode for S3.

S3Table

A Glue table that targets a S3 dataset.

S3TableEncryption

Server-side encryption for the S3 bucket that a managed S3Table creates.

S3TableProps

S3TableStorage

Where an S3Table stores its data.

ScalaSparkEtlJob

Spark ETL Jobs class.

ScalaSparkEtlJobProps

ScalaSparkFlexEtlJob

Scala Spark Flex ETL Jobs class.

ScalaSparkFlexEtlJobProps

ScalaSparkStreamingJob

Scala Streaming Jobs class.

ScalaSparkStreamingJobProps

ScheduledTriggerOptions

Schema

SecurityConfiguration

A security configuration is a set of security properties that can be used by AWS Glue to encrypt data at rest.

SecurityConfigurationProps

SerializationLibrary

Serialization library to use when serializing/deserializing (SerDe) table records.

SparkExtraCodeProps

SparkJob

Base class for different types of Spark Jobs.

SparkJobProps

SparkUILoggingLocation

SparkUIProps

StartableTriggerOptions

StorageParameter

A storage parameter. The list of storage parameters available is not exhaustive and other keys may be used.

StorageParameters

The storage parameter keys that are currently known, this list is not exhaustive and other keys may be used.

SurplusBytesHandlingAction

Specifies how to handle data being loaded that exceeds the length of the data type defined for columns containing VARBYTE data.

SurplusCharHandlingAction

Specifies how to handle data being loaded that exceeds the length of the data type defined for columns containing VARCHAR, CHAR, or string data.

TableAttributes

TableBase

A Glue table.

TableBaseProps

TableClientSideEncryption

Client-side encryption for an S3Table’s data.

TriggerOptions

TriggerSchedule

Represents a trigger schedule.

Type

The type of a column in a table schema.

WorkerConfiguration

WorkerType

The type of predefined worker that is allocated when a job runs.

Workflow

This module defines a construct for creating and managing AWS Glue Workflows and Triggers.

WorkflowAttributes

WorkflowBase

Base abstract class for Workflow.

WorkflowProps

WriteParallel

Specifies how to handle data being loaded that exceeds the length of the data type defined for columns containing VARCHAR, CHAR, or string data.