bulk-cdk-core-load/io.airbyte.cdk.load.dataflow.config.model

Package-level declarations

Types

data class AggregatePublishingConfig(val maxRecordsPerAgg: Long, val maxEstBytesPerAgg: Long, val stalenessDeadlinePerAgg: Duration = 5.minutes, val maxEstBytesAllAggregates: Long, val maxBufferedAggregates: Int = 5)

Configures the publishing of aggregates downstream for uploading to the destination.

ConnectorInputStreams

class ConnectorInputStreams(values: List<InputStream>) : List<InputStream>

Micronaut work around - wraps the input streams to avoid injecting a List directly, and being subject to Micronaut merging like beans into a single list leading to injecting unexpected extra input streams.

DataFlowSocketConfig

interface DataFlowSocketConfig

Configuration interface for dataflow socket settings.

LifecycleParallelismConfig

data class LifecycleParallelismConfig(val streamInitParallelism: Int = 10, val streamFinalizeParallelism: Int = 10, val finalFlushParallelism: Int = 10)

MediumConverterConfig

data class MediumConverterConfig(val extractedAtAsTimestampWithTimezone: Boolean = true)

Config object for medium converter options. Used by both JSON and Protobuf converters.