Airbyte Kotlin Bulk CDK

0.1.92

bulk-cdk-toolkit-extract-cdc/io.airbyte.cdk.read.cdc

Package-level declarations

Types

AbortDebeziumWarmStartState

data class AbortDebeziumWarmStartState(val reason: String) : InvalidDebeziumWarmStartState

CdcPartitionReader

class CdcPartitionReader<T : Comparable<T>>(val resourceAcquirer: ResourceAcquirer, val readerOps: CdcPartitionReaderDebeziumOperations<T>, val upperBound: T, val debeziumProperties: Map<String, String>, val startingOffset: DebeziumOffset, val startingSchemaHistory: DebeziumSchemaHistory?, val isInputStateSynthetic: Boolean, val feedBootstrap: GlobalFeedBootstrap) : UnlimitedTimePartitionReader

PartitionReader implementation for CDC with Debezium.

CdcPartitionReaderDebeziumOperations

interface CdcPartitionReaderDebeziumOperations<T : Comparable<T>>

CdcPartitionsCreator

class CdcPartitionsCreator<T : Comparable<T>>(val concurrencyResource: ConcurrencyResource, val resourceAcquirer: ResourceAcquirer, val feedBootstrap: GlobalFeedBootstrap, val creatorOps: CdcPartitionsCreatorDebeziumOperations<T>, val readerOps: CdcPartitionReaderDebeziumOperations<T>, val lowerBoundReference: AtomicReference<T>, val upperBoundReference: AtomicReference<T>, val resetReason: AtomicReference<String?>) : PartitionsCreator

PartitionsCreator implementation for CDC with Debezium.

CdcPartitionsCreatorDebeziumOperations

interface CdcPartitionsCreatorDebeziumOperations<T : Comparable<T>>

CdcPartitionsCreatorFactory

@Singleton

@Order(value = 10)

class CdcPartitionsCreatorFactory<T : Comparable<T>>(val concurrencyResource: ConcurrencyResource, val resourceAcquirer: ResourceAcquirer, val cdcPartitionsCreatorDbzOps: CdcPartitionsCreatorDebeziumOperations<T>, val cdcPartitionReaderDbzOps: CdcPartitionReaderDebeziumOperations<T>) : PartitionsCreatorFactory

PartitionsCreatorFactory implementation for CDC with Debezium.

CdcPartitionsCreatorFactorySupplier

@Singleton

class CdcPartitionsCreatorFactorySupplier<T : CdcPartitionsCreatorFactory<C>, C : Comparable<C>>(val factory: T) : PartitionsCreatorFactorySupplier<T>

data class Converted(val output: Any?) : PartialConverterResult

Returned by successful PartialConverter applications.

ConverterFactory

class ConverterFactory(val customConverterClass: Class<out CustomConverter<*, *>>)

Factory class for generating CustomConverter.Converter instances for debezium given a list of PartialConverters.

class DebeziumEvent(event: ChangeEvent<String?, String?>)

Convenience wrapper around ChangeEvent.

value class DebeziumOffset(val wrapped: Map<JsonNode, JsonNode>)

DebeziumOffset wraps the contents of a Debezium offset file.

DebeziumOperations

interface ~~DebeziumOperations~~<T : Comparable<T>> : CdcPartitionsCreatorDebeziumOperations<T> , CdcPartitionReaderDebeziumOperations<T>

Stateless connector-specific Debezium operations.

DebeziumPropertiesBuilder

class DebeziumPropertiesBuilder(props: Properties = Properties())

Utility class for building Properties for initializing the Debezium engine.

DebeziumRecordKey

value class DebeziumRecordKey(val wrapped: JsonNode)

DebeziumRecordKey wraps a Debezium change data event key.

DebeziumRecordValue

value class DebeziumRecordValue(val wrapped: JsonNode)

DebeziumRecordValue wraps a Debezium change data event value.

DebeziumSchemaHistory

value class DebeziumSchemaHistory(val wrapped: List<HistoryRecord>)

DebeziumSchemaHistory wraps the contents of a Debezium schema history file.

DebeziumStateFilesAccessor

class DebeziumStateFilesAccessor : AutoCloseable

DebeziumStateFilesAccessor reads and writes from Debezium offset and schema history files. This should NOT be done while the Debezium Engine is running! None of this is thread-safe. Instead, this object should be used to:

DebeziumWarmStartState

sealed interface DebeziumWarmStartState

Return type for CdcPartitionsCreatorDebeziumOperations.deserializeState.

DeserializedRecord

data class DeserializedRecord(val data: NativeRecordPayload, val changes: Map<Field, FieldValueChange>)

DeserializedRecords are used to generate Airbyte RECORD messages.

InvalidDebeziumWarmStartState

sealed interface InvalidDebeziumWarmStartState : DebeziumWarmStartState

data object NoConversion : PartialConverterResult

Returned by unsuccessful PartialConverter applications.

NullFallThrough

object NullFallThrough : PartialConverter

Utility PartialConverter for dealing with null values when these are valid. This cuts down on the boilerplate when defining subsequent PartialConverter implementations.

PartialConverter

fun interface PartialConverter

PartialConverter objects are used by RelationalColumnCustomConverter.Handler objects which to define a sequence of conversion functions which work on a best-effort basis to convert a given input value, provided by Debezium, into an output value which obeys the Airbyte Protocol.

PartialConverterResult

sealed interface PartialConverterResult

Output type of a PartialConverter.

RelationalColumnCustomConverter

interface RelationalColumnCustomConverter : CustomConverter<SchemaBuilder, RelationalColumn>

Used by Debezium to transform record values into their expected format.

ResetDebeziumWarmStartState

data class ResetDebeziumWarmStartState(val reason: String) : InvalidDebeziumWarmStartState

ValidDebeziumWarmStartState

data class ValidDebeziumWarmStartState(val offset: DebeziumOffset, val schemaHistory: DebeziumSchemaHistory?) : DebeziumWarmStartState