bulk-cdk-core-load/io.airbyte.cdk.load.table

Package-level declarations

Types

abstract class BaseDirectLoadInitialStatusGatherer(tableOperationsClient: TableOperationsClient, catalog: DestinationCatalog) : DatabaseInitialStatusGatherer<DirectLoadInitialStatus>

ColumnNameGenerator

fun interface ColumnNameGenerator

ColumnNameMapping

@JvmInline

value class ColumnNameMapping(columnNameMapping: Map<String, String>) : Map<String, String>

map from the column name as declared in the schema, to the column name that we'll create in the final (typed) table.

DatabaseInitialStatus

interface DatabaseInitialStatus

DatabaseInitialStatusGatherer

fun interface DatabaseInitialStatusGatherer<InitialStatus : DatabaseInitialStatus>

Some destinations can efficiently fetch multiple tables' information in a single query, so this interface accepts multiple streams in a single method call.

DefaultTempTableNameGenerator

@Singleton

open class DefaultTempTableNameGenerator(internalNamespace: String? = null, affixLength: Int = 8, affixSeparator: String = "", hashLength: Int = 32) : TempTableNameGenerator

better handling for temp table names - e.g. postgres has a 64-char table name limit, so we want to avoid running into that. This method generates a table name with (by default) at most 64 characters (4 * affixLength + 2 * affixSeparator.length + hashLength).

FinalTableNameGenerator

fun interface FinalTableNameGenerator : TableNameGenerator

RawTableNameGenerator

fun interface RawTableNameGenerator : TableNameGenerator

TableNameGenerator

sealed interface TableNameGenerator

TableSuffixes

object TableSuffixes

TempTableNameGenerator

fun interface TempTableNameGenerator

TypingDedupingUtil

object TypingDedupingUtil

Properties

CDC_CURSOR_COLUMN

const val CDC_CURSOR_COLUMN: String

CDC_DELETED_AT_COLUMN

const val CDC_DELETED_AT_COLUMN: String

CDC meta column names.