bulk-cdk-core-load/io.airbyte.cdk.load.command

Package-level declarations

Types

Append

data object Append : ImportType

Dedupe

data class Dedupe(val primaryKey: List<List<String>>, val cursor: List<String>) : ImportType

DefaultDestinationCatalogFactory

@Factory

class DefaultDestinationCatalogFactory

DestinationCatalog

data class DestinationCatalog(val streams: List<DestinationStream> = emptyList())

Internal representation of destination streams. This is intended to be a case class specialized for usability.

DestinationConfiguration

abstract class DestinationConfiguration : Configuration

DestinationConfigurationFactory

interface DestinationConfigurationFactory<I : ConfigurationSpecification, O : DestinationConfiguration>

DestinationStream

data class DestinationStream(val unmappedNamespace: String?, val unmappedName: String, val generationId: Long, val minimumGenerationId: Long, val syncId: Long, namespaceMapper: NamespaceMapper, val tableSchema: StreamTableSchema)

Internal representation of destination streams. This is intended to be a case class specialized for usability.

DestinationStreamFactory

@Singleton

class DestinationStreamFactory(jsonSchemaToAirbyteType: JsonSchemaToAirbyteType, namespaceMapper: NamespaceMapper, schemaFactory: TableSchemaFactory)

EnvVarConstants

object EnvVarConstants

ImportType

sealed interface ImportType

NamespaceMapper

class NamespaceMapper(namespaceDefinitionType: NamespaceDefinitionType = NamespaceDefinitionType.SOURCE, namespaceFormat: String? = null, streamPrefix: String? = null)

Overwrite

data object Overwrite : ImportType

A legacy destination sync mode. Modern destinations depend on platform to set overwrite/record-retaining behavior via the generationId / minimumGenerationId parameters, and should treat this as equivalent to Append.

Property

data class Property(val micronautProperty: String, val environmentVariable: String)

Represents a micronaut property, which has a corresponding entry in micronaut's application.yml file, which is populated by an environment variable. Just a pair of the micronaut property name, and that corresponding env var name.

SoftDelete

data object SoftDelete : ImportType

Update

data object Update : ImportType

Functions

computeUnknownColumnChanges

fun Map<String, FieldType>.computeUnknownColumnChanges(): List<Meta.Change>

This function exists so that our tests can easily mock a DestinationStream, while still getting a real value for unknownColumnChanges.