bulk-cdk-core-load/io.airbyte.cdk.load.command

Package-level declarations

Types

Append

data object Append : ImportType

Dedupe

data class Dedupe(val primaryKey: List<List<String>>, val cursor: List<String>) : ImportType

DefaultDestinationCatalogFactory

@Factory

class DefaultDestinationCatalogFactory

DestinationCatalog

data class DestinationCatalog(val streams: List<DestinationStream> = emptyList())

Internal representation of destination streams. This is intended to be a case class specialized for usability.

DestinationConfiguration

abstract class DestinationConfiguration : Configuration

To implement a DestinationConfiguration:

DestinationConfigurationFactory

interface DestinationConfigurationFactory<I : ConfigurationSpecification, O : DestinationConfiguration>

DestinationDiscoverCatalog

data class DestinationDiscoverCatalog(val operations: List<DestinationOperation>)

Internal representation of a DestinationCatalog as returned by a destination on a discover command.

DestinationOperation

data class DestinationOperation(val objectName: String, val syncMode: ImportType, val schema: AirbyteType, val matchingKeys: List<List<String>>)

Internal Representation of the DestinationOperation from the protocol that is used in the context of a Destination Discover command.

DestinationStream

data class DestinationStream(val unmappedNamespace: String?, val unmappedName: String, val importType: ImportType, val schema: AirbyteType, val generationId: Long, val minimumGenerationId: Long, val syncId: Long, val isFileBased: Boolean = false, val includeFiles: Boolean = false, val destinationObjectName: String? = null, val matchingKey: List<String>? = null, namespaceMapper: NamespaceMapper, val tableSchema: StreamTableSchema)

Internal representation of destination streams. This is intended to be a case class specialized for usability.

DestinationStreamFactory

@Singleton

class DestinationStreamFactory(jsonSchemaToAirbyteType: JsonSchemaToAirbyteType, namespaceMapper: NamespaceMapper, schemaFactory: TableSchemaFactory)

EnvVarConstants

object EnvVarConstants

ImportType

sealed interface ImportType

NamespaceMapper

class NamespaceMapper(namespaceDefinitionType: NamespaceDefinitionType = NamespaceDefinitionType.SOURCE, namespaceFormat: String? = null, streamPrefix: String? = null)

Overwrite

data object Overwrite : ImportType

A legacy destination sync mode. Modern destinations depend on platform to set overwrite/record-retaining behavior via the generationId / minimumGenerationId parameters, and should treat this as equivalent to Append.

Property

data class Property(val micronautProperty: String, val environmentVariable: String)

Represents a micronaut property, which has a corresponding entry in micronaut's application.yml file, which is populated by an environment variable. Just a pair of the micronaut property name, and that corresponding env var name.

SoftDelete

data object SoftDelete : ImportType

Update

data object Update : ImportType

Functions

computeUnknownColumnChanges

fun AirbyteType.computeUnknownColumnChanges(): List<Meta.Change>

This function exists so that our tests can easily mock a DestinationStream, while still getting a real value for unknownColumnChanges.