bulk-cdk-core-extract/io.airbyte.cdk.output

Package-level declarations

Types

sealed interface CatalogValidationFailure

Union type for all validation failures.

@DefaultImplementation(value = LoggingCatalogValidationFailureHandler::class)

interface CatalogValidationFailureHandler : Consumer<CatalogValidationFailure>

At the start of the READ operation, the connector configuration, the configured catalog and the input states are validated against each other. For instance, a catalog may have grown stale after a schema change in the source database. All validation failures are passed to this interface. The production implementation will log a message while the test implementation collects them in a buffer for later inspection.

DataChannelFormat

enum DataChannelFormat : Enum<DataChannelFormat>

DataChannelFormat defines the wire format for Records and state messages sent over the wire.

DataChannelMedium

enum DataChannelMedium : Enum<DataChannelMedium>

DataChannelMedium defines the medium over which Records and state messages are sent. It can be either STDIO (standard input/output) or SOCKET (unix domain sockets).

FieldNotFound

data class FieldNotFound(val streamID: StreamIdentifier, val fieldName: String) : CatalogValidationFailure

FieldTypeMismatch

data class FieldTypeMismatch(val streamID: StreamIdentifier, val fieldName: String, val expected: AirbyteSchemaType, val actual: AirbyteSchemaType) : CatalogValidationFailure

InvalidCursor

data class InvalidCursor(val streamID: StreamIdentifier, val cursor: String) : CatalogValidationFailure

InvalidIncrementalSyncMode

data class InvalidIncrementalSyncMode(val streamID: StreamIdentifier) : CatalogValidationFailure

InvalidPrimaryKey

data class InvalidPrimaryKey(val streamID: StreamIdentifier, val primaryKey: List<String>) : CatalogValidationFailure

MultipleStreamsFound

data class MultipleStreamsFound(val streamID: StreamIdentifier) : CatalogValidationFailure

OutputMessageRouter

class OutputMessageRouter(recordsDataChannelMedium: DataChannelMedium, recordsDataChannelFormat: DataChannelFormat, standardOutputConsumer: StandardOutputConsumer, additionalProperties: Map<String, String>, feedBootstrap: FeedBootstrap<*>, acquiredResources: Map<ResourceType, Resource.Acquired>) : AutoCloseable

OutputMessageRouter is responsible for building the appropriate routes for messages output. Record message stream state and status traces may go over std output, or over sockets in JSONL or Protobuf format. All other message like log or error messages go over std output.

ResetStream

data class ResetStream(val streamID: StreamIdentifier) : CatalogValidationFailure

StreamHasNoFields

data class StreamHasNoFields(val streamID: StreamIdentifier) : CatalogValidationFailure

StreamNotFound

data class StreamNotFound(val streamID: StreamIdentifier) : CatalogValidationFailure