bulk-cdk-core-load/io.airbyte.cdk.load.data

Package-level declarations

Types

AirbyteType

sealed class AirbyteType

AirbyteTypeToAirbyteTypeWithMeta

class AirbyteTypeToAirbyteTypeWithMeta(flatten: Boolean)

AirbyteValue

sealed interface AirbyteValue

AirbyteValueCoercer

object AirbyteValueCoercer

Utility class to coerce AirbyteValue to specific types. Does not support recursive coercion.

AirbyteValueJsonlProxy

class AirbyteValueJsonlProxy(data: ObjectNode) : AirbyteValueProxy

AirbyteValueProtobufProxy

class ~~AirbyteValueProtobufProxy~~(data: List<AirbyteRecordMessage.AirbyteValueProtobuf>) : AirbyteValueProxy

Protobuf is sent as an ordered list of AirbyteValues. Coherent access depends on the source and destination agreeing on the schema. Currently, this is alphabetical order by field name, as constraints on the socket implementation guarantee that source and destination will always see the same schema. Eventually this order needs to be set by the source with a header message.

AirbyteValueProxy

interface AirbyteValueProxy

Provides a universal view over raw data, agnostic of the serialization format. Fields are accessed with accessors that contain name, index, and type. The type indicates with method should be used.

AirbyteValueToProtobuf

class AirbyteValueToProtobuf

Convenience class for testing.

ArrayType

data class ArrayType(val items: FieldType) : AirbyteType

ArrayTypeWithoutSchema

data object ArrayTypeWithoutSchema : AirbyteType

ArrayValue

@JvmInline

value class ArrayValue(val values: List<AirbyteValue>) : AirbyteValue

BooleanType

data object BooleanType : AirbyteType

BooleanValue

@JvmInline

value class BooleanValue(val value: Boolean) : AirbyteValue, Comparable<BooleanValue>

DateType

data object DateType : AirbyteType

DateValue

@JvmInline

value class DateValue(val value: LocalDate) : AirbyteValue, Comparable<DateValue>

EnrichedAirbyteValue

class EnrichedAirbyteValue(var abValue: AirbyteValue, val type: AirbyteType, val name: String, val changes: MutableList<Meta.Change> = mutableListOf(), val airbyteMetaField: Meta.AirbyteMetaFields?)

Represents an "enriched" (/augmented) Airbyte value with additional metadata.

FieldType

data class FieldType(val type: AirbyteType, val nullable: Boolean)

IntegerType

data object IntegerType : AirbyteType

IntegerValue

@JvmInline

value class IntegerValue(val value: BigInteger) : AirbyteValue, Comparable<IntegerValue>

NullValue

data object NullValue : AirbyteValue, Comparable<NullValue>

NumberType

data object NumberType : AirbyteType

NumberValue

@JvmInline

value class NumberValue(val value: BigDecimal) : AirbyteValue, Comparable<NumberValue>

ObjectType

data class ObjectType(val properties: LinkedHashMap<String, FieldType>, val additionalProperties: Boolean = true, val required: List<String> = emptyList<String>()) : AirbyteType

ObjectTypeWithEmptySchema

data object ObjectTypeWithEmptySchema : AirbyteType

ObjectTypeWithoutSchema

data object ObjectTypeWithoutSchema : AirbyteType

ObjectValue

@JvmInline

value class ObjectValue(val values: LinkedHashMap<String, AirbyteValue>) : AirbyteValue

ProtobufTypeMismatchException

class ProtobufTypeMismatchException(val streamName: String, val columnName: String, val expectedType: AirbyteType, val actualValueCase: AirbyteRecordMessage.AirbyteValueProtobuf.ValueCase) : RuntimeException

Exception thrown when a protobuf value type doesn't match the expected AirbyteType. This indicates that the source connector is using the wrong protobuf setter method for the declared schema type.

StringType

data object StringType : AirbyteType

StringValue

@JvmInline

value class StringValue(val value: String) : AirbyteValue, Comparable<StringValue>

TimestampTypeWithoutTimezone

data object TimestampTypeWithoutTimezone : AirbyteType

TimestampTypeWithTimezone

data object TimestampTypeWithTimezone : AirbyteType

TimestampWithoutTimezoneValue

@JvmInline

value class TimestampWithoutTimezoneValue(val value: LocalDateTime) : AirbyteValue, Comparable<TimestampWithoutTimezoneValue>