bulk-cdk-toolkit-load-iceberg-parquet/io.airbyte.cdk.load.data.iceberg.parquet

Package-level declarations

Types

AirbyteTypeToIcebergSchema

class AirbyteTypeToIcebergSchema

AirbyteValueToIcebergRecord

class AirbyteValueToIcebergRecord

IcebergNullOutOfRangeIntegers

class IcebergNullOutOfRangeIntegers(minValue: BigInteger = Long.MIN_VALUE.toBigInteger(), maxValue: BigInteger = Long.MAX_VALUE.toBigInteger()) : AirbyteValueIdentityMapper

Iceberg wants to write objects/unions as JSON strings, but arrays as strongly-typed. Therefore, we need to handle top-level ints, and arrays of ints, but should ignore ints inside objects, and ints inside unions.

IcebergStringifyComplexTypes

class IcebergStringifyComplexTypes : AirbyteValueIdentityMapper

Functions

toIcebergRecord

fun Map<String, EnrichedAirbyteValue>.toIcebergRecord(icebergSchema: Schema): GenericRecord

toIcebergSchema

fun ObjectType.toIcebergSchema(primaryKeys: List<List<String>>): Schema