bulk-cdk-core-load/io.airbyte.cdk.load.dataflow.transform/RecordDTO

RecordDTO

data class RecordDTO(val fields: Map<String, AirbyteValue>, val partitionKey: PartitionKey, val sizeBytes: Long, val emittedAtMs: Long)

Data transfer object containing a transformed record ready for aggregation and loading.

This DTO represents a record after it has been processed through the transformation pipeline, with all field mappings and value coercion already applied. It contains the minimal metadata needed for the aggregation and loading phases.

Constructors

RecordDTO

constructor(fields: Map<String, AirbyteValue>, partitionKey: PartitionKey, sizeBytes: Long, emittedAtMs: Long)

Properties

emittedAtMs

val emittedAtMs: Long

Timestamp when this record was emitted from the source, in milliseconds since epoch. Used by the CDK for tracking data freshness and latency metrics.

fields

val fields: Map<String, AirbyteValue>

Map of destination column names to their transformed values. All field name transformations and value coercion have been applied at this point. Most relevant field for destination implementations.

partitionKey

val partitionKey: PartitionKey

Internal CDK field for routing records to aggregates. This is managed by the CDK and should not be used by destination implementations.

sizeBytes

val sizeBytes: Long

Estimated size of this record in bytes, used by the CDK for memory management and triggering aggregate flushes based on size thresholds.