bulk-cdk-toolkit-load-object-storage/io.airbyte.cdk.load.state.object_storage/ObjectStorageDestinationState

ObjectStorageDestinationState

class ObjectStorageDestinationState(stream: DestinationStream, client: ObjectStorageClient<*>, pathFactory: PathFactory, destinationConfig: DestinationConfiguration) : DestinationState

Constructors

Link copied to clipboard
constructor(stream: DestinationStream, client: ObjectStorageClient<*>, pathFactory: PathFactory, destinationConfig: DestinationConfiguration)

Types

Link copied to clipboard
object Companion

Functions

Link copied to clipboard
suspend fun ensureUnique(key: String): String

Ensures the key is unique by appending -${max_suffix + 1} if there is a conflict. If the key is unique, it is returned as-is.

Link copied to clipboard
suspend fun getObjectsToDelete(): List<Pair<Long, RemoteObject<*>>>

Returns (generationId, object) for all objects that should be cleaned up.

Link copied to clipboard
Link copied to clipboard
suspend fun getPartIdCounter(path: String): AtomicLong

Returns a shared atomic long referencing the max {part_number} for any given path.