bulk-cdk-toolkit-load-object-storage/io.airbyte.cdk.load.state.object_storage/ObjectStorageFallbackPersister

ObjectStorageFallbackPersister

@Singleton
class ObjectStorageFallbackPersister(client: ObjectStorageClient<*>, pathFactory: PathFactory, destinationConfig: DestinationConfiguration) : DestinationStatePersister<ObjectStorageDestinationState>

Note: there's no persisting yet. This will require either a client-provided path to store data or a guaranteed sortable set of file names so that we can send the high watermark to the platform.

Constructors

Link copied to clipboard
constructor(client: ObjectStorageClient<*>, pathFactory: PathFactory, destinationConfig: DestinationConfiguration)

Functions

Link copied to clipboard
open suspend override fun load(stream: DestinationStream): ObjectStorageDestinationState
Link copied to clipboard
open suspend override fun persist(stream: DestinationStream, state: ObjectStorageDestinationState)