bulk-cdk-core-load/io.airbyte.cdk.load.config/SyncBeanFactory

SyncBeanFactory

@Factory
class SyncBeanFactory

Factory for instantiating beans necessary for the sync process.

Constructors

Link copied to clipboard
constructor()

Types

Link copied to clipboard
@Singleton
@Named(value = "openStreamQueue")
class OpenStreamQueue : ChannelMessageQueue<DestinationStream>

A queue of streams to open on. This allows the dev to control the number of concurrent calls to open by controlling how many workers (coroutines) are pulling from this queue.

Functions

Link copied to clipboard
@Singleton
@Named(value = "batchStateUpdateQueue")
fun batchStateUpdateQueue(): ChannelMessageQueue<BatchUpdate>

A queue for updating batch states, which is not partitioned.

Link copied to clipboard
@Singleton
fun checkpointManager(catalog: DestinationCatalog, syncManager: SyncManager, outputConsumer: suspend (Reserved<CheckpointMessage>, Long, Long, Long) -> Unit, timeProvider: TimeProvider, @Named(value = "dataChannelMedium") dataChannelMedium: DataChannelMedium, namespaceMapper: NamespaceMapper): CheckpointManager
Link copied to clipboard
@Singleton
@Named(value = "defaultDestinationTaskLauncherHasThrown")
fun defaultDestinationTaskLauncherHasThrown(): AtomicBoolean
Link copied to clipboard
@Singleton
@Secondary
@Named(value = "globalMemoryManager")
fun globalMemoryManager(): ReservationManager
Link copied to clipboard
@Singleton
@Named(value = "isFileTransfer")
fun isFileTransfer(catalog: DestinationCatalog): Boolean

True if the catalog has at least one stream that includeFiles.

Link copied to clipboard
@Singleton
@Named(value = "queueMemoryManager")
fun queueMemoryMananger(config: DestinationConfiguration, @Named(value = "globalMemoryManager") globalMemoryManager: ReservationManager): ReservationManager