bulk-cdk-toolkit-load-object-storage/io.airbyte.cdk.load.factory.object_storage/ObjectLoaderQueueBeanFactory/fileObjectLoaderPartQueue

fileObjectLoaderPartQueue

@Singleton

@Named(value = "filePartQueue")

@Requires(condition = IsFileTransferCondition::class)

fun fileObjectLoaderPartQueue(@Named(value = "globalMemoryManager") globalMemoryManager: ReservationManager): ResourceReservingPartitionedQueue<PipelineEvent<ObjectKey, ObjectLoaderPartFormatter.FormattedPart>>

Queue between file part chunking and loading of file parts. It will hold the actual part bytes and needs to be sized based on the available reserved memory.