bulk-cdk-toolkit-load-object-storage/io.airbyte.cdk.load.factory.object_storage/ObjectLoaderQueueBeanFactory/recordObjectLoaderPartQueue

recordObjectLoaderPartQueue

@Singleton

@Named(value = "objectLoaderPartQueue")

@Requires(bean = ObjectLoader::class)

fun recordObjectLoaderPartQueue(@Named(value = "globalMemoryManager") globalMemoryManager: ReservationManager): ResourceReservingPartitionedQueue<PipelineEvent<ObjectKey, ObjectLoaderPartFormatter.FormattedPart>>

Queue between step 1 (format parts) and step 2 (load them): it will hold the actual part bytes and needs to be sized based on the available reserved memory.