bulk-cdk-toolkit-load-dlq/io.airbyte.cdk.load.write.dlq/DlqPipelineFactoryFactory/dlqPipelineSteps

dlqPipelineSteps

@Singleton
@Requires(bean = ObjectStorageConfig::class, beanProperty = "type", notEquals = "None")
@Named(value = "dlqPipelineSteps")
fun <K : WithStream, T : RemoteObject<*>> dlqPipelineSteps(@Named(value = "dlqRecordFormatterStep") formatterStep: ObjectLoaderPartFormatterStep, @Named(value = "recordPartLoaderStep") loaderStep: ObjectLoaderPartLoaderStep<T>, @Named(value = "recordUploadCompleterStep") completerStep: ObjectLoaderUploadCompleterStep<K, T>): List<LoadPipelineStep>

References the traditional ObjectStorage pipeline steps.

We rely on an ObjectStorageConfig to exist and not be DisabledObjectStorageConfig to decide whether we should return the ObjectLoader pipeline steps as DLQ Steps.

@Singleton
@Requires(bean = ObjectStorageConfig::class, beanProperty = "type", value = "None")
@Named(value = "dlqPipelineSteps")
fun dlqPipelineSteps(): List<LoadPipelineStep>