bulk-cdk-toolkit-load-dlq/io.airbyte.cdk.load.write.dlq/DlqPipelineFactoryFactory/partFormatterStep

partFormatterStep

@Named(value = "dlqRecordFormatterStep")
@Singleton
fun <T : OutputStream> partFormatterStep(@Named(value = "numInputPartitions") numInputPartitions: Int, partFormatter: ObjectLoaderPartFormatter<T>, @Named(value = "dlqInputQueue") inputQueue: PartitionedQueue<PipelineEvent<StreamKey, DestinationRecordRaw>>, @Named(value = "objectLoaderPartQueue") outputQueue: PartitionedQueue<PipelineEvent<ObjectKey, ObjectLoaderPartFormatter.FormattedPart>>, taskFactory: LoadPipelineStepTaskFactory, flushStrategy: PipelineFlushStrategy): ObjectLoaderPartFormatterStep

This is the start of the "traditional" object storage pipeline. However, in order for the updated pipeline to work, this recreates the ObjectLoaderPartFormatterStep but with the dlqInputQueue as in input instead of the actual input of the destination which is used by the DlqLoader in this case.