DlqNoopPipelineStep
class DlqNoopPipelineStep(val numWorkers: Int, taskFactory: LoadPipelineStepTaskFactory, dlqInputQueue: PartitionedQueue<PipelineEvent<StreamKey, DestinationRecordRaw>>) : LoadPipelineStep
Define a NoopStep for the Dead Letter Queue.
This step skips through all records without doing anything. This is to make sure we update the counts of rejected records properly by leveraging the FlattenQueueAdapter and the fact that the LoadPipelineStepTask will update the rejected records count correctly on BatchState.COMPLETE.
Constructors
Link copied to clipboard
constructor(numWorkers: Int, taskFactory: LoadPipelineStepTaskFactory, dlqInputQueue: PartitionedQueue<PipelineEvent<StreamKey, DestinationRecordRaw>>)