Package-level declarations
Types
Link copied to clipboard
class DlqLoaderAccumulator<S>(loader: DlqLoader<S>) : BatchAccumulator<S, StreamKey, DestinationRecordRaw, DlqStepOutput>
Wraps a DlqLoader into a BatchAccumulator so that it fits into a LoadPipeline.
Link copied to clipboard
class DlqLoaderPipelineStep<S : AutoCloseable>(val numWorkers: Int, taskFactory: LoadPipelineStepTaskFactory, dlqLoader: DlqLoader<S>, outputQueue: PartitionedQueue<PipelineEvent<StreamKey, DestinationRecordRaw>>) : LoadPipelineStep
DeadLetterQueue Loader Pipeline Step.
Link copied to clipboard
class DlqNoopAccumulator : BatchAccumulator<DlqNoopState, StreamKey, DestinationRecordRaw, WithBatchState>
See documentation of DlqNoopPipelineStep.
Link copied to clipboard
class DlqNoopPipelineStep(val numWorkers: Int, taskFactory: LoadPipelineStepTaskFactory, dlqInputQueue: PartitionedQueue<PipelineEvent<StreamKey, DestinationRecordRaw>>) : LoadPipelineStep
Define a NoopStep for the Dead Letter Queue.
Link copied to clipboard
See documentation of DlqNoopPipelineStep.
Link copied to clipboard
class DlqStepOutput(val state: BatchState, val rejectedRecords: List<DestinationRecordRaw>? = null) : WithBatchState
Part of the BatchAccumulator interface.
Link copied to clipboard
class FlattenQueueAdapter<K : WithStream>(queue: PartitionedQueue<PipelineEvent<K, DestinationRecordRaw>>) : PartitionedQueue<PipelineEvent<K, DlqStepOutput>>
Queue Adapter in order to be able to reuse existing ObjectStorage steps for the DeadLetterQueue.
Link copied to clipboard
class PassThroughPartitioner : OutputPartitioner<StreamKey, DestinationRecordRaw, StreamKey, DlqStepOutput>
A partitioner that echoes the same partition as provided on the input.