bulk-cdk-core-load/io.airbyte.cdk.load.pipeline/DirectLoadRecordAccumulator

DirectLoadRecordAccumulator

@Singleton

@Requires(bean = DirectLoaderFactory::class)

class DirectLoadRecordAccumulator<S : DirectLoader, K : WithStream>(val directLoaderFactory: DirectLoaderFactory<S>) : BatchAccumulator<S, K, DestinationRecordRaw, DirectLoadAccResult>

Used internally by the CDK to wrap the client-provided DirectLoader in a generic BatchAccumulator, so that it can be used as a pipeline step. At this stage, the loader's public interface is mapped to the internal interface, hiding internal mechanics.

Constructors

DirectLoadRecordAccumulator

constructor(directLoaderFactory: DirectLoaderFactory<S>)

Properties

directLoaderFactory

val directLoaderFactory: DirectLoaderFactory<S>

Functions

open suspend override fun accept(input: DestinationRecordRaw, state: S): BatchAccumulatorResult<S, DirectLoadAccResult>

finish

open suspend override fun finish(state: S): FinalOutput<S, DirectLoadAccResult>

start

open suspend override fun start(key: K, part: Int): S