bulk-cdk-core-extract/io.airbyte.cdk.read/StateManager

StateManager

class StateManager(global: Global? = null, initialGlobalState: OpaqueStateValue? = null, initialStreamStates: Map<Stream, OpaqueStateValue?> = mapOf())

Singleton object which tracks the state of an ongoing READ operation.

Constructors

Link copied to clipboard
constructor(global: Global? = null, initialGlobalState: OpaqueStateValue? = null, initialStreamStates: Map<Stream, OpaqueStateValue?> = mapOf())

Types

Link copied to clipboard
data class StateForCheckpointWithPartitionId(val pendingState: OpaqueStateValue, val partitionId: String?, val pendingNumRecords: Long, var id: Int?)
Link copied to clipboard

Properties

Link copied to clipboard
val feeds: List<Feed>

feeds is all the Feeds in the configured catalog passed via the CLI.

Functions

Link copied to clipboard
fun checkpoint(): List<AirbyteStateMessage>

Returns the Airbyte STATE messages which checkpoint the progress of the READ in the platform. Updates the internal state of the StateManager to ensure idempotency (no redundant messages are emitted).

Link copied to clipboard
fun current(feed: Feed): OpaqueStateValue?

Returns the current state value for the given feed.

Link copied to clipboard
fun scoped(feed: Feed): StateManager.StateManagerScopedToFeed

Returns a StateManagerScopedToFeed instance scoped to this feed.