bulk-cdk-core-load/io.airbyte.cdk.load.dataflow.state.stats

Package-level declarations

Types

data class CommitStatsResult(val committedStats: EmissionStats = EmissionStats(), val cumulativeStats: EmissionStats = EmissionStats())

CommittedStatsStore

@Singleton

class CommittedStatsStore

Stores stat histograms per stream. For hydrating state messages with stats.

EmissionStats

data class EmissionStats(var count: Long = 0, var bytes: Long = 0)

Simple record level stat data. Used for committed and emitted stats.

EmittedStatsStore

interface EmittedStatsStore

tallies "emitted" record and byte counts from records on read

PartitionStats

data class PartitionStats(val counts: PartitionHistogram = PartitionHistogram(), val bytes: PartitionHistogram = PartitionHistogram())

StateAdditionalStatsStore

@Singleton

class StateAdditionalStatsStore

A singleton class responsible for managing additional state statistics, specifically histograms of metrics associated with partitions and destination streams. This class provides methods to add metrics values, retrieve combined statistics, and maintain metrics completeness with default values.

StateStatsEnricher

@Singleton

class StateStatsEnricher(statsStore: CommittedStatsStore, namespaceMapper: NamespaceMapper, stateAdditionalStatsStore: StateAdditionalStatsStore)

Decorates states with destination stats — both top level and per stream.