bulk-cdk-toolkit-legacy-task-load-db/io.airbyte.cdk.load.orchestration.db.legacy_typing_deduping/TypingDedupingRawTableOperations

TypingDedupingRawTableOperations

interface TypingDedupingRawTableOperations

Functions

getRawTableGeneration

abstract fun getRawTableGeneration(rawTableName: TableName, suffix: String): Long?

Get the generation of a single record in the raw table. Not necessarily the min or max generation, just any record.

overwriteRawTable

abstract fun overwriteRawTable(rawTableName: TableName, suffix: String)

Swap the "temporary" raw table into the "real" raw table. For example, DROP TABLE IF NOT EXISTS airbyte_internal.foo; ALTER TABLE airbyte_internal.foo_tmp RENAME TO foo.

prepareRawTable

abstract fun prepareRawTable(rawTableName: TableName, suffix: String, replace: Boolean = false)

Prepare the raw table, including any associated blob storage. Similar to createFinalTable, accepts a suffix parameter, which should be used in conjunction with overwriteRawTable.

transferFromTempRawTable

abstract fun transferFromTempRawTable(rawTableName: TableName, suffix: String)

Copy all records from the temporary raw table into the real raw table, then drop the temporary raw table. For example INSERT INTO airbyte_internal.foo SELECT * FROM airbyte_internal.foo_tmp; DROP TABLE airbyte_internal.foo_tmp.