bulk-cdk-toolkit-legacy-task-load-db/io.airbyte.cdk.load.orchestration.db.legacy_typing_deduping/NoopTypingDedupingSqlGenerator

NoopTypingDedupingSqlGenerator

object NoopTypingDedupingSqlGenerator : TypingDedupingSqlGenerator

We are switching all destinations away from T+D, to use direct-load tables instead. However, some destinations will continue to provide a "legacy raw tables" mode, which writes the raw table format of T+D, but with the actual T+D disabled.

This sqlgenerator supports that, by simply doing nothing.

Properties

supportsExpensiveSaferCasting

open val supportsExpensiveSaferCasting: Boolean

Whether updateFinalTable actually generates different SQL when useExpensiveSaferCasting is enabled. Some destinations don't have this distinction, and should override this field to false.

Functions

clearLoadedAt

open override fun clearLoadedAt(stream: DestinationStream, rawTableName: TableName): Sql

createFinalTable

open override fun createFinalTable(stream: DestinationStream, tableName: TableName, columnNameMapping: ColumnNameMapping, finalTableSuffix: String, replace: Boolean): Sql

Generate a SQL statement to create a fresh table to match the given stream.

overwriteFinalTable

open override fun overwriteFinalTable(stream: DestinationStream, finalTableName: TableName, finalTableSuffix: String): Sql

Drop the previous final table, and rename the new final table to match the old final table.

prepareTablesForSoftReset

open fun prepareTablesForSoftReset(stream: DestinationStream, tableNames: TableNames, columnNameMapping: ColumnNameMapping): Sql

Typically we need to create a soft reset temporary table and clear loaded at values

updateFinalTable

open override fun updateFinalTable(stream: DestinationStream, tableNames: TableNames, columnNameMapping: ColumnNameMapping, finalTableSuffix: String, maxProcessedTimestamp: Instant?, useExpensiveSaferCasting: Boolean): Sql

Generate a SQL statement to copy new data from the raw table into the final table.