IcebergTableCleaner

@Singleton
class IcebergTableCleaner(icebergUtil: IcebergUtil)

Removes all data from an Iceberg org.apache.iceberg.Table. This method is necessary as some catalog implementations do not clear the underlying files written to table storage.

Constructors

Link copied to clipboard
constructor(icebergUtil: IcebergUtil)

Functions

Link copied to clipboard
fun clearTable(catalog: Catalog, identifier: TableIdentifier, io: FileIO, tableLocation: String)

Clears the table identified by the provided TableIdentifier. This removes all data and files associated with the org.apache.iceberg.Table.

Link copied to clipboard
fun deleteOldGenerationData(table: Table, stagingBranchName: String, stream: DestinationStream)