bulk-cdk-toolkit-load-s3/io.airbyte.cdk.load.file.s3

Package-level declarations

Types

interface S3Client : ObjectStorageClient<S3Object>

@Factory

class S3ClientFactory(arnRole: AWSArnRoleConfigurationProvider, keyConfig: AWSAccessKeyConfigurationProvider, bucketConfig: S3BucketConfigurationProvider, assumeRoleCredentials: AwsAssumeRoleCredentials?)

assumeRoleCredentials is required if keyConfig does not have an access key, and arnRole includes a nonnull role ARN. Otherwise, it is ignored.

S3KotlinClient

class S3KotlinClient(client: S3Client, val bucketConfig: S3BucketConfiguration) : S3Client

The primary and recommended S3 client implementation -- kotlin-friendly with suspend functions. However, there's a bug that can cause hard failures under high-concurrency. (Partial workaround in place https://github.com/awslabs/aws-sdk-kotlin/issues/1214#issuecomment-2464831817).

S3Object

data class S3Object(val key: String, val storageConfig: S3BucketConfiguration) : RemoteObject<S3BucketConfiguration>

S3StreamingUpload

class S3StreamingUpload(client: S3Client, bucketConfig: S3BucketConfiguration, response: CreateMultipartUploadResponse) : StreamingUpload<S3Object>