S3
This document describes the parameters required for accessing AWS S3. These parameters apply to:
- Catalog properties.
- Table Valued Function properties.
- Broker Load properties.
- Export properties.
- Outfile properties.
Parameter Overviewβ
Property Name | Description | Default Value | Required |
---|---|---|---|
s3.endpoint | S3 endpoint | Yes | |
s3.region | S3 region | No | |
s3.access_key | S3 access key | Yes | |
s3.secret_key | S3 secret key | Yes | |
s3.use_path_style | Whether to use path-style access to S3. Used when accessing certain S3-compatible object storage that doesn't support host-style | false | No |
s3.connection.maximum | S3 maximum connections | 50 | No |
s3.connection.request.timeout | S3 request timeout in milliseconds | 3000 | No |
s3.connection.timeout | S3 connection timeout in milliseconds | 1000 | No |
s3.role_arn | Used in assume role method | No | |
s3.external_id | Used in assume role method | No |
Authentication Configurationβ
When accessing AWS S3, you need to provide AWS Access Key and AWS Secret Key, which are the following parameters:
- s3.access_key
- s3.secret_key
Configuration Exampleβ
"s3.access_key" = "ak"
"s3.secret_key" = "sk"
"s3.endpoint" = "s3.us-east-1.amazonaws.com"
"s3.region" = "us-east"