Skip to main content

S3

This document describes the parameters required for accessing AWS S3. These parameters apply to:

  • Catalog properties.
  • Table Valued Function properties.
  • Broker Load properties.
  • Export properties.
  • Outfile properties.

Parameter Overview​

Property NameDescriptionDefault ValueRequired
s3.endpointS3 endpointYes
s3.regionS3 regionNo
s3.access_keyS3 access keyYes
s3.secret_keyS3 secret keyYes
s3.use_path_styleWhether to use path-style access to S3. Used when accessing certain S3-compatible object storage that doesn't support host-stylefalseNo
s3.connection.maximumS3 maximum connections50No
s3.connection.request.timeoutS3 request timeout in milliseconds3000No
s3.connection.timeoutS3 connection timeout in milliseconds1000No
s3.role_arnUsed in assume role methodNo
s3.external_idUsed in assume role methodNo

Authentication Configuration​

When accessing AWS S3, you need to provide AWS Access Key and AWS Secret Key, which are the following parameters:

  • s3.access_key
  • s3.secret_key

When accessing AWS S3, Doris also supports the Assumed Role method. Please refer to the following document for configuration: AWS intergration.

Configuration Example​

"s3.access_key" = "ak"
"s3.secret_key" = "sk"
"s3.endpoint" = "s3.us-east-1.amazonaws.com"
"s3.region" = "us-east"