Skip to main content

Huawei OBS

This document describes the parameters required to access Huawei Cloud OBS, which are applicable to the following scenarios:

  • Catalog properties
  • Table Valued Function properties
  • Broker Load properties
  • Export properties
  • Outfile properties

Doris uses S3 Client to access Huawei Cloud OBS through S3-compatible protocol.

Parameter Overview

Property NameFormer NameDescriptionDefault ValueRequired
obs.endpoints3.endpointOBS endpoint, specifies the access endpoint for Huawei Cloud OBSYes
obs.access_keys3.access_keyOBS access key, used for authenticationYes
obs.secret_keys3.secret_keyOBS secret key, used together with access key for authenticationYes
obs.regions3.regionOBS region, specifies the region of Huawei Cloud OBSNo
obs.use_path_styles3.use_path_styleWhether to use path-style access. Recommended to set to true for compatibility with non-AWS S3 services like MinIO/CephFALSENo
obs.connection.maximums3.connection.maximumMaximum number of connections to OBS service50No
obs.connection.request.timeouts3.connection.request.timeoutRequest timeout in milliseconds for connecting to OBS service3000No
obs.connection.timeouts3.connection.timeoutConnection timeout in milliseconds for establishing connection to OBS service1000No

Before version 3.1, use legacy name

Example Configuration

"obs.access_key" = "your-access-key",
"obs.secret_key" = "your-secret-key",
"obs.endpoint" = "obs.cn-north-4.myhuaweicloud.com",
"obs.region" = "cn-north-4"

For versions before 3.1:

"s3.access_key" = "your-access-key",
"s3.secret_key" = "your-secret-key",
"s3.endpoint" = "obs.cn-north-4.myhuaweicloud.com",
"s3.region" = "cn-north-4",

Usage Recommendations

  • It is recommended to use the obs. prefix for configuration parameters to ensure consistency and clarity with Huawei Cloud OBS.
  • For versions before 3.1, please use the former name with s3. prefix.
  • Configuring obs.region can improve access accuracy and performance, it is recommended to set it.
  • Connection pool parameters can be adjusted according to concurrency requirements to avoid connection blocking.