Huawei OBS

This document describes the parameters required to access Huawei Cloud OBS, which are applicable to the following scenarios:

• Catalog properties
• Table Valued Function properties
• Broker Load properties
• Export properties
• Outfile properties

Doris supports accessing Huawei Cloud OBS through S3-compatible protocol (using S3 Client) or OBS native protocol (using native SDK).

info

Starting from versions 3.0.5 and 4.1.0, Doris natively integrates the Huawei Cloud OBS SDK. Users can access OBS data (such as Paimon Catalog) directly with the obs:// prefix, enabling better support for Huawei Cloud's Parallel File System (PFS).

Parameter Overview

Property Name	Former Name	Description	Default Value	Required
obs.endpoint	s3.endpoint	OBS endpoint, specifies the access endpoint for Huawei Cloud OBS		Yes
obs.access_key	s3.access_key	OBS access key, used for authentication		Yes
obs.secret_key	s3.secret_key	OBS secret key, used together with access key for authentication		Yes
obs.region	s3.region	OBS region, specifies the region of Huawei Cloud OBS		No
obs.use_path_style	s3.use_path_style	Whether to use path-style access. Recommended to set to true for compatibility with non-AWS S3 services like MinIO/Ceph	FALSE	No
obs.connection.maximum	s3.connection.maximum	Maximum number of connections to OBS service	50	No
obs.connection.request.timeout	s3.connection.request.timeout	Request timeout in milliseconds for connecting to OBS service	3000	No
obs.connection.timeout	s3.connection.timeout	Connection timeout in milliseconds for establishing connection to OBS service	1000	No

Before version 3.1, use legacy name

Example Configuration

"obs.access_key" = "your-access-key",
"obs.secret_key" = "your-secret-key",
"obs.endpoint" = "obs.cn-north-4.myhuaweicloud.com",
"obs.region" = "cn-north-4"

For versions before 3.1:

"s3.access_key" = "your-access-key",
"s3.secret_key" = "your-secret-key",
"s3.endpoint" = "obs.cn-north-4.myhuaweicloud.com",
"s3.region" = "cn-north-4",

Usage Recommendations

• It is recommended to use the obs. prefix for configuration parameters to ensure consistency and clarity with Huawei Cloud OBS.
• For versions before 3.1, please use the former name with s3. prefix.
• Configuring obs.region can improve access accuracy and performance, it is recommended to set it.
• Connection pool parameters can be adjusted according to concurrency requirements to avoid connection blocking.