CalvinKirs opened a new pull request, #58740:
URL: https://github.com/apache/doris/pull/58740
### Changes
This update enables Catalogs to automatically load credentials for S3 or
S3-compatible storage using AwsCredentialsProviderChain. Users no longer need
to explicitly specify AK/SK in Catalog properties. The feature provides
stronger support for cloud-native environments such as IRSA, containers, and
EC2 Instance Profiles. ↳
All credential resolution is unified through
DefaultDorisAwsCredentialsProviderChain, ensuring consistent and secure
handling across the project.
Key Behavior
#### No need to configure AK/SK manually:
Credentials can be automatically derived from IRSA, WebIdentity, container
metadata, EC2 instance profile, environment variables, system properties, or
AWS profile files. ↳
#### Unified credential resolution:
All modules use DefaultDorisAwsCredentialsProviderChain to avoid
inconsistent custom implementations. ↳
eg
```
CREATE CATALOG `iceberg_fs_catalog` PROPERTIES (
"type" = "iceberg",
"iceberg.catalog.type" = "hadoop",
"warehouse" = "s3://<bucket>/iceberg/fs/s3/warehouse/",
"s3.region"="us-east-1",
"s3.endpoint" = "s3.us-east-1.amazonaws.com",
"s3.auth_type" = "INSTANCE_PROFILE"
);
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
