This is an automated email from the ASF dual-hosted git repository.
morningman pushed a change to branch branch-3.1
in repository https://gitbox.apache.org/repos/asf/doris.git
from eed65309c46 [fix](case) retry if stream load hangs (#54955)
add ddf98053387 branch-3.1: [feat](paimon) support paimon dlf rest catalog
(#54523) (#54887)
No new revisions were added by this update.
Summary of changes:
.../org/apache/doris/paimon/PaimonJniScanner.java | 44 +--
.../java/org/apache/doris/common/util/S3URI.java | 2 +-
.../apache/doris/datasource/CatalogProperty.java | 7 +-
.../credentials/CredentialExtractor.java} | 27 +-
.../credentials/CredentialUtils.java} | 21 +-
.../iceberg/IcebergS3CredentialExtractor.java | 53 +++
.../iceberg/IcebergVendedCredentialsProvider.java | 72 +---
.../paimon/PaimonDLFExternalCatalog.java | 1 +
.../datasource/paimon/PaimonExternalCatalog.java | 2 +
.../paimon/PaimonExternalCatalogFactory.java | 1 +
.../datasource/paimon/PaimonExternalTable.java | 6 +-
.../paimon/PaimonFileExternalCatalog.java | 1 +
.../paimon/PaimonHMSExternalCatalog.java | 1 +
.../paimon/PaimonOssCredentialExtractor.java | 68 ++++
.../paimon/PaimonVendedCredentialsProvider.java | 100 +++++
.../datasource/paimon/source/PaimonScanNode.java | 8 +-
.../metastore/AbstractPaimonProperties.java | 4 +-
.../PaimonAliyunDLFMetaStoreProperties.java | 1 -
.../metastore/PaimonPropertiesFactory.java | 1 +
.../metastore/PaimonRestMetaStoreProperties.java | 111 ++++++
.../storage/AbstractS3CompatibleProperties.java | 68 ++--
.../property/storage/MinioProperties.java | 7 +
.../datasource/property/storage/OBSProperties.java | 7 +
.../datasource/property/storage/OSSProperties.java | 16 +-
.../property/storage/S3PropertyUtils.java | 5 +-
.../java/org/apache/doris/fs/obj/S3ObjStorage.java | 38 +-
.../IcebergVendedCredentialsProviderTest.java | 25 +-
.../PaimonVendedCredentialsProviderTest.java | 407 +++++++++++++++++++++
...ogTest.java => IcebergGlueRestCatalogTest.java} | 78 ++--
.../metastore/PaimonDlfRestCatalogTest.java | 285 +++++++++++++++
.../PaimonRestMetaStorePropertiesTest.java | 400 ++++++++++++++++++++
.../property/storage/MinioPropertiesTest.java | 21 +-
.../property/storage/OBSPropertyTest.java | 58 +--
.../property/storage/OSSPropertiesTest.java | 48 +--
.../property/storage/S3PropertiesTest.java | 44 ++-
...atalog.out => test_paimon_dlf_rest_catalog.out} | Bin 133 -> 179 bytes
.../iceberg/test_glue_rest_s3tables.groovy | 8 +-
....groovy => test_paimon_dlf_rest_catalog.groovy} | 30 +-
...t_domain_connection_and_ak_sk_correction.groovy | 2 +-
39 files changed, 1733 insertions(+), 345 deletions(-)
copy
fe/fe-core/src/main/java/org/apache/doris/{mtmv/MTMVRelatedPartitionDescGeneratorService.java
=> datasource/credentials/CredentialExtractor.java} (52%)
copy
fe/fe-core/src/main/java/org/apache/doris/{mysql/privilege/AccessControllerFactory.java
=> datasource/credentials/CredentialUtils.java} (55%)
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/datasource/iceberg/IcebergS3CredentialExtractor.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/datasource/paimon/PaimonOssCredentialExtractor.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/datasource/paimon/PaimonVendedCredentialsProvider.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/datasource/property/metastore/PaimonRestMetaStoreProperties.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/datasource/paimon/PaimonVendedCredentialsProviderTest.java
rename
fe/fe-core/src/test/java/org/apache/doris/datasource/property/metastore/{RestCatalogTest.java
=> IcebergGlueRestCatalogTest.java} (88%)
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/datasource/property/metastore/PaimonDlfRestCatalogTest.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/datasource/property/metastore/PaimonRestMetaStorePropertiesTest.java
copy
regression-test/data/external_table_p2/paimon/{test_paimon_dlf_catalog.out =>
test_paimon_dlf_rest_catalog.out} (59%)
copy
regression-test/suites/external_table_p2/paimon/{test_paimon_dlf_catalog.groovy
=> test_paimon_dlf_rest_catalog.groovy} (54%)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
