This is an automated email from the ASF dual-hosted git repository. dazhou pushed a change to branch branch-3.2 in repository https://gitbox.apache.org/repos/asf/hadoop.git.
from 26367b6 Bump nimbus-jose-jwt from 4.41.1 to 7.9 (#1682) new 546db64 HADOOP-16548 : Disable Flush() over config new 8b2c7e0 HADOOP-16578 : Avoid FileSystem API calls when FileSystem already exists new ffeb6d8 HADOOP-16587. Make ABFS AAD endpoints configurable. new b1e748f HADOOP-16612. Track Azure Blob File System client-perceived latency new c225efe HADOOP-16455. ABFS: Implement FileSystem.access() method. new aa9cd0a HADOOP-16660. ABFS: Make RetryCount in ExponentialRetryPolicy Configurable. The 6 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: hadoop-tools/hadoop-azure/pom.xml | 7 +- .../hadoop/fs/azurebfs/AbfsConfiguration.java | 70 +- .../hadoop/fs/azurebfs/AzureBlobFileSystem.java | 26 +- .../fs/azurebfs/AzureBlobFileSystemStore.java | 865 +++++++++++++-------- .../fs/azurebfs/constants/AbfsHttpConstants.java | 1 + .../AuthConfigurations.java} | 29 +- .../fs/azurebfs/constants/ConfigurationKeys.java | 20 + .../constants/FileSystemConfigurations.java | 5 +- .../constants/HttpHeaderConfigurations.java | 1 + .../fs/azurebfs/constants/HttpQueryParams.java | 1 + .../contracts/services/AbfsPerfLoggable.java | 24 +- .../fs/azurebfs/oauth2/AzureADAuthenticator.java | 23 +- .../fs/azurebfs/oauth2/MsiTokenProvider.java | 14 +- .../oauth2/RefreshTokenBasedTokenProvider.java | 12 +- .../hadoop/fs/azurebfs/services/AbfsClient.java | 31 +- .../fs/azurebfs/services/AbfsHttpOperation.java | 46 +- .../fs/azurebfs/services/AbfsInputStream.java | 4 +- .../fs/azurebfs/services/AbfsOutputStream.java | 28 +- .../hadoop/fs/azurebfs/services/AbfsPerfInfo.java | 133 ++++ .../fs/azurebfs/services/AbfsPerfTracker.java | 319 ++++++++ .../fs/azurebfs/services/AbfsRestOperation.java | 11 + .../azurebfs/services/AbfsRestOperationType.java | 3 +- .../azurebfs/services/ExponentialRetryPolicy.java | 11 +- .../hadoop-azure/src/site/markdown/abfs.md | 67 ++ .../azurebfs/ITestAbfsRestOperationException.java | 41 + .../ITestAzureBlobFileSystemCheckAccess.java | 314 ++++++++ .../fs/azurebfs/ITestAzureBlobFileSystemFlush.java | 27 +- .../fs/azurebfs/ITestGetNameSpaceEnabled.java | 6 +- .../TestAbfsConfigurationFieldsValidation.java | 2 +- .../azurebfs/constants/TestConfigurationKeys.java | 8 + .../fs/azurebfs/oauth2/RetryTestTokenProvider.java | 67 ++ .../fs/azurebfs/services/TestAbfsClient.java | 2 +- .../fs/azurebfs/services/TestAbfsPerfTracker.java | 408 ++++++++++ .../hadoop-azure/src/test/resources/azure-test.xml | 5 + 34 files changed, 2222 insertions(+), 409 deletions(-) copy hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/{contracts/exceptions/InvalidAbfsRestOperationException.java => constants/AuthConfigurations.java} (55%) copy hadoop-hdfs-project/hadoop-hdfs-rbf/src/main/java/org/apache/hadoop/hdfs/server/federation/utils/package-info.java => hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/contracts/services/AbfsPerfLoggable.java (75%) create mode 100644 hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/AbfsPerfInfo.java create mode 100644 hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/AbfsPerfTracker.java create mode 100644 hadoop-tools/hadoop-azure/src/test/java/org/apache/hadoop/fs/azurebfs/ITestAzureBlobFileSystemCheckAccess.java create mode 100644 hadoop-tools/hadoop-azure/src/test/java/org/apache/hadoop/fs/azurebfs/oauth2/RetryTestTokenProvider.java create mode 100644 hadoop-tools/hadoop-azure/src/test/java/org/apache/hadoop/fs/azurebfs/services/TestAbfsPerfTracker.java --------------------------------------------------------------------- To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-commits-h...@hadoop.apache.org