This is an automated email from the ASF dual-hosted git repository.
stevel pushed a change to branch trunk
in repository https://gitbox.apache.org/repos/asf/hadoop.git.
from 43f0a34 YARN-10935. AM Total Queue Limit goes below per-user AM Limit
if parent is full. Contributed by Eric Payne.
add 52c024c HADOOP-17195. OutOfMemory error while performing hdfs
CopyFromLocal to ABFS (#3406)
No new revisions were added by this update.
Summary of changes:
.../apache/hadoop/fs/CommonConfigurationKeys.java | 5 +
.../hadoop/fs/statistics/StreamStatisticNames.java | 12 +
.../store/BlockUploadStatistics.java} | 16 +-
.../org/apache/hadoop/fs/store/DataBlocks.java | 411 ++++++++++++------
.../src/main/resources/core-default.xml | 7 +
.../org/apache/hadoop/fs/store/TestDataBlocks.java | 138 ++++++
.../hadoop/fs/azurebfs/AzureBlobFileSystem.java | 42 +-
.../fs/azurebfs/AzureBlobFileSystemStore.java | 165 ++++++--
.../fs/azurebfs/constants/ConfigurationKeys.java | 31 ++
.../constants/FileSystemConfigurations.java | 18 +
.../fs/azurebfs/services/AbfsOutputStream.java | 469 ++++++++++++---------
.../azurebfs/services/AbfsOutputStreamContext.java | 107 +++++
.../services/AbfsOutputStreamStatistics.java | 4 +-
.../services/AbfsOutputStreamStatisticsImpl.java | 25 +-
.../fs/azure/integration/AzureTestConstants.java | 13 +
.../fs/azurebfs/AbstractAbfsIntegrationTest.java | 2 +-
.../hadoop/fs/azurebfs/AbstractAbfsScaleTest.java | 17 +-
.../hadoop/fs/azurebfs/ITestAbfsHugeFiles.java | 97 +++++
.../fs/azurebfs/ITestAzureBlobFileSystemLease.java | 8 +-
.../fs/azurebfs/services/TestAbfsOutputStream.java | 176 ++++++--
20 files changed, 1354 insertions(+), 409 deletions(-)
copy
hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/{metrics2/MetricType.java
=> fs/store/BlockUploadStatistics.java} (80%)
copy
hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/S3ADataBlocks.java
=>
hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/store/DataBlocks.java
(67%)
create mode 100644
hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/store/TestDataBlocks.java
create mode 100644
hadoop-tools/hadoop-azure/src/test/java/org/apache/hadoop/fs/azurebfs/ITestAbfsHugeFiles.java
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
