This is an automated email from the ASF dual-hosted git repository.
weichiu pushed a change to branch branch-3.2
in repository https://gitbox.apache.org/repos/asf/hadoop.git.
from c82e20f HDFS-14731. [FGL] Remove redundant locking on NameNode.
Contributed by Konstantin V Shvachko.
new e1ff3b2 HDFS-15068. DataNode could meet deadlock if invoke
refreshVolumes when register. Contributed by Aiphago.
new 9acbbd8 HDFS-12999. When reach the end of the block group, it may not
need to flush all the data packets(flushAllInternals) twice. Contributed by
lufei and Fei Hui.
new 3937abd HDFS-13660. DistCp job fails when new data is appended in the
file while the DistCp copy job is running
The 3 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.../apache/hadoop/hdfs/DFSStripedOutputStream.java | 17 ++-
.../hdfs/server/datanode/BPOfferService.java | 2 +-
.../hadoop/hdfs/server/datanode/DataNode.java | 147 +++++++++++----------
.../server/datanode/DataNodeFaultInjector.java | 5 +
.../server/datanode/TestDataNodeVolumeFailure.java | 46 +++++++
.../org/apache/hadoop/tools/DistCpConstants.java | 6 +
.../apache/hadoop/tools/mapred/CopyCommitter.java | 10 +-
.../org/apache/hadoop/tools/mapred/CopyMapper.java | 3 +-
.../tools/mapred/RetriableFileCopyCommand.java | 34 +++--
.../org/apache/hadoop/tools/util/DistCpUtils.java | 26 ++--
.../hadoop/tools/mapred/TestCopyCommitter.java | 5 +-
.../apache/hadoop/tools/mapred/TestCopyMapper.java | 56 ++++++++
.../tools/mapred/TestRetriableFileCopyCommand.java | 25 +++-
.../apache/hadoop/tools/util/TestDistCpUtils.java | 45 +++----
.../tools/util/TestDistCpUtilsWithCombineMode.java | 4 +-
15 files changed, 293 insertions(+), 138 deletions(-)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
