This is an automated email from the ASF dual-hosted git repository.
weichiu pushed a change to branch branch-3.1
in repository https://gitbox.apache.org/repos/asf/hadoop.git.
from 4af1885 HDFS-14731. [FGL] Remove redundant locking on NameNode.
Contributed by Konstantin V Shvachko.
new abee740 HDFS-15068. DataNode could meet deadlock if invoke
refreshVolumes when register. Contributed by Aiphago.
new 354e63b HDFS-12999. When reach the end of the block group, it may not
need to flush all the data packets(flushAllInternals) twice. Contributed by
lufei and Fei Hui.
new ce66145 HDFS-13660. DistCp job fails when new data is appended in the
file while the DistCp copy job is running
The 3 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.../apache/hadoop/hdfs/DFSStripedOutputStream.java | 17 ++-
.../hdfs/server/datanode/BPOfferService.java | 2 +-
.../hadoop/hdfs/server/datanode/DataNode.java | 147 +++++++++++----------
.../server/datanode/DataNodeFaultInjector.java | 5 +
.../server/datanode/TestDataNodeVolumeFailure.java | 46 +++++++
.../org/apache/hadoop/tools/DistCpConstants.java | 6 +
.../apache/hadoop/tools/mapred/CopyCommitter.java | 10 +-
.../org/apache/hadoop/tools/mapred/CopyMapper.java | 3 +-
.../tools/mapred/RetriableFileCopyCommand.java | 34 +++--
.../org/apache/hadoop/tools/util/DistCpUtils.java | 26 ++--
.../hadoop/tools/mapred/TestCopyCommitter.java | 5 +-
.../apache/hadoop/tools/mapred/TestCopyMapper.java | 56 ++++++++
.../tools/mapred/TestRetriableFileCopyCommand.java | 25 +++-
.../apache/hadoop/tools/util/TestDistCpUtils.java | 45 +++----
.../tools/util/TestDistCpUtilsWithCombineMode.java | 4 +-
15 files changed, 293 insertions(+), 138 deletions(-)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
