[
https://issues.apache.org/jira/browse/HDFS-13660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16936657#comment-16936657
]
Hudson commented on HDFS-13660:
-------------------------------
SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #17367 (See
[https://builds.apache.org/job/Hadoop-trunk-Commit/17367/])
HDFS-13660. DistCp job fails when new data is appended in the file while
(stevel: rev 51c64b357d4bd1a0038e61df3d4b8ea0a3ad7449)
* (edit)
hadoop-tools/hadoop-distcp/src/test/java/org/apache/hadoop/tools/util/TestDistCpUtils.java
* (edit)
hadoop-tools/hadoop-distcp/src/main/java/org/apache/hadoop/tools/util/DistCpUtils.java
* (edit)
hadoop-tools/hadoop-distcp/src/main/java/org/apache/hadoop/tools/mapred/CopyMapper.java
* (edit)
hadoop-tools/hadoop-distcp/src/main/java/org/apache/hadoop/tools/DistCpConstants.java
* (edit)
hadoop-tools/hadoop-distcp/src/main/java/org/apache/hadoop/tools/mapred/CopyCommitter.java
* (edit)
hadoop-tools/hadoop-distcp/src/main/java/org/apache/hadoop/tools/mapred/RetriableFileCopyCommand.java
* (edit)
hadoop-tools/hadoop-distcp/src/test/java/org/apache/hadoop/tools/mapred/TestCopyCommitter.java
* (edit)
hadoop-tools/hadoop-distcp/src/test/java/org/apache/hadoop/tools/mapred/TestCopyMapper.java
* (edit)
hadoop-tools/hadoop-distcp/src/test/java/org/apache/hadoop/tools/mapred/TestRetriableFileCopyCommand.java
* (edit)
hadoop-tools/hadoop-distcp/src/test/java/org/apache/hadoop/tools/util/TestDistCpUtilsWithCombineMode.java
> DistCp job fails when new data is appended in the file while the distCp copy
> job is running
> -------------------------------------------------------------------------------------------
>
> Key: HDFS-13660
> URL: https://issues.apache.org/jira/browse/HDFS-13660
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: distcp
> Reporter: Mukund Thakur
> Assignee: Mukund Thakur
> Priority: Critical
> Fix For: 3.3.0
>
> Attachments: distcp_failure_when_file_append.log
>
>
> Steps to reproduce:
> Suppose distcp MR job is copying the file /tmp/web_returns_merged/data-m-002
> and
> we append some more data to this file using command
> hadoop fs -appendToFile xaa /tmp/web_returns_merged/data-m-002
> the job fails with exception
> Mismatch in length of
> source:hdfs://mycluster0/tmp/web_returns_merged/data-m-002 and target.
> Attached the logs.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
