Mukund Thakur created HDFS-13660:
------------------------------------
Summary: DistCp job fails when new data is appended in the file
while the distCp copy job is running
Key: HDFS-13660
URL: https://issues.apache.org/jira/browse/HDFS-13660
Project: Hadoop HDFS
Issue Type: Bug
Components: distcp
Reporter: Mukund Thakur
Attachments: distcp_failure_when_file_append.log
Steps to reproduce:
Suppose distcp MR job is copying the file /tmp/web_returns_merged/data-m-002
and
we append some more data to this file using command
hadoop fs -appendToFile xaa /tmp/web_returns_merged/data-m-002
the job fails with exception
Mismatch in length of
source:hdfs://mycluster0/tmp/web_returns_merged/data-m-002 and target.
Attached the logs.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
