Hi
I can't remember the exact error message but distcp consistently fails
when trying to copy open files. Is it your case ?
Workaround it to snapshot prior to copying
Ulul
On 31/12/2016 19:25, Aditya exalter wrote:
Hi All,
A very happy new year to ALL.
I am facing issue while executing distcp between two different clusters,
Caused by: java.io.IOException: Mismatch in length of
source:hdfs://ip1/xxxxxxxxxx/xxxxx and
target:hdfs://nameservice1/xxxxxx/.distcp.tmp.attempt_1483200922993_0056_m_000011_2
I tried using -pb and -skipcrccheck
hadoop distcp -pb -skipcrccheck -update hdfs://ip1/xxxxxxxxxx/xxxxx
hdfs:///xxxxxxxxxxxx/
hadoop distcp -pb hdfs://ip1/xxxxxxxxxx/xxxxx hdfs:///xxxxxxxxxxxx/
hadoop distcp -skipcrccheck -update
hdfs://ip1/xxxxxxxxxx/xxxxx hdfs:///xxxxxxxxxxxx/
but nothing seems to be working .Any solutions please.
Regards,
Aditya.
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
