RE: Distcp fails with "Got EOF but currentPos = 240377856 < filelength = 1026034162" error

2016-01-18 Thread Zheng, Kai
Looks like a file it’s copying is ended unexpectedly. Maybe need to find out which file, check or read the file in other means to ensure it’s fine not being corrupt. Regards, Kai From: Buntu Dev [mailto:buntu...@gmail.com] Sent: Tuesday, January 19, 2016 5:46 AM To: user@hadoop.apache.org

Re: Distcp fails with "Got EOF but currentPos = 240377856 < filelength = 1026034162" error

2016-01-18 Thread Buntu Dev
Thanks Kai, but I checked the parqet file that was reported to have issues and fsck says the file is healthy. On Mon, Jan 18, 2016 at 7:09 PM, Zheng, Kai wrote: > Looks like a file it’s copying is ended unexpectedly. Maybe need to find > out which file, check or read the

RE: Distcp fails with "Got EOF but currentPos = 240377856 < filelength = 1026034162" error

2016-01-18 Thread Brahma Reddy Battula
Dev [mailto:buntu...@gmail.com] Sent: 19 January 2016 09:15 To: Zheng, Kai Cc: user@hadoop.apache.org Subject: Re: Distcp fails with "Got EOF but currentPos = 240377856 < filelength = 1026034162" error Thanks Kai, but I checked the parqet file that was reported to have issues a