Re: [lftp-devel] [lftp] Bug in lftp mirror when using xfer:use-temp-file option

2014-10-28 Thread akshay gupta
will giving --delete-first option in lftp mirror help in my case? I think its not working in case of use-temp-file option. As per the man page its suppose to delete the old version of the file before it start downloading the new one. Its not doing anything. Please help. On Mon, Oct 27, 2014 at

Re: [lftp-devel] [lftp] Bug in lftp mirror when using xfer:use-temp-file option

2014-10-28 Thread Alexander Lukyanov
It looks like a bug in the FS (fuse and/or hdfs) which also hits rsync: https://groups.google.com/a/cloudera.org/forum/#!msg/cdh-user/R1GR2Asj_lc/f_uuIjG5R1UJ Please try this workaround. 2014-10-28 10:29 GMT+03:00 akshay gupta akshaygupta...@gmail.com: will giving --delete-first option in lftp

Re: [lftp-devel] [lftp] Bug in lftp mirror when using xfer:use-temp-file option

2014-10-28 Thread akshay gupta
Thanks for the patch Alexander, files seems to be getting replaced now. Ill do some more testing to make sure every thing works perfectly. Thanks again, Akshay On Tue, Oct 28, 2014 at 3:21 PM, Alexander Lukyanov lavv...@gmail.com wrote: BTW, it looks like mirror should remove the old file

Re: [lftp-devel] [lftp] Bug in lftp mirror when using xfer:use-temp-file option

2014-10-27 Thread Alexander V. Lukyanov
On Mon, Oct 27, 2014 at 01:30:42PM +0530, akshay gupta wrote: --- RETR test.txt --- 150 Opening BINARY mode data connection for 'test.txt' (202 bytes). Got EOF on data connection Closing data socket --- 226 Transfer complete. So the file cannot be renamed locally, right? Is there a

Re: [lftp-devel] [lftp] Bug in lftp mirror when using xfer:use-temp-file option

2014-10-27 Thread akshay gupta
no, I am running as a root user. There is some issue with lftp, when file with same name already exist its not able to rename the temp file to actual file. On Mon, Oct 27, 2014 at 1:44 PM, Alexander V. Lukyanov l...@netis.ru wrote: On Mon, Oct 27, 2014 at 01:30:42PM +0530, akshay gupta wrote:

Re: [lftp-devel] [lftp] Bug in lftp mirror when using xfer:use-temp-file option

2014-10-27 Thread Alexander Lukyanov
I have found the bug. As a workaround, use set xfer:clobber yes. 2014-10-27 13:06 GMT+03:00 akshay gupta akshaygupta...@gmail.com: no, I am running as a root user. There is some issue with lftp, when file with same name already exist its not able to rename the temp file to actual file. On

Re: [lftp-devel] [lftp] Bug in lftp mirror when using xfer:use-temp-file option

2014-10-27 Thread akshay gupta
now its producing 0 byte files and i am also getting input/output error here are the debug logs: lftp akshaygupta@192.168.128.124:~/Desktop/lftp mirror --ignore-time --- PASV --- 227 Entering Passive Mode (192,168,128,124,248,18) Connecting data socket to (192.168.128.124) port 63506

Re: [lftp-devel] [lftp] Bug in lftp mirror when using xfer:use-temp-file option

2014-10-27 Thread Alexander V. Lukyanov
On Mon, Oct 27, 2014 at 05:53:19PM +0530, akshay gupta wrote: now its producing 0 byte files and i am also getting input/output error here are the debug logs: copy: renaming `/mount/user/tom/test.txt_tmp_' to `test.txt' mirror: rename(/mount/user/tom/test.txt_tmp_, /mount/user/tom/test.txt):

Re: [lftp-devel] [lftp] Bug in lftp mirror when using xfer:use-temp-file option

2014-10-27 Thread akshay gupta
I am using fuse mounted hadoop distributed file system(HDFS). Can you suggest what changes need to be done to make it work as this is a very critical requirement for my project. Will deleting file and then renaming temp file help? how to achieve that? On Mon, Oct 27, 2014 at 7:38 PM, Alexander V.