Re: [lftp-devel] [lftp] FW: Regarding LFTP checksum issue

2014-06-09 Thread Alexander Lukyanov
Do you have checksum issues if you use plain get command? Does pget work as expected with other ftp servers? 2014-04-01 13:15 GMT+04:00 PRADHAN Priyabrata priyabrata.prad...@murex.com : Fyia Thanks Priya *From:* PRADHAN Priyabrata *Sent:* Tuesday, April 01, 2014 6:14 PM *To:*

Re: [lftp-devel] [lftp] Status for incomplete files

2014-09-19 Thread Alexander Lukyanov
Please try http://lftp.yar.ru/ftp/devel/lftp-4.5.5.20140919.tar.gz, it introduces another setting xfer:temp-file-name. You can thus change the temporary file name; an asterisk is replaced by the original file name. So you would do set xfer:temp-file-name _tmp_* to achieve wanted behaviour.

Re: [lftp-devel] [lftp] Status for incomplete files

2014-09-19 Thread Alexander Lukyanov
, 2014 at 4:58 PM, Alexander Lukyanov lavv...@gmail.com wrote: Please try http://lftp.yar.ru/ftp/devel/lftp-4.5.5.20140919.tar.gz, it introduces another setting xfer:temp-file-name. You can thus change the temporary file name; an asterisk is replaced by the original file name. So you would do

Re: [lftp-devel] possible bug in lftp mirror using xfer:use-temp-file option

2014-09-30 Thread Alexander Lukyanov
In unix it is usually allowed to rename open files, so lftp does that. I'll see if it is possible to reverse the order. 2014-09-30 12:18 GMT+04:00 akshay gupta akshaygupta...@gmail.com: Hi, I am trying to mirror files on Fuse mounted hdfs file system (

Re: [lftp-devel] Bug in lftp mirror when using xfer:use-temp-file option

2014-10-27 Thread Alexander Lukyanov
Can you provide a debug log? Why lftp cannot replace the old file? 2014-10-27 10:44 GMT+03:00 akshay gupta akshaygupta...@gmail.com: Hi, I am trying to mirror files using lftp, I have tested a use case where a file at the source machine gets modified but the file name remains the same.

Re: [lftp-devel] [lftp] Bug in lftp mirror when using xfer:use-temp-file option

2014-10-27 Thread Alexander Lukyanov
--- 226 Transfer complete. So the file cannot be renamed locally, right? Is there a permissions problem? -- Alexander. On Mon, Oct 27, 2014 at 1:18 PM, Alexander Lukyanov lavv...@gmail.com wrote: Can you provide a debug log? Why lftp cannot replace the old file? 2014-10-27 10:44

Re: [lftp-devel] [lftp] Bug in lftp mirror when using xfer:use-temp-file option

2014-10-28 Thread Alexander Lukyanov
It looks like a bug in the FS (fuse and/or hdfs) which also hits rsync: https://groups.google.com/a/cloudera.org/forum/#!msg/cdh-user/R1GR2Asj_lc/f_uuIjG5R1UJ Please try this workaround. 2014-10-28 10:29 GMT+03:00 akshay gupta akshaygupta...@gmail.com: will giving --delete-first option in lftp

Re: [lftp-devel] Possible Bug in lftp mirror using mirror:sort-by option

2014-10-29 Thread Alexander Lukyanov
Mirror in lftp works directory by directory. It does not build full list of files first, so it cannot sort the whole list. Maybe the mirror algorithm should be redesigned to build the whole recursive list first. What do you think? 2014-10-29 10:07 GMT+03:00 akshay gupta akshaygupta...@gmail.com:

Re: [lftp-devel] Possible Bug in lftp mirror using mirror:sort-by option

2014-11-12 Thread Alexander Lukyanov
the functionality of mirror:sort-by option implies that the order is for all the files irrespective of the directory structure. Or may be it should support both the options and it would be configuration defined which one to use. On Wed, Oct 29, 2014 at 2:09 PM, Alexander Lukyanov lavv...@gmail.com wrote

Re: [lftp-devel] Possible Bug in lftp mirror using mirror:sort-by option

2014-12-05 Thread Alexander Lukyanov
--with-openssl command and it cannot seem to find Makefile.in in the configure step. Attached the complete logs On Thu, Dec 4, 2014 at 8:54 PM, Alexander Lukyanov lavv...@gmail.com wrote: autogen.sh script should generate everything. You'll have to get gnulib too. четверг, 4 декабря 2014 г

Re: [lftp-devel] Possible Bug in lftp mirror using mirror:sort-by option

2014-12-08 Thread Alexander Lukyanov
: Have done some initial high level testing. It seems to work. Will test it thoroughly and will get back to you in case I find any bug. On Fri, Dec 5, 2014 at 10:20 PM, Alexander Lukyanov lavv...@gmail.com wrote: I think you need to install gettext-devel. I have also made a snapshot in case you

Re: [lftp-devel] Handling for small files

2015-02-24 Thread Alexander Lukyanov
Which protocol do you use? вт, 24 февр. 2015, 13:48, akshay gupta akshaygupta...@gmail.com: Hi, I am trying to transfer about 80GB of data using mirror option. File sizes are very small about 0.5 KB to 3 KB per file. Transfer is taking a lot of time which I am attributing to small file

Re: [lftp-devel] Bug in lftp mirror when using xfer:use-temp-file option

2015-05-13 Thread Alexander Lukyanov
There should be no limitations. Please produce a stack trace and send it to me. ср, 13 мая 2015, 18:34, Ankit Khurana ankit.khurana0...@gmail.com: Hi, I am trying to mirror files using lftp, the mirror path contains around 1 million files. The problem i am facing is that when i start the

Re: [lftp-devel] Bug in lftp mirror when using xfer:use-temp-file option

2015-05-15 Thread Alexander Lukyanov
The problem should be fixed by https://github.com/lavv17/lftp/commit/a2b4cdbf8ccdb98c8d5c79834ea6e29f83575da9 without unnecessary memory allocation. 2015-05-15 20:22 GMT+03:00 Alexander Lukyanov lavv...@gmail.com: Thanks for debugging! I'll fix it by using heap memory чт, 14 мая 2015, 14:59