Re: [lftp-devel] possible bug in lftp mirror using xfer:use-temp-file option
Its causing unpredictable behaviour in case of fuse mounted file system. Please look into it if it can be resolved. Thanks for the quick response. ~Akshay On Tue, Sep 30, 2014 at 9:15 PM, Alexander Lukyanov lavv...@gmail.com wrote: In unix it is usually allowed to rename open files, so lftp does that. I'll see if it is possible to reverse the order. 2014-09-30 12:18 GMT+04:00 akshay gupta akshaygupta...@gmail.com: Hi, I am trying to mirror files on Fuse mounted hdfs file system ( https://wiki.apache.org/hadoop/MountableHDFS). Lftp is creating some 0 byte files. Observations: 1. Files of size larger then 64k are getting transferred properly. Smaller files have 0 byte file size. 2. Debug logs shows that lftp downloaded data for the files correctly. It also renamed them. Additional tests on fuse mounted hdfs. - I created a file with a temp file name, written the data to it, then renamed the file and finally closed the output stream. In this case it creates a 0 byte file. - I created a file with a temp file name, written the data to it, closed the file and then renamed the file. In this case it creates the file correctly. Can someone please look into this issue, it might be possible that stream is closed after the file is renamed. Thanks, Akshay -- Alexander. ___ lftp-devel mailing list lftp-devel@uniyar.ac.ru http://univ.uniyar.ac.ru/mailman/listinfo/lftp-devel
Re: [lftp-devel] possible bug in lftp mirror using xfer:use-temp-file option
This option (xfer:use-temp-file) is available in development snapshot http://lftp.yar.ru/ftp/devel/lftp-4.5.5.20140919.tar.gz. On Tue, Sep 30, 2014 at 10:35 PM, akshay gupta akshaygupta...@gmail.com wrote: Its causing unpredictable behaviour in case of fuse mounted file system. Please look into it if it can be resolved. Thanks for the quick response. ~Akshay On Tue, Sep 30, 2014 at 9:15 PM, Alexander Lukyanov lavv...@gmail.com wrote: In unix it is usually allowed to rename open files, so lftp does that. I'll see if it is possible to reverse the order. 2014-09-30 12:18 GMT+04:00 akshay gupta akshaygupta...@gmail.com: Hi, I am trying to mirror files on Fuse mounted hdfs file system ( https://wiki.apache.org/hadoop/MountableHDFS). Lftp is creating some 0 byte files. Observations: 1. Files of size larger then 64k are getting transferred properly. Smaller files have 0 byte file size. 2. Debug logs shows that lftp downloaded data for the files correctly. It also renamed them. Additional tests on fuse mounted hdfs. - I created a file with a temp file name, written the data to it, then renamed the file and finally closed the output stream. In this case it creates a 0 byte file. - I created a file with a temp file name, written the data to it, closed the file and then renamed the file. In this case it creates the file correctly. Can someone please look into this issue, it might be possible that stream is closed after the file is renamed. Thanks, Akshay -- Alexander. ___ lftp-devel mailing list lftp-devel@uniyar.ac.ru http://univ.uniyar.ac.ru/mailman/listinfo/lftp-devel
Re: [lftp-devel] possible bug in lftp mirror using xfer:use-temp-file option
I am using this feature to know whether a file is completely transferred or lftp is still downloading this file. On Wed, Oct 1, 2014 at 12:46 PM, akshay gupta akshaygupta...@gmail.com wrote: This option (xfer:use-temp-file) is available in development snapshot http://lftp.yar.ru/ftp/devel/lftp-4.5.5.20140919.tar.gz. On Tue, Sep 30, 2014 at 10:35 PM, akshay gupta akshaygupta...@gmail.com wrote: Its causing unpredictable behaviour in case of fuse mounted file system. Please look into it if it can be resolved. Thanks for the quick response. ~Akshay On Tue, Sep 30, 2014 at 9:15 PM, Alexander Lukyanov lavv...@gmail.com wrote: In unix it is usually allowed to rename open files, so lftp does that. I'll see if it is possible to reverse the order. 2014-09-30 12:18 GMT+04:00 akshay gupta akshaygupta...@gmail.com: Hi, I am trying to mirror files on Fuse mounted hdfs file system ( https://wiki.apache.org/hadoop/MountableHDFS). Lftp is creating some 0 byte files. Observations: 1. Files of size larger then 64k are getting transferred properly. Smaller files have 0 byte file size. 2. Debug logs shows that lftp downloaded data for the files correctly. It also renamed them. Additional tests on fuse mounted hdfs. - I created a file with a temp file name, written the data to it, then renamed the file and finally closed the output stream. In this case it creates a 0 byte file. - I created a file with a temp file name, written the data to it, closed the file and then renamed the file. In this case it creates the file correctly. Can someone please look into this issue, it might be possible that stream is closed after the file is renamed. Thanks, Akshay -- Alexander. ___ lftp-devel mailing list lftp-devel@uniyar.ac.ru http://univ.uniyar.ac.ru/mailman/listinfo/lftp-devel
Re: [lftp-devel] possible bug in lftp mirror using xfer:use-temp-file option
On Tue, Sep 30, 2014 at 10:35:37PM +0530, akshay gupta wrote: Its causing unpredictable behaviour in case of fuse mounted file system. Please look into it if it can be resolved. Please test the new snapshot http://lftp.yar.ru/ftp/devel/lftp-4.5.5.20141003.tar.gz -- Alexander. ___ lftp-devel mailing list lftp-devel@uniyar.ac.ru http://univ.uniyar.ac.ru/mailman/listinfo/lftp-devel
Re: [lftp-devel] possible bug in lftp mirror using xfer:use-temp-file option
In unix it is usually allowed to rename open files, so lftp does that. I'll see if it is possible to reverse the order. 2014-09-30 12:18 GMT+04:00 akshay gupta akshaygupta...@gmail.com: Hi, I am trying to mirror files on Fuse mounted hdfs file system ( https://wiki.apache.org/hadoop/MountableHDFS). Lftp is creating some 0 byte files. Observations: 1. Files of size larger then 64k are getting transferred properly. Smaller files have 0 byte file size. 2. Debug logs shows that lftp downloaded data for the files correctly. It also renamed them. Additional tests on fuse mounted hdfs. - I created a file with a temp file name, written the data to it, then renamed the file and finally closed the output stream. In this case it creates a 0 byte file. - I created a file with a temp file name, written the data to it, closed the file and then renamed the file. In this case it creates the file correctly. Can someone please look into this issue, it might be possible that stream is closed after the file is renamed. Thanks, Akshay -- Alexander. ___ lftp-devel mailing list lftp-devel@uniyar.ac.ru http://univ.uniyar.ac.ru/mailman/listinfo/lftp-devel
