Re: [lftp] possible bug in lftp mirror using xfer:use-temp-file option
In which LFTP version exists this option (xfer:use-temp-file)? 2014-09-30 19:05 GMT+02:00 akshay gupta : > Its causing unpredictable behaviour in case of fuse mounted file system. > Please look into it if it can be resolved. > > Thanks for the quick response. > > ~Akshay > > On Tue, Sep 30, 2014 at 9:15 PM, Alexander Lukyanov > wrote: > >> In unix it is usually allowed to rename open files, so lftp does that. >> I'll see if it is possible to reverse the order. >> >> 2014-09-30 12:18 GMT+04:00 akshay gupta : >> >>> Hi, >>> >>> I am trying to mirror files on Fuse mounted hdfs file system ( >>> https://wiki.apache.org/hadoop/MountableHDFS). Lftp is creating some 0 >>> byte files. >>> >>> Observations: >>> 1. Files of size larger then 64k are getting transferred properly. >>> Smaller files have 0 byte file size. >>> 2. Debug logs shows that lftp downloaded data for the files correctly. >>> It also renamed them. >>> >>> Additional tests on fuse mounted hdfs. >>> - I created a file with a temp file name, written the data to it, then >>> renamed the file and finally closed the output stream. In this case it >>> creates a 0 byte file. >>> - I created a file with a temp file name, written the data to it, closed >>> the file and then renamed the file. In this case it creates the file >>> correctly. >>> >>> >>> Can someone please look into this issue, it might be possible that >>> stream is closed after the file is renamed. >>> >>> Thanks, >>> Akshay >>> >>> >>> >> >> >> >> -- >>Alexander. >> > > > ___ > lftp mailing list > lftp@uniyar.ac.ru > http://univ.uniyar.ac.ru/mailman/listinfo/lftp > > ___ lftp mailing list lftp@uniyar.ac.ru http://univ.uniyar.ac.ru/mailman/listinfo/lftp
Re: [lftp] possible bug in lftp mirror using xfer:use-temp-file option
Its causing unpredictable behaviour in case of fuse mounted file system. Please look into it if it can be resolved. Thanks for the quick response. ~Akshay On Tue, Sep 30, 2014 at 9:15 PM, Alexander Lukyanov wrote: > In unix it is usually allowed to rename open files, so lftp does that. > I'll see if it is possible to reverse the order. > > 2014-09-30 12:18 GMT+04:00 akshay gupta : > >> Hi, >> >> I am trying to mirror files on Fuse mounted hdfs file system ( >> https://wiki.apache.org/hadoop/MountableHDFS). Lftp is creating some 0 >> byte files. >> >> Observations: >> 1. Files of size larger then 64k are getting transferred properly. >> Smaller files have 0 byte file size. >> 2. Debug logs shows that lftp downloaded data for the files correctly. It >> also renamed them. >> >> Additional tests on fuse mounted hdfs. >> - I created a file with a temp file name, written the data to it, then >> renamed the file and finally closed the output stream. In this case it >> creates a 0 byte file. >> - I created a file with a temp file name, written the data to it, closed >> the file and then renamed the file. In this case it creates the file >> correctly. >> >> >> Can someone please look into this issue, it might be possible that stream >> is closed after the file is renamed. >> >> Thanks, >> Akshay >> >> >> > > > > -- >Alexander. > ___ lftp mailing list lftp@uniyar.ac.ru http://univ.uniyar.ac.ru/mailman/listinfo/lftp
Re: [lftp] possible bug in lftp mirror using xfer:use-temp-file option
In unix it is usually allowed to rename open files, so lftp does that. I'll see if it is possible to reverse the order. 2014-09-30 12:18 GMT+04:00 akshay gupta : > Hi, > > I am trying to mirror files on Fuse mounted hdfs file system ( > https://wiki.apache.org/hadoop/MountableHDFS). Lftp is creating some 0 > byte files. > > Observations: > 1. Files of size larger then 64k are getting transferred properly. Smaller > files have 0 byte file size. > 2. Debug logs shows that lftp downloaded data for the files correctly. It > also renamed them. > > Additional tests on fuse mounted hdfs. > - I created a file with a temp file name, written the data to it, then > renamed the file and finally closed the output stream. In this case it > creates a 0 byte file. > - I created a file with a temp file name, written the data to it, closed > the file and then renamed the file. In this case it creates the file > correctly. > > > Can someone please look into this issue, it might be possible that stream > is closed after the file is renamed. > > Thanks, > Akshay > > > -- Alexander. ___ lftp mailing list lftp@uniyar.ac.ru http://univ.uniyar.ac.ru/mailman/listinfo/lftp
[lftp] possible bug in lftp mirror using xfer:use-temp-file option
Hi, I am trying to mirror files on Fuse mounted hdfs file system ( https://wiki.apache.org/hadoop/MountableHDFS). Lftp is creating some 0 byte files. Observations: 1. Files of size larger then 64k are getting transferred properly. Smaller files have 0 byte file size. 2. Debug logs shows that lftp downloaded data for the files correctly. It also renamed them. Additional tests on fuse mounted hdfs. - I created a file with a temp file name, written the data to it, then renamed the file and finally closed the output stream. In this case it creates a 0 byte file. - I created a file with a temp file name, written the data to it, closed the file and then renamed the file. In this case it creates the file correctly. Can someone please look into this issue, it might be possible that stream is closed after the file is renamed. Thanks, Akshay ___ lftp mailing list lftp@uniyar.ac.ru http://univ.uniyar.ac.ru/mailman/listinfo/lftp