Re: [lftp] Handling for small files
On Tue, Feb 24, 2015 at 11:07:23AM +, akshay gupta wrote: > I am using fish protocol. If possible, try to use sftp. Fish is not quite the most efficient option. Even ftp is better, especially with pipelining (set ftp:sync-mode off). -- Alexander. > On Tue, Feb 24, 2015, 4:23 PM Alexander Lukyanov wrote: > > > Which protocol do you use? > > > > вт, 24 февр. 2015, 13:48, akshay gupta : > > > > Hi, > >> > >> I am trying to transfer about 80GB of data using mirror option. File > >> sizes are very small about 0.5 KB to 3 KB per file. Transfer is taking a > >> lot of time which I am attributing to small file size. Is there any option > >> in lftp which I can use to increase the transfer speed. May be some sort of > >> compression option like rsync -av*z.* > >> > >> I know about the parallel file transfer option but I cant use it because > >> I want to maintain the order of file transfer. > >> > >> Please help. > >> > >> > >> Thanks, > >> > >> Akshay > >> > >> > >> > >> > >> ___ lftp mailing list lftp@uniyar.ac.ru http://univ.uniyar.ac.ru/mailman/listinfo/lftp
Re: [lftp] Handling for small files
I am using fish protocol. On Tue, Feb 24, 2015, 4:23 PM Alexander Lukyanov wrote: > Which protocol do you use? > > вт, 24 февр. 2015, 13:48, akshay gupta : > > Hi, >> >> I am trying to transfer about 80GB of data using mirror option. File >> sizes are very small about 0.5 KB to 3 KB per file. Transfer is taking a >> lot of time which I am attributing to small file size. Is there any option >> in lftp which I can use to increase the transfer speed. May be some sort of >> compression option like rsync -av*z.* >> >> I know about the parallel file transfer option but I cant use it because >> I want to maintain the order of file transfer. >> >> Please help. >> >> >> Thanks, >> >> Akshay >> >> >> >> >> ___ lftp mailing list lftp@uniyar.ac.ru http://univ.uniyar.ac.ru/mailman/listinfo/lftp
Re: [lftp] Handling for small files
Which protocol do you use? вт, 24 февр. 2015, 13:48, akshay gupta : > Hi, > > I am trying to transfer about 80GB of data using mirror option. File sizes > are very small about 0.5 KB to 3 KB per file. Transfer is taking a lot of > time which I am attributing to small file size. Is there any option in lftp > which I can use to increase the transfer speed. May be some sort of > compression option like rsync -av*z.* > > I know about the parallel file transfer option but I cant use it because I > want to maintain the order of file transfer. > > Please help. > > > Thanks, > > Akshay > > > > > ___ lftp mailing list lftp@uniyar.ac.ru http://univ.uniyar.ac.ru/mailman/listinfo/lftp
[lftp] Handling for small files
Hi, I am trying to transfer about 80GB of data using mirror option. File sizes are very small about 0.5 KB to 3 KB per file. Transfer is taking a lot of time which I am attributing to small file size. Is there any option in lftp which I can use to increase the transfer speed. May be some sort of compression option like rsync -av*z.* I know about the parallel file transfer option but I cant use it because I want to maintain the order of file transfer. Please help. Thanks, Akshay ___ lftp mailing list lftp@uniyar.ac.ru http://univ.uniyar.ac.ru/mailman/listinfo/lftp
