On Fri, Dec 13, 2013 at 09:03:00AM -0500, Justin Piszcz wrote: > This latest version (lftp-pre4.5.0.20131214)--is showing improved > performance, including two sub-3 minute transfers for the dataset, also at > the server-level, CPU utilization increased (pure-ftpd) from 35% to 45-47% > (which isn't a problem but demonstrates lftp can pull the data faster now)..
I'm glad to hear that. Please use strace to see if system call pattern is optimal. > After (newest code base) > Version: lftp-pre4.5.0.20131214 > > 10.33user 165.36system 2:56.93elapsed 99%CPU (0avgtext+0avgdata > 17.34user 165.72system 3:03.97elapsed 99%CPU (0avgtext+0avgdata > 13.40user 159.24system 2:54.20elapsed 99%CPU (0avgtext+0avgdata > > Before: > Version (lftp-pre4.5.0-20131206) and it was normal: > > 22.34user 164.00system 3:07.52elapsed 99%CPU > 22.29user 165.31system 3:09.03elapsed 99%CPU I see that user time is decreased (probably because of buffer swapping optimization), but system time is still the same. Please try larger settings for xfer:buffer-size to see if they decrease system time. Use strace to ensure lftp really uses those buffer sizes (it does here). -- Alexander. > > -----Original Message----- > > From: Alexander V. Lukyanov [mailto:l...@netis.ru] > > Sent: Friday, December 13, 2013 8:39 AM > > To: Justin Piszcz > > Cc: lftp-devel@uniyar.ac.ru > > Subject: Re: lftp-pre4.5.0-20131206 > > > > On Thu, Dec 12, 2013 at 04:24:14AM -0500, Justin Piszcz wrote: > > > lftp is still reading 65536 buffers, but not larger than that: > > > > Ok, I have made another snapshot: > > http://lftp.yar.ru/ftp/devel/lftp-pre4.5.0.20131214.tar.gz > > > > Please give it a try. You can test various values for xfer:buffer-size > > and see which works better. By default it is still 0x10000. For me that > > value works best for transfers from localhost. For some obscure reason > > 0x20000 bytes cannot be passed at once from localhost and are split into > > two packets of 131004 and 68 bytes (linux-3.11.4-201.fc19.x86_64). > > > > -- > > Alexander. _______________________________________________ lftp-devel mailing list lftp-devel@uniyar.ac.ru http://univ.uniyar.ac.ru/mailman/listinfo/lftp-devel
