Alexander, This latest version (lftp-pre4.5.0.20131214)--is showing improved performance, including two sub-3 minute transfers for the dataset, also at the server-level, CPU utilization increased (pure-ftpd) from 35% to 45-47% (which isn't a problem but demonstrates lftp can pull the data faster now)..
Re/TOP: 31511 user 20 0 38356 2324 1796 S [43.9% CPU] 0.0 1:09.17 pure-ftpd Results: After (newest code base) Version: lftp-pre4.5.0.20131214 156505837056 bytes transferred in 177 seconds (843.64M/s) 10.33user 165.36system 2:56.93elapsed 99%CPU (0avgtext+0avgdata 3068maxresident)k 0inputs+0outputs (2major+1225minor)pagefaults 0swaps 156505837056 bytes transferred in 184 seconds (811.40M/s) 17.34user 165.72system 3:03.97elapsed 99%CPU (0avgtext+0avgdata 3140maxresident)k 156505837056 bytes transferred in 174 seconds (856.90M/s) 13.40user 159.24system 2:54.20elapsed 99%CPU (0avgtext+0avgdata 3080maxresident)k 0inputs+0outputs (5major+1243minor)pagefaults 0swaps Before: Version (lftp-pre4.5.0-20131206) and it was normal: 156505837056 bytes transferred in 187 seconds (796.08M/s) 22.34user 164.00system 3:07.52elapsed 99%CPU (0avgtext+0avgdata2704maxresident)k 0inputs+0outputs (6major+2406minor)pagefaults 0swaps 156505837056 bytes transferred in 189 seconds (789.70M/s) 22.29user 165.31system 3:09.03elapsed 99%CPU (0avgtext+0avgdata2684maxresident)k 0inputs+0outputs (8major+7492minor)pagefaults 0swaps 156505837056 bytes transferred in 187 seconds (799.54M/s) Justin. > -----Original Message----- > From: Alexander V. Lukyanov [mailto:l...@netis.ru] > Sent: Friday, December 13, 2013 8:39 AM > To: Justin Piszcz > Cc: lftp-devel@uniyar.ac.ru > Subject: Re: lftp-pre4.5.0-20131206 > > On Thu, Dec 12, 2013 at 04:24:14AM -0500, Justin Piszcz wrote: > > lftp is still reading 65536 buffers, but not larger than that: > > Ok, I have made another snapshot: > http://lftp.yar.ru/ftp/devel/lftp-pre4.5.0.20131214.tar.gz > > Please give it a try. You can test various values for xfer:buffer-size > and see which works better. By default it is still 0x10000. For me that > value works best for transfers from localhost. For some obscure reason > 0x20000 bytes cannot be passed at once from localhost and are split into > two packets of 131004 and 68 bytes (linux-3.11.4-201.fc19.x86_64). > > -- > Alexander. _______________________________________________ lftp-devel mailing list lftp-devel@uniyar.ac.ru http://univ.uniyar.ac.ru/mailman/listinfo/lftp-devel
