Re: [lftp-devel] lftp-pre4.5.0-20131206

2013-12-13 Thread Justin Piszcz
Alexander, This latest version (lftp-pre4.5.0.20131214)--is showing improved performance, including two sub-3 minute transfers for the dataset, also at the server-level, CPU utilization increased (pure-ftpd) from 35% to 45-47% (which isn't a problem but demonstrates lftp can pull the data faster

Re: [lftp-devel] lftp-pre4.5.0-20131206

2013-12-13 Thread Alexander V. Lukyanov
On Fri, Dec 13, 2013 at 09:03:00AM -0500, Justin Piszcz wrote: This latest version (lftp-pre4.5.0.20131214)--is showing improved performance, including two sub-3 minute transfers for the dataset, also at the server-level, CPU utilization increased (pure-ftpd) from 35% to 45-47% (which isn't a

Re: [lftp-devel] lftp-pre4.5.0-20131206

2013-12-13 Thread Justin Piszcz
Hi, Alexander, this is great!. Response: 1. Yes, there are only 17 instances of EAGAIN for the first 10-20GB (test run), the strace log is now filled with read and write activity. 2. The default buffer size remains 65536 (as shown in strace) (with the default buffer size and with 0x2)

Re: [lftp-devel] lftp-pre4.5.0-20131206

2013-12-13 Thread Alexander V. Lukyanov
On Fri, Dec 13, 2013 at 10:06:34AM -0500, Justin Piszcz wrote: 1. Yes, there are only 17 instances of EAGAIN for the first 10-20GB (test run), the strace log is now filled with read and write activity. That's great. 2. The default buffer size remains 65536 (as shown in strace) (with the

Re: [lftp-devel] lftp-pre4.5.0-20131206

2013-12-12 Thread Justin Piszcz
-Original Message- From: Alexander V. Lukyanov [mailto:l...@netis.ru] Sent: Thursday, December 12, 2013 2:47 AM To: Justin Piszcz Cc: lftp-devel@uniyar.ac.ru Subject: Re: lftp-pre4.5.0-20131206 On Wed, Dec 11, 2013 at 06:37:16AM -0500, Justin Piszcz wrote: I am using Debian

[lftp-devel] lftp-pre4.5.0-20131206

2013-12-06 Thread Alexander V. Lukyanov
A new development snapshot is available from http://lftp.yar.ru/ftp/devel/lftp-pre4.5.0-20131206.tar.gz * optimized cpu usage. * fixed file info fetching from http server. Please test. -- Alexander. ___ lftp-devel mailing list

Re: [lftp-devel] lftp-pre4.5.0-20131206

2013-12-06 Thread Justin Piszcz
Hello Alexander, $ /vapp/bin/lftp --version LFTP | Version pre4.5.0-20131206 | Copyright (c) 1996-2013 Alexander V. Lukyanov Performed same test under same conditions using the same file, 3-times: 156505837056 bytes transferred in 205 seconds (726.62M/s) 156505837056 bytes transferred in 193

Re: [lftp-devel] lftp-pre4.5.0-20131206

2013-12-06 Thread Lars Viklund
On Fri, Dec 06, 2013 at 04:19:22PM +0400, Alexander V. Lukyanov wrote: A new development snapshot is available from http://lftp.yar.ru/ftp/devel/lftp-pre4.5.0-20131206.tar.gz * optimized cpu usage. * fixed file info fetching from http server. Please test. I grabbed this version to

Re: [lftp-devel] lftp-pre4.5.0-20131206

2013-12-06 Thread Alexander V. Lukyanov
BTW, I have just fixed a failed assert in heap code (removing the last heap item is a special case that was not handled properly). -- Alexander. ___ lftp-devel mailing list lftp-devel@uniyar.ac.ru http://univ.uniyar.ac.ru/mailman/listinfo/lftp-devel

Re: [lftp-devel] lftp-pre4.5.0-20131206

2013-12-06 Thread Justin Piszcz
-Original Message- From: Alexander V. Lukyanov [mailto:l...@netis.ru] Sent: Friday, December 06, 2013 8:39 AM To: Justin Piszcz Cc: lftp-devel@uniyar.ac.ru Subject: Re: lftp-pre4.5.0-20131206 On Fri, Dec 06, 2013 at 08:31:38AM -0500, Justin Piszcz wrote: Hello Alexander, $