At 03:36 AM 8/20/2007, Alexander V. Lukyanov wrote:
On Sat, Aug 18, 2007 at 09:31:36PM -0500, Thomas L. Shinnick wrote:
> But using "lftp sftp://that_host"; only works for the 16KB size,
> and fails on 64KB or bigger.
This patch should fix the problem.
Thank you very much! Applied to 3.5.12 release, tested against 16KB,
64KB, 1MB, 128MB, and 512MB and all worked. This is wonderful.
BTW: because of what the customer wanted in the way of behavior,
these are the commands to lftp:
lcd that_user/Inbox
mirror --verbose=3 --reverse --Remove-source-files
--older-than=now-5mins . file:../Outbox/
lcd ../Outbox
mirror --verbose=3 --reverse . file:../Archive/
mirror --verbose=3 --reverse --Remove-source-files . /that_user/RAW/
lcd ../..
ls /that_user/RAW/
- move everything from ./Inbox to ./Outbox
- make a copy of ./Outbox files to ./Archive
- now finally move ./Outbox files to remote site directory
Using lftp to copy files around locally is weird, yes, but it means I
can do it all within the one program!
OBTW: because I was worried at the overhead of doing encrypted
transfers, I ran timing tests against ftp://, sftp://, and plain sftp.
ftp://
1M ~2 secs
128M ~100 secs ~1.28MB/sec (1:40 mins)
512M 408 secs ~1.25MB/sec (6:48 mins)
sftp://
1M ~4-5 secs
128M ~99 secs ~1.29MB/sec (1:39 mins)
512M 410 secs ~1.25MB/sec (6:50 mins)
plain sftp
1M ~3-4 secs
128M ~99 secs ~1.29MB/sec (1:39 mins)
512M 411 secs ~1.25MB/sec (6:51 mins)
So lftp has the same throughput as plain sftp, and maybe a bit better
as the sftp:// test was run during the daytime, the sftp test run at night.
Thank you very much again.
Tom
--
Alexander.
