>>>> -----Original Message----- >>>> From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf >>>> Of Alexander V. Lukyanov >>>> Sent: Wednesday, 20 December 2006 7:15 PM >>>> To: Tony O'Hagan >>>> Cc: [email protected] >>>> Subject: Re: mirroring is very slow with large directories. >>>> >>>> On Wed, Dec 20, 2006 at 02:49:31PM +1000, Tony O'Hagan wrote: >>>> > A single mirror command sends 2500+ MDTM commands for each file before >>>> > starting any file transfers. >>> >>> Try any of these: >>> set ftp:sync-mode off >>> set ftp:use-mdtm off >>> >>> When the sync-mode is off, lftp sends all MDTM commands and then collects >>> all the replies, this is much faster than waiting for reply after each >>> command. >>> >>> -- >>> Alexander.
>> Yes... I've already tried setting ftp:use-mdtm to "false". Unfortunately >> lftp then appears to no longer uses timestamps at all and just downloads >> everything every time so it's no use for mirroring. Is this what you >> expected? >> -- Tony >It shouldn't be like this, so you need to re-check this with a small test >directory and then report the bug to the mailing list. >This is the only way to make bugs fixed. > >Alexander fixes bugs very fast, though :) I tried to workaround the "large directory" problem by selecting a subset of the files using a more specific pattern that selected a date range. This still executes MDTM for every file but reduces the number of files. This appeared to work ok but I've just realized that now lftp has proceeded to *delete* all the local files that don't match this pattern! I assumed that this would only occur if -e or --delete options were used. Apparently not! It's important that I *never* delete local files since the remote site will eventually purge old files that I need to keep. I've no idea how to proceed. Tony.
