Hi list!
I'm trying to use lftp to move many thousand small files residing in one
directory to my local machine. I'm on Windows/cygwin and the command line is as
follows:
lftp u...@host:/> mirror --no-recursion --parallel=5 --verbose=3
--Remove-source-files /
While this works generally, I noticed two problems:
1) The server limits directory listings to 2000 files. Hence I can only work in
chunks of 2000, having to reissue the command every so often. Is there a way to
automate this, until all files have been transferred?
2) There seems to be an issue with removing source files. When I check on the
server, they have been removed indeed. However, the lftp client piles up
"couldn't remove" messages, like this:
..
Old file `foo23432.bar' is not removed
Old file `foo23433.bar' is not removed
Total: 1 directory, 2000 files, 0 symlinks
New: 2000 files, 0 symlinks
1761808 bytes transferred in 2467 seconds (714b/s)
To be removed: 0 directories, 8000 files, 0 symlinks
Apparently, that doesn't happen with every download chunk. However, it's always
the complete chunk (8000 files = 4 * 2000). Any ideas about this?
Point 2 is just a minor annoyance, since it seems to work correctly. I would
sincerely appreciate any help with point 1 though. Many thanks in advance,
Andreas
--
GRATIS für alle GMX-Mitglieder: Die maxdome Movie-FLAT!
Jetzt freischalten unter http://portal.gmx.net/de/go/maxdome01
Spam detection software, running on the system "univ.uniyar.ac.ru", has
identified this incoming email as possible spam. The original message
has been attached to this so you can view it (if it isn't spam) or label
similar future email. If you have any questions, see
the administrator of that system for details.
Content preview: Hi list! I'm trying to use lftp to move many thousand small
files residing in one directory to my local machine. I'm on Windows/cygwin
and the command line is as follows: lftp u...@host:/> mirror --no-recursion
--parallel=5 --verbose=3 --Remove-source-files / [...]
Content analysis details: (4.0 points, 5.0 required)
pts rule name description
---- ---------------------- --------------------------------------------------
0.0 FREEMAIL_FROM Sender email is freemail
(michaelch[at]ciudad.com.ar)
(voroninee[at]yandex.ru)
(ezosource[at]mail.com)
(kwakumail01[at]yahoo.com)
(elaineannlampard[at]hotmail.com)
(sagitova_77[at]mail.ru) (chan01[at]lawyer.com)
(ezosource[at]mail.com)
(eurocoordinat21[at]voila.fr)
(aecrfaweuyhtyh[at]web.de)
(tany-79[at]yandex.ru) (hm1209[at]yahoo.com.hk)
(sen.anyokonkwo[at]yahoo.com)
(ludmila-sexi[at]mail.ru)
(john_murphy09[at]live.com)
(john_murphy09[at]live.com)
(alenkin28[at]mail.ru)
(andreasmanthey[at]gmx.net)
-0.0 T_RP_MATCHES_RCVD Envelope sender domain matches handover relay
domain
4.0 BAYES_50 BODY: Bayes spam probability is 40 to 60%
[score: 0.4892]
0.0 T_TO_NO_BRKTS_FREEMAIL T_TO_NO_BRKTS_FREEMAIL
