Re: --spider download

2001-05-19 Thread Jan Prikryl
Quoting Tom Gordon ([EMAIL PROTECTED]): [...] --09:58:49-- ftp://metalab.unc.edu/README [...] Oh, I see. I'm afraid `--spider' will not work with FTP, it's been probably meant for HTTP only (Hrvoje?) . The wget user manual says: | --spider | When invoked with this option,

Recursive retrieval can skip valid pages

2001-05-19 Thread Jeremy Hetzler
I believe this is a known bug, but it does not appear in the current documentation. Problem: When invoked as wget -r -lx, wget can sometimes mistakenly decide not to retrieve valid pages, if they have already appeared in an invalid context. Example: A directory contains three html files,

wget and globbing

2001-05-19 Thread kcole
I am trying to set up wget to automatically download the latest Virus files from Mcafee's ftp server. I was trying to use the glob feature of wget to match sdat*.exe as the name of the latest file updates every time they release a new one. I was wondering if anyone else has had any luck using