dan jacobson recently reported a bug with --spider and -r:
http://www.mail-archive.com/wget@sunsite.dk/msg08797.html
hrvoje confirms this bug has been in wget for a long time, mainly
because the semantics of --spider and -r were never properly defined.
from my point of view, it makes sense
I have a wget question about -r. I have a series of web pages I want to
download that look like this:
URL1 points to a page containing
URL2
URL3
URL4
URL5
URL6
The URL1 page also contains a CGI url, which points to a similar page,
containing URL7-11.
Is there a way for me to invoke wget so
