Wget's default behavior is not to span hosts. However, a redirect
does not count as spanning because the redirected contents is
considered as a different name for the original contents, which *was*
requested.
Note that Wget will not follow the links from the redirected document
further into the
Hello Hrvoje,
On 07-Oct-03, you wrote:
is it possible for someone to e-mail me a working wget setup for amiga to
my private mail?
Thanks
Regards
Patrick Robinson
I don't use an Amiga, nor do I have an idea what you mean by a
working Wget setup. Have you tried compiling from source?
with the same
command line ... it makes no sense that wget 1.8.2 has problems with
particular web sites.
This is incorrect behavior - and if you try the same URL with 1.8.2 you
can reproduce the same results.
The second problem, and I cannot currently give you an example to try
yourself but _it
Josh Brooks [EMAIL PROTECTED] writes:
I have noticed very unpredictable behavior from wget 1.8.2 -
specifically I have noticed two things:
a) sometimes it does not follow all of the links it should
b) sometimes wget will follow links to other sites and URLs - when the
command line used
Thank you for the great response. It is much appreciated - see below...
On Tue, 7 Oct 2003, Hrvoje Niksic wrote:
www.zorg.org/vsound/ contains this markup:
META NAME=ROBOTSCONTENT=NOFOLLOW
That explicitly tells robots, such as Wget, not to follow the links in
the page. Wget