Recursion and real no spanning hosts

2003-11-13 Thread magnus
It seems that wget is always spanning hosts. To be more precise first page of each spanned host is always being downloaded. Why does it happen? How to change this behavior? Example: wget -r -U Mozilla/5.0 http://www.macintouch.com/panreader13.html Option --span-hosts is not used. Zdzisiek

Re: Recursion and real no spanning hosts

2003-11-13 Thread Hrvoje Niksic
[EMAIL PROTECTED] writes: It seems that wget is always spanning hosts. To be more precise first page of each spanned host is always being downloaded. What you are observing is that Wget is always following redirections. For example, if a page A redirects to page B, Wget will download B even

Re: spanning hosts

2002-04-02 Thread Ian Abbott
On 28 Mar 2002 at 18:01, Jens Rösner wrote: I came across a crash caused by a cookie two days ago. I disabled cookies and it worked. I'm hoping you had debug output on when it crashed, otherwise this is a different crash to the one I already know about. Can you confirm this, please?

Re: spanning hosts: 2 Problems

2002-03-28 Thread Jens Rösner
Hi again, Ian and fellow wgeteers! A debug log will be useful if you can produce one. Sure I (or wget) can and did. It is 60kB of text. Zipping? Attaching? Also note that if receive cookies that expire around 2038 with debugging on, the Windows version of Wget will crash! (This is a known

Re: spanning hosts: 2 Problems

2002-03-26 Thread Ian Abbott
On 26 Mar 2002 at 19:01, Jens Rösner wrote: I am using wget to parse a local html file which has numerous links into the www. Now, I only want hosts that include certain strings like -H -Daudi,vw,online.de It's probably worth noting that the comparisons between the -D strings and the