>start_url: http://www.suse.com/Mailinglists/suse-informix
>
>doesn't see this subdir. The index file there however contians
>all the links...
My best suggestion is to run htdig and add '-vvv' to your command line.
This will generate a pile of data, but it should give you each HTTP header
as well as some explanation of why it rejects links.
I ran it through the URL test code I've been using as I add support for
multiple services. It parsed it OK, so any problem is occurring earlier in
parsing--for example the HTML parser may decide those href tags aren't any
good. The debugging output will tell us more.
-Geoff
------------------------------------
To unsubscribe from the htdig3-dev mailing list, send a message to
[EMAIL PROTECTED] containing the single word "unsubscribe" in
the SUBJECT of the message.
