On Thu, 15 Feb 101 [EMAIL PROTECTED] wrote:
+ Can htdig make a list of broken links for a given site?
Alone, no, but I have a perl script ...
It ought to have been 'contributed' but I've have no response from asking
permission from the person who's original script I mangled into something
slightly different. Maybe I should 'contribute' it anyway since the
original script was posted to this list ...
The script takes the htdig output and generates a large table of page
counts at various levels of hopcount, that's the bit I added. The original
component is still there, it takes the extra output from -s and builds a
'bad link' file for each server. Of course, the 'bad link' list is
incomplete, it will only notice a link is bad if htdig tried to follow it.
If the URL matches in the 'exclude_urls:' list then htdig will never try
following the link. It's useful as a routine check on internal links.
The script is visible at
http://wwwsearch.ox.ac.uk/dig_report.pl
and you can see a sample of the output from it at
http://wwwsearch.ox.ac.uk/report/
I have never run it on htdig output after 3.1.5. It currently gets given
'-v' output but I have given it '-vv', no guarantees on '-vvv...'!
regards,
Malcolm.
[EMAIL PROTECTED] http://users.ox.ac.uk/~malcolm/
_______________________________________________
htdig-general mailing list <[EMAIL PROTECTED]>
Information: http://lists.sourceforge.net/lists/listinfo/htdig-general
FAQ: http://htdig.sourceforge.net/FAQ.html
