On Tue, 6 Mar 2001, Geoff Hutchison wrote:
<hopcount reliability taken into a separate email>
+ >Personally, I have an application where an option to index one hop beyond
+ >the limit_urls_to point would be nice ... I know, go write it myself!
+
+ I think the first question is "how would one specify this?" Once that
+ question is answered, then writing it would probably be a bit more
+ apparent.
Geoff,
For my one-hop scenario I would (probably imprecisely) specify it as ...
A page that, by the present ruleset, would be rejected will be
accepted and processed as if it had an <index,nofollow> header.
To go beyong one hop I can see would be more problematic since the
additional hops may involve a link to yet another site thus inviting even
more controls.
regards,
Malcolm.
[EMAIL PROTECTED] http://users.ox.ac.uk/~malcolm/
_______________________________________________
htdig-general mailing list <[EMAIL PROTECTED]>
To unsubscribe, send a message to <[EMAIL PROTECTED]> with a
subject of unsubscribe
FAQ: http://htdig.sourceforge.net/FAQ.html