If I understand meta tag robots directive correctly the
following should index the page but disallow htdig from
following the links:
<meta name="robots" content="index,nofollow">
However, htsearch doesn't report the pages with this meta tag (I
assume they were not indexed, right?). Is this htdig bug, or
mistake on my part? What is a correct way of achieving the
desire effect?
TIA
-------- Mark Malecha
-------- [EMAIL PROTECTED]
----------------------------------------------------------------------
To unsubscribe from the htdig mailing list, send a message to
[EMAIL PROTECTED] containing the single word "unsubscribe" in
the body of the message.
