[htdig] exclude documents, but still index links on it?

[John Caldwell]

I'm working on a site with some dynamic content, and i want to be able to
point htdig at an index of pages so that it can spider them, but I don't
want the main index page to ever show up in the search results.  Is there
way to 'exclude' a file but still follow the links on it?

--
John Caldwell
[EMAIL PROTECTED]


------------------------------------
To unsubscribe from the htdig mailing list, send a message to
[EMAIL PROTECTED]
You will receive a message to confirm this.