On Fri, 2 Nov 2001, Phil Glatz wrote: > Is there a way I can index the contents of this file, but not the file itself? > > I tried adding > exclude_urls: /adlist/index.html
Keep in mind if you index a file and it still exists, it will be left in the database. I think what you want is the "follow, noindex" directive: <META name="robots" content="follow, noindex"> So links on this page will be followed by robots (including ht://Dig) but the page will not be indexed. In actuality, the page will be indexed somewhat but marked to be removed by htmerge/htpurge. -- -Geoff Hutchison Williams Students Online http://wso.williams.edu/ _______________________________________________ htdig-general mailing list <[EMAIL PROTECTED]> To unsubscribe, send a message to <[EMAIL PROTECTED]> with a subject of unsubscribe FAQ: http://htdig.sourceforge.net/FAQ.html
