I'm indexing a lot of pages which are archives - they contain both a link to the original article, and part of the text of the original article.

So ideally I want to crawl the "parent" archive page and index everything it links to, but I don't actually want to index the "parent" page itself.

I hope that makes sense...

Is this possible? I'm using the intranet crawling method.

Many thanks,

Dean

Reply via email to