Hi !

Some time ago, I read that someone wanted to index not only the HTML
source but also the URLs that the robot comes across when indexing a
site.

I DO NOT want to index the URLs but unfortunately, they get indexed : is
there something I missed here ?

All the pages I index have the same type of URL, the only thing that
changes is the search part of the URL. Could this help solve the problem
??

Thanks a lot !

                Vincent QUERU


------------------------------------
To unsubscribe from the htdig mailing list, send a message to
[EMAIL PROTECTED]
You will receive a message to confirm this.
List archives:  <http://www.htdig.org/mail/menu.html>
FAQ:            <http://www.htdig.org/FAQ.html>

Reply via email to