Author: Alexander Barkov
Email: [EMAIL PROTECTED]
Message:
Why do you thinks that robots.txt are indexed?
> Hi,
>
> I have installed and working:
> version 3.1.19
> Robots yes
>
> Indexer is set to index Server path and Server world, working fine.
>
> In my search results some robots.txt files seem to have been indexed themselves
>instead of the index.html or index.htm file.
>
> How can I prevent robots.txt files from being indexed themselves, without losing the
>option to read robots.txt first?
>
> Jan Paul
Reply: <http://www.mnogosearch.org/board/message.php?id=3161>
___________________________________________
If you want to unsubscribe send "unsubscribe general"
to [EMAIL PROTECTED]
