Author: Alexander Barkov
Email: [EMAIL PROTECTED]
Message:
> The more I look at this, the more I believe that mnoGoSearch is not following the
>robots.txt spec.
>
> Comments?
Why did you decide it? Have you any examples of such behaviour?
Actually there was a bug in robots.txt related code, but I thought
it was fixed several releases ago. Which version do you use? How
many indexers do you run at the same time? What is your database?
Please give more information...
Reply: <http://search.mnogo.ru/board/message.php?id=2005>
___________________________________________
If you want to unsubscribe send "unsubscribe general"
to [EMAIL PROTECTED]
