Get the same problem with 3.1.19 in cache mode, but not in mysql crc-multi
: robots.txt appears in the results, and with a very high relevancy !
I have drop the cache mode database, because of too many problems (seg
fault discussed earlier).
Francois
>Why do you thinks that robots.txt are indexed?
>
>> Hi,
>>
>> I have installed and working:
>> version 3.1.19
>> Robots yes
>>
>> Indexer is set to index Server path and Server world, working fine.
>>
>> In my search results some robots.txt files seem to have been indexed
themselves instead of the index.html or index.htm file.
>>
>> How can I prevent robots.txt files from being indexed themselves,
without losing the option to read robots.txt first?
>>
>> Jan Paul
>
>Reply: <http://www.mnogosearch.org/board/message.php?id=3161>
>
>___________________________________________
>If you want to unsubscribe send "unsubscribe general"
>to [EMAIL PROTECTED]
>
>
>
___________________________________________
If you want to unsubscribe send "unsubscribe general"
to [EMAIL PROTECTED]
