Author: Ivan Mikhnevich
Email: [EMAIL PROTECTED]
Message:
The problem was not in this case.
Current mnoGoSearch implementation will never understand the lines like:
Disallow: /texts/print.phtml
or
Disallow: /forum/index.pl?archive
It does not take into account the filename when checking prefix. For the examples
above the mnoGoSearch will check the Disallow lines with "/texts/" and "/forum/" parts
of corresponding URLs.
The only thing that my path does is making an temporary variable which contains both
the path and the filename. It concatenates them together and then checks for prefixes
with Disallow lines.
It allows to implement a standard, which has some examples with filenames in Disallow
lines.
Reply: <http://search.mnogo.ru/board/message.php?id=2129>
___________________________________________
If you want to unsubscribe send "unsubscribe general"
to [EMAIL PROTECTED]