Author: Ivan Mikhnevich
Email: [EMAIL PROTECTED]
Message:
The problem was not in this case.
Current mnoGoSearch implementation will never understand the lines like:

Disallow: /texts/print.phtml

or

Disallow: /forum/index.pl?archive

It does not take into account the filename when checking prefix. For the examples 
above the mnoGoSearch will check the Disallow lines with "/texts/" and "/forum/" parts 
of corresponding URLs.

The only thing that my path does is making an temporary variable which contains both 
the path and the filename. It concatenates them together and then checks for prefixes 
with Disallow lines.

It allows to implement a standard, which has some examples with filenames in Disallow 
lines.

Reply: <http://search.mnogo.ru/board/message.php?id=2129>

___________________________________________
If you want to unsubscribe send "unsubscribe general"
to [EMAIL PROTECTED]

Reply via email to