Author: Tim Hewitt
Email: [EMAIL PROTECTED]
Message:
Ivan,
The robots.txt standard clearly states that a disallow of
/tmp
would disallow
/tmp/nextdir/file.html
/tmp.html
/tmpjunk/myfile.html
the disallow directive being used as a prefix for the entire URL to be matched.
/tmp/
would disallow only
/tmp/nextdir/file/html
in my above example.
I don't see where your patch addresses this at all.
Can you give me an example that your code fix addresses?
Thanks,
-Tim
Reply: <http://search.mnogo.ru/board/message.php?id=2122>
___________________________________________
If you want to unsubscribe send "unsubscribe general"
to [EMAIL PROTECTED]
