Author: Tim Hewitt
Email: [EMAIL PROTECTED]
Message:
Thanks, I think that will be great!
I see that this particular document does not include the Allow directive - though it's
in other places on that website.
I do believe there is a problem with your current implementation of Disallow however.
>From that same page:
Disallow
The value of this field specifies a partial URL that is not to be visited. This can be
a full path, or a partial path; any URL that starts with this value will not be
retrieved. For example, Disallow: /help disallows both /help.html and
/help/index.html, whereas Disallow: /help/ would disallow /help/index.html but allow
/help.html.
The partial URL is not being used today.
If I specify
/member.php
as a partial URL to disallow, you will index the file:
/member.php?s=asdasd
and clearly this should not be indexed as the partial URL matches.
I should even be able to disallow:
/member
and get the same behavior - however this does not work today.
Please consider changing this behavior when you address the Allow directive as well.
Thanks,
-Tim
Reply: <http://search.mnogo.ru/board/message.php?id=2092>
___________________________________________
If you want to unsubscribe send "unsubscribe general"
to [EMAIL PROTECTED]
