[EMAIL PROTECTED] wrote:
> Aaron Andersen wrote:
>> And one of the rules (although perhaps not written out because it is
>> so completely obvious) is that a user agent doesn't go and ask web
>> servers for random files just because there might possibly be a file
>> with that name that would be useful. It just isn't right.
> robots.txt?
Are you saying that Mozilla downloads robots.txt?
--
"They that can give up essential liberty to obtain a little temporary
safety deserve neither liberty nor safety."
-- Benjamin Franklin
