Aaron Andersen wrote:

> And one of the rules (although perhaps not written out because it is so 
> completely obvious) is that a user agent doesn't go and ask web servers 
> for random files just because there might possibly be a file with that 
> name that would be useful.  It just isn't right.

Not random files. A completely, 100%, entirely predictable file.

And for a useful precedent: robots.txt

The rhetoric on this thread is crazy.

-- Mike


Reply via email to