Recently, Aengus squawked:
> Are you sure you've got the syntax right - those engines are usually
> well behaved wrt robots.txt
yeah, I copied it from, in this case, the google-bot page on robots
dot text ...
however, I allowed pages and *try* to disallow caching the jpegs ...
so, I guess I can't really say *if* they are abiding or not based on
seeing them call up html pages.
> This question was addressed last week on that list.
hey, thanks ... I didn't know THAT list existed and will subsequently
This is the reportmagic-help mailing list
To change your subscription or other preferences use this URL: