Recently, Aengus squawked:

> Are you sure you've got the syntax right - those engines are usually
> well behaved wrt  robots.txt

yeah, I copied it from, in this case, the google-bot page on robots
dot text ...

however, I allowed pages and *try* to disallow caching the jpegs ...
so, I guess I can't really say *if* they are abiding or not based on
seeing them call up html pages.

> This question was addressed last week on that list.

hey, thanks ... I didn't know THAT list existed and will subsequently
join it.


Robert D.

Firefox 1.5

This is the reportmagic-help mailing list
To change your subscription or other preferences use this URL:

Reply via email to