Recently, Aengus squawked:

> Are you sure you've got the syntax right - those engines are usually
> well behaved wrt  robots.txt

yeah, I copied it from, in this case, the google-bot page on robots
dot text ...

however, I allowed pages and *try* to disallow caching the jpegs ...
so, I guess I can't really say *if* they are abiding or not based on
seeing them call up html pages.


> This question was addressed last week on that list.
> http://lists.meer.net/pipermail/analog-help/2006-March/thread.html#19446

hey, thanks ... I didn't know THAT list existed and will subsequently
join it.

-- 

Regards,
Robert D.

Firefox 1.5
WinME
rmagic
qdns
analog


_______________________________________________
This is the reportmagic-help mailing list
To change your subscription or other preferences use this URL:
   http://reportmagic.org/cgi-bin/mailman/listinfo/reportmagic-help

Reply via email to