On Fri, 6 Aug 2004, [EMAIL PROTECTED] wrote:

> Have you ever noticed a google resultset entry that didn't have a
> cache link? I don't know if it is something that a publisher can set
> programatically or if it is a business arrangement.

Pages are cached by default.  To get removed you have to request it.

http://www.google.com/help/features.html#cached

> Advertising based news sites will probably be even less appreciative
> of mirroring and caching as more and more of them turn into
> registration based sites.

You misunderstand.  If registration is required, a crawler will fail
anyway, and I don't mean anything but crawler-like behavior with depth
1.  I'm talking about common sense caching, not "how can we defeat
this site so all their content is mirrored."  You could even have a
redirect link that sends you to the cached version iff the original
site is unresponsive, so normal users never know what happened.

Ted
_______________________________________________
Boston-pm mailing list
[EMAIL PROTECTED]
http://mail.pm.org/mailman/listinfo/boston-pm

Reply via email to