> From: Johansen, Roar
> I personally am very interested in finding a reason for this 
> sudden rise.

I suspect that web indexing robots are responsible.
Google, altavista, lycos, etc etc
Lookup documentation on 'robots.txt'

Also, MSIE clients can flag a bookmark for 'offline' viewing,
meaning that the pages (typically to a link-depth of 2..4) are
dowloaded to dedicated local cache.

Another side-effect of this 'offline' process is that MSIE
will typically 'check for updates', which is to say, it
will bombard your site with 'HEAD' requests (i think) or
otherwise find some way of checking if the cached pages
are up-to-date.

As far as I know MSIE respects the suggestions from robots.txt

HTH

~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Get the mailserver that powers this list at http://www.coolfusion.com
Archives: http://www.mail-archive.com/[email protected]/
Unsubscribe: http://www.houseoffusion.com/index.cfm?sidebar=lists

Reply via email to