"Serving up different results based on user agent may cause your site to be
perceived as deceptive and removed from the Google index."
http://www.google.com/support/webmasters/bin/answer.py?hl=en&answer=66355



-----Original Message-----
From: mongrel-users-boun...@rubyforge.org
[mailto:mongrel-users-boun...@rubyforge.org] On Behalf Of Mike Papper
Sent: Wednesday, June 10, 2009 8:42 PM
To: mongrel-users@rubyforge.org
Subject: Re: [Mongrel] Non-Cache Handling for Bots

I am talking about Rails standard page-caching mechanism. Rails by  
default puts full pages into public/... and if mongrel sees them  
there, it serves them (without running rails dispatch et al). This is  
fine for normal but not good for the bot user agents.

Here is a new solution:
1) set rails to cache in public/cache
2) Use Apache rewrite to serve these files directly (if found)
3) If not found, pass to mongrel which will not find the cached files  
either since MONGREL ONLY LOOKS IN public for cached files. Mongrel  
does not honor the config.action_controller.page_cache_directory rails  
setting
4) Rails processes the file and puts it into public/cache/...

...on the next request, apache serves from cache.

I am working on the reqwrite rules etc. for this.

Mike

On Jun 10, 2009, at 6:16 PM, m...@simtone.net wrote:

>
> What kind of caches are you talking about?
> Are these full page caches?  The kind that get stored into /public?
>
> My question is, can you instead of adding /robot to the URL when  
> apache
> finds the robot, can you instead change Apache's DocumentRoot?
> It seems to be that this would prevent apache from finding the cached
> page.  Also, if you actually point to another copy of your /public,  
> you
> could get the normal static pages...
>
> I think perhaps since you are talking about changing mongrel's caching
> behaviour that you aren't talking about the page caches that get  
> stored
> into /public. (Well, I'm rusty on terminology here)
>
> -- 
> Michael Richardson <m...@simtone.net>
> Director -- Consumer Desktop Development, Simtone Corporation,  
> Ottawa, Canada
> Personal: http://www.sandelman.ca/mcr/
>
> SIMtone Corporation fundamentally transforms computing into simple,
> secure, and very low-cost network-provisioned services pervasively
> accessible by everyone.  Learn more at www.simtone.net and
www.SIMtoneVDU.com
>
>

_______________________________________________
Mongrel-users mailing list
Mongrel-users@rubyforge.org
http://rubyforge.org/mailman/listinfo/mongrel-users

_______________________________________________
Mongrel-users mailing list
Mongrel-users@rubyforge.org
http://rubyforge.org/mailman/listinfo/mongrel-users

Reply via email to