Re: [Nutch-dev] Using squid as a caching reverse proxy & load balancer

[Doug Cutting]

I've never found the locality of queries to be sufficient to make this 
sort of front-end caching effective.  It takes thousands of unique 
queries to account for just 10% of the traffic.  So you end up spending 
a lot of resources on the cache, and things only get 10% faster.

Doug

Byron Miller wrote:
Is it worthwhile to do this? I could modify the
search.jsp to include a cacheable entry for x amount
of  time.
Since the indexes aren't updated all the time, getting
cached results of a previous query based on the URI
string could help on common searches couldn't it?
I also like the fact that i can keep the nutch java
servers behind on a private network and use squid to
do the interfacing.
Viable or should i spend the squid server money on
more RAM RAM RAM RAM?
-------------------------------------------------------
This SF.Net email is sponsored by: IBM Linux Tutorials
Free Linux tutorial presented by Daniel Robbins, President and CEO of
GenToo technologies. Learn everything from fundamentals to system
administration.http://ads.osdn.com/?ad_id=1470&alloc_id=3638&op=click
_______________________________________________
Nutch-developers mailing list
[EMAIL PROTECTED]
https://lists.sourceforge.net/lists/listinfo/nutch-developers


-------------------------------------------------------
This SF.Net email is sponsored by: IBM Linux Tutorials
Free Linux tutorial presented by Daniel Robbins, President and CEO of
GenToo technologies. Learn everything from fundamentals to system
administration.http://ads.osdn.com/?ad_id=1470&alloc_id=3638&op=click
_______________________________________________
Nutch-developers mailing list
[EMAIL PROTECTED]
https://lists.sourceforge.net/lists/listinfo/nutch-developers