All,
thanks for good feedback.
Letting the load-balancer route bots to a specific slaves
and humans to others seems like the way forward this
time.
Thanks,
Tobias
2008/9/1 Walter Underwood [EMAIL PROTECTED]
How many documents do you have in your index? How many unique
queries per day, bot
Hi all,
Is there any way to suppress that a certain query gets added to the
caches (or is allowed to affect cache statistics) in Solr?
*Reason:* We have a very search oriented website. The SEO-aspects
of the site is also important why almost the entire search-space is
traversable for indexing
If you are serving cached queries to the bot, what would be the benefit of
suppressing those queries from figuring into the cache statistics page?
On Mon, Sep 1, 2008 at 2:46 PM, Tobias Hill [EMAIL PROTECTED] wrote:
Hi all,
Is there any way to suppress that a certain query gets added to the
Maybe I was a bit unclear, let me try with other words.
I didn't have the statistic-page in mind. All I care about is that I don't
want a massive amount of bot-generated queries affect the internal
statistics of the caches in Solr. If caching would be possible to switch
off for bot-queries the
I get what you are trying to do yes, googlebot essentially fills
up the cache with edge cases.
There is nothing in solr to prevent using the cache for some queries
and not others -- given the way parts of solr works, it is a bad idea
to turn off caching completly (a Document my be
Apart from hacking the internals, there's nothing inside Solr which will let
you do that. EHCache is for application layer caches, Solr is an external
server so it can't know about your application. I think that over a period
of time, the caches will be back to normal (through user-generated
How many documents do you have in your index? How many unique
queries per day, bot and human? What are your cache hit ratios?
Maybe you can increase the size of the caches and not worry about
it. Search engine position is important. Have marketing pay for
the extra memory (I'm not kidding).
