On 5/4/2012 8:10 PM, Lance Norskog wrote:
Optimize takes a 'maxSegments' option. This tells it to stop when
there are N segments instead of just one.
If you use a very high mergeFactor and then call optimize with a sane
number like 50, it only merges the little teeny segments.
When I
Optimize takes a 'maxSegments' option. This tells it to stop when
there are N segments instead of just one.
If you use a very high mergeFactor and then call optimize with a sane
number like 50, it only merges the little teeny segments.
On Thu, May 3, 2012 at 8:28 PM, Shawn Heisey
Great, thanks Otis and Erick for your responses
I will take a look at SPM
Thanks
Prabhu
-Original Message-
From: Otis Gospodnetic [mailto:otis_gospodne...@yahoo.com]
Sent: 03 May 2012 00:02
To: solr-user@lucene.apache.org
Subject: Re: Solr Merge during off peak times
Hello Prabhu
May 2012 13:15
To: solr-user@lucene.apache.org
Subject: Re: Solr Merge during off peak times
But again, with a master/slave setup merging should
be relatively benign. And at 200M docs, having a M/S
setup is probably indicated.
Here's a good writeup of mergepolicy
http
On 5/2/2012 5:54 AM, Prakashganesh, Prabhu wrote:
We have a fairly large scale system - about 200 million docs and fairly high
indexing activity - about 300k docs per day with peak ingestion rates of about
20 docs per sec. I want to work out what a good mergeFactor setting would be by
testing
at log files or in the admin UI. Do
you know if this can be done or if there is some tool for this?
Thanks
Prabhu
-Original Message-
From: Otis Gospodnetic [mailto:otis_gospodne...@yahoo.com]
Sent: 01 May 2012 15:12
To: solr-user@lucene.apache.org
Subject: Re: Solr Merge during off peak
.
Do you know if this can be done or if there is some tool for this?
Thanks
Prabhu
-Original Message-
From: Otis Gospodnetic [mailto:otis_gospodne...@yahoo.com]
Sent: 01 May 2012 15:12
To: solr-user@lucene.apache.org
Subject: Re: Solr Merge during off peak times
Hi Prabhu,
I don't
the response times are etc..
Thanks
Prabhu
-Original Message-
From: Erick Erickson [mailto:erickerick...@gmail.com]
Sent: 02 May 2012 12:40
To: solr-user@lucene.apache.org
Subject: Re: Solr Merge during off peak times
Why do you care? Merging is generally a background process, or are
you doing
-Original Message-
From: Erick Erickson [mailto:erickerick...@gmail.com]
Sent: 02 May 2012 12:40
To: solr-user@lucene.apache.org
Subject: Re: Solr Merge during off peak times
Why do you care? Merging is generally a background process, or are
you doing heavy indexing? In a master/slave setup
Subject: Re: Solr Merge during off peak times
But again, with a master/slave setup merging should
be relatively benign. And at 200M docs, having a M/S
setup is probably indicated.
Here's a good writeup of mergepolicy
http://juanggrande.wordpress.com/2011/02/07/merge-policy-internals/
If you're
is more static, perhaps? Thoughts?
Thanks
Prabhu
-Original Message-
From: Erick Erickson [mailto:erickerick...@gmail.com]
Sent: 02 May 2012 13:15
To: solr-user@lucene.apache.org
Subject: Re: Solr Merge during off peak times
But again, with a master/slave setup merging should
: Prakashganesh, Prabhu prabhu.prakashgan...@dowjones.com
To: solr-user@lucene.apache.org solr-user@lucene.apache.org; Otis
Gospodnetic otis_gospodne...@yahoo.com
Sent: Wednesday, May 2, 2012 7:22 AM
Subject: RE: Solr Merge during off peak times
Ok, thanks Otis
Another question on merging
What
Hi Prabhu,
I don't think such a merge policy exists, but it would be nice to have this
option and I imagine it wouldn't be hard to write if you really just base the
merge or no merge decision on the time of day (and maybe day of the week).
Note that this should go into Lucene, not Solr, so if
13 matches
Mail list logo
