Hi Jack;
Due to I am new to Solr, can you explain this two things that you said:
1) when most people say "index size" they are referring to all fields,
collectively, not individual fields (what do you mean with "Segments are on
a per-field basis" and all fields, individual fields.)
2) more cores
bq: disk space is three times
True, I keep forgetting about compound since I never use it...
On Wed, Apr 10, 2013 at 11:05 AM, Walter Underwood
wrote:
> Correct, except the worst case maximum for disk space is three times. --wunder
>
> On Apr 10, 2013, at 6:04 AM, Erick Erickson wrote:
>
>> You'
On 4/11/2013 7:46 AM, Michael Ryan wrote:
In our system, we use LogByteSizeMergePolicy, and used to have a mergeFactor of
10. We would see the worst case happen when there were exactly 20 segments (or
some other multiple of 10, I believe) at the start of the optimize. IIRC, it
would merge thos
urrent merge policy implementations still have this
issue.
-Michael
-Original Message-
From: Furkan KAMACI [mailto:furkankam...@gmail.com]
Sent: Thursday, April 11, 2013 2:44 AM
To: solr-user@lucene.apache.org
Subject: Re: Approximately needed RAM for 5000 query/second at a Solr
e this
> issue.
> >
> > -Michael
> >
> > -Original Message-----
> > From: Furkan KAMACI [mailto:furkankam...@gmail.com]
> > Sent: Thursday, April 11, 2013 2:44 AM
> > To: solr-user@lucene.apache.org
> > Subject: Re: Approximately needed RAM for
a couple years ago).
>
> I'm not sure if the current merge policy implementations still have this
> issue.
>
> -Michael
>
> -Original Message-
> From: Furkan KAMACI [mailto:furkankam...@gmail.com]
> Sent: Thursday, April 11, 2013 2:44 AM
> To: solr-
#x27;m not sure if the current merge policy implementations still have this issue.
-Michael
-Original Message-
From: Furkan KAMACI [mailto:furkankam...@gmail.com]
Sent: Thursday, April 11, 2013 2:44 AM
To: solr-user@lucene.apache.org
Subject: Re: Approximately needed RAM for 5000 query/s
Hi Walter;
Is there any document or something else says that worst case is three times
of disk space? Twice times or three times. It is really different when we
talk about GB's of disk spaces.
2013/4/10 Walter Underwood
> Correct, except the worst case maximum for disk space is three times.
>
Correct, except the worst case maximum for disk space is three times. --wunder
On Apr 10, 2013, at 6:04 AM, Erick Erickson wrote:
> You're mixing up disk and RAM requirements when you talk
> about having twice the disk size. Solr does _NOT_ require
> twice the index size of RAM to optimize, it re
You're mixing up disk and RAM requirements when you talk
about having twice the disk size. Solr does _NOT_ require
twice the index size of RAM to optimize, it requires twice
the size on _DISK_.
In terms of RAM requirements, you need to create an index,
run realistic queries at the installation and
>> On 4/9/2013 7:03 PM, Furkan KAMACI wrote:
>> > These are really good metrics for me:
>> > You say that RAM size should be at least index size, and it is
>> > better to have a RAM size twice the index size (because of worst
>> > case scenario).
>> > On the other hand let's assume that I have a
Thank you for your explanations, this will help me to figure out my system.
2013/4/10 Shawn Heisey
> On 4/9/2013 9:12 PM, Furkan KAMACI wrote:
> > I am sorry but you said:
> >
> > *you need enough free RAM for the OS to cache the maximum amount of disk
> > space all your indexes will ever use*
>
On 4/9/2013 9:12 PM, Furkan KAMACI wrote:
> I am sorry but you said:
>
> *you need enough free RAM for the OS to cache the maximum amount of disk
> space all your indexes will ever use*
>
> I have made an assumption my indexes at my machine. Let's assume that it is
> 5 GB. So it is better to have
I am sorry but you said:
*you need enough free RAM for the OS to cache the maximum amount of disk
space all your indexes will ever use*
I have made an assumption my indexes at my machine. Let's assume that it is
5 GB. So it is better to have at least 5 GB RAM? OK, Solr will use RAM up
to how much
On 4/9/2013 7:03 PM, Furkan KAMACI wrote:
> These are really good metrics for me:
>
> You say that RAM size should be at least index size, and it is better to
> have a RAM size twice the index size (because of worst case scenario).
>
> On the other hand let's assume that I have a RAM size that is
Solr use that extra RAM or is it a
approximately maximum limit (to have twice size of indexes at machine)?
2013/4/10 Shawn Heisey
> On 4/9/2013 4:06 PM, Furkan KAMACI wrote:
>
>> Are there anybody who can help me about how to guess the approximately
>> needed RAM for 5000 query/s
On 4/9/2013 4:06 PM, Furkan KAMACI wrote:
Are there anybody who can help me about how to guess the approximately
needed RAM for 5000 query/second at a Solr machine?
You've already gotten some good replies, and I'm aware that they haven't
really answered your question. This
gt; > 2013/4/10 Walter Underwood
> >
> >> On Apr 9, 2013, at 3:06 PM, Furkan KAMACI wrote:
> >>
> >>> Are there anybody who can help me about how to guess the approximately
> >>> needed RAM for 5000 query/second at a Solr machine?
> >>
&
there anybody who can help me about how to guess the approximately
>>> needed RAM for 5000 query/second at a Solr machine?
>>
>> No.
>>
>> That depends on the kind of queries you have, the size and content of the
>> index, the required response time, how freq
> On Apr 9, 2013, at 3:06 PM, Furkan KAMACI wrote:
>
> > Are there anybody who can help me about how to guess the approximately
> > needed RAM for 5000 query/second at a Solr machine?
>
> No.
>
> That depends on the kind of queries you have, the size and content of the
On Apr 9, 2013, at 3:06 PM, Furkan KAMACI wrote:
> Are there anybody who can help me about how to guess the approximately
> needed RAM for 5000 query/second at a Solr machine?
No.
That depends on the kind of queries you have, the size and content of the
index, the required response tim
t;
> The best way to answer is to do a proof of concept implementation and
> measure it yourself.
>
> -- Jack Krupansky
>
> -Original Message- From: Furkan KAMACI
> Sent: Tuesday, April 09, 2013 6:06 PM
> To: solr-user@lucene.apache.org
> Subject: Approximately nee
concept implementation and
measure it yourself.
-- Jack Krupansky
-Original Message-
From: Furkan KAMACI
Sent: Tuesday, April 09, 2013 6:06 PM
To: solr-user@lucene.apache.org
Subject: Approximately needed RAM for 5000 query/second at a Solr machine?
Are there anybody who can help me
Are there anybody who can help me about how to guess the approximately
needed RAM for 5000 query/second at a Solr machine?
24 matches
Mail list logo
