Hi Jack;
Due to I am new to Solr, can you explain this two things that you said:
1) when most people say "index size" they are referring to all fields,
collectively, not individual fields (what do you mean with "Segments are on
a per-field basis" and all fields, individual fields.)
2) more cores
bq: disk space is three times
True, I keep forgetting about compound since I never use it...
On Wed, Apr 10, 2013 at 11:05 AM, Walter Underwood
wrote:
> Correct, except the worst case maximum for disk space is three times. --wunder
>
> On Apr 10, 2013, at 6:04 AM, Erick Erickson wrote:
>
>> You'
On 4/11/2013 7:46 AM, Michael Ryan wrote:
In our system, we use LogByteSizeMergePolicy, and used to have a mergeFactor of
10. We would see the worst case happen when there were exactly 20 segments (or
some other multiple of 10, I believe) at the start of the optimize. IIRC, it
would merge thos
urrent merge policy implementations still have this
issue.
-Michael
-Original Message-
From: Furkan KAMACI [mailto:furkankam...@gmail.com]
Sent: Thursday, April 11, 2013 2:44 AM
To: solr-user@lucene.apache.org
Subject: Re: Approximately needed RAM for 5000 query/second at a Solr
e this
> issue.
> >
> > -Michael
> >
> > -Original Message-----
> > From: Furkan KAMACI [mailto:furkankam...@gmail.com]
> > Sent: Thursday, April 11, 2013 2:44 AM
> > To: solr-user@lucene.apache.org
> > Subject: Re: Approximately needed RAM for
a couple years ago).
>
> I'm not sure if the current merge policy implementations still have this
> issue.
>
> -Michael
>
> -Original Message-
> From: Furkan KAMACI [mailto:furkankam...@gmail.com]
> Sent: Thursday, April 11, 2013 2:44 AM
> To: solr-
#x27;m not sure if the current merge policy implementations still have this issue.
-Michael
-Original Message-
From: Furkan KAMACI [mailto:furkankam...@gmail.com]
Sent: Thursday, April 11, 2013 2:44 AM
To: solr-user@lucene.apache.org
Subject: Re: Approximately needed RAM for 5000 query/s
Hi Walter;
Is there any document or something else says that worst case is three times
of disk space? Twice times or three times. It is really different when we
talk about GB's of disk spaces.
2013/4/10 Walter Underwood
> Correct, except the worst case maximum for disk space is three times.
>
Correct, except the worst case maximum for disk space is three times. --wunder
On Apr 10, 2013, at 6:04 AM, Erick Erickson wrote:
> You're mixing up disk and RAM requirements when you talk
> about having twice the disk size. Solr does _NOT_ require
> twice the index size of RAM to optimize, it re
You're mixing up disk and RAM requirements when you talk
about having twice the disk size. Solr does _NOT_ require
twice the index size of RAM to optimize, it requires twice
the size on _DISK_.
In terms of RAM requirements, you need to create an index,
run realistic queries at the installation and
>> On 4/9/2013 7:03 PM, Furkan KAMACI wrote:
>> > These are really good metrics for me:
>> > You say that RAM size should be at least index size, and it is
>> > better to have a RAM size twice the index size (because of worst
>> > case scenario).
>> > On the other hand let's assume that I have a
Thank you for your explanations, this will help me to figure out my system.
2013/4/10 Shawn Heisey
> On 4/9/2013 9:12 PM, Furkan KAMACI wrote:
> > I am sorry but you said:
> >
> > *you need enough free RAM for the OS to cache the maximum amount of disk
> > space all your indexes will ever use*
>
On 4/9/2013 9:12 PM, Furkan KAMACI wrote:
> I am sorry but you said:
>
> *you need enough free RAM for the OS to cache the maximum amount of disk
> space all your indexes will ever use*
>
> I have made an assumption my indexes at my machine. Let's assume that it is
> 5 GB. So it is better to have
I am sorry but you said:
*you need enough free RAM for the OS to cache the maximum amount of disk
space all your indexes will ever use*
I have made an assumption my indexes at my machine. Let's assume that it is
5 GB. So it is better to have at least 5 GB RAM? OK, Solr will use RAM up
to how much
On 4/9/2013 7:03 PM, Furkan KAMACI wrote:
> These are really good metrics for me:
>
> You say that RAM size should be at least index size, and it is better to
> have a RAM size twice the index size (because of worst case scenario).
>
> On the other hand let's assume that I have a RAM size that is
These are really good metrics for me:
You say that RAM size should be at least index size, and it is better to
have a RAM size twice the index size (because of worst case scenario).
On the other hand let's assume that I have a RAM size that is bigger than
twice of indexes at machine. Can Solr use
On 4/9/2013 4:06 PM, Furkan KAMACI wrote:
Are there anybody who can help me about how to guess the approximately
needed RAM for 5000 query/second at a Solr machine?
You've already gotten some good replies, and I'm aware that they haven't
really answered your question. This is the kind of ques
Thanks for your answer.
2013/4/10 Walter Underwood
> We are using Amazon EC2 M1 Extra Large instances (m1.xlarge).
>
> http://aws.amazon.com/ec2/instance-types/
>
> wunder
>
> On Apr 9, 2013, at 3:35 PM, Furkan KAMACI wrote:
>
> > Hi Walter;
> >
> > Firstly thank for your detailed reply. I know
We are using Amazon EC2 M1 Extra Large instances (m1.xlarge).
http://aws.amazon.com/ec2/instance-types/
wunder
On Apr 9, 2013, at 3:35 PM, Furkan KAMACI wrote:
> Hi Walter;
>
> Firstly thank for your detailed reply. I know that this is not a well
> detailed question but I don't have any metric
Hi Walter;
Firstly thank for your detailed reply. I know that this is not a well
detailed question but I don't have any metrics yet. If we talk about your
system, what is the average RAM size of your Solr machines? Maybe that can
help me to make a comparison.
2013/4/10 Walter Underwood
> On Apr
On Apr 9, 2013, at 3:06 PM, Furkan KAMACI wrote:
> Are there anybody who can help me about how to guess the approximately
> needed RAM for 5000 query/second at a Solr machine?
No.
That depends on the kind of queries you have, the size and content of the
index, the required response time, how fr
Actually I will propose a system and I should figure out about machine
specifications. There will be no faceting mechanism at first, just simple
search queries of a web search engine. We can think that I will have a
commodity server (I don't know is there any benchmark for a usual Solr
machine)
20
It all depends on the nature of your query and the nature of the data in the
index. Does returning results from a result cache count in your QPS? Not to
mention how many cores and CPU speed and CPU caching as well. Not to mention
network latency.
The best way to answer is to do a proof of conc
23 matches
Mail list logo
