[
https://issues.apache.org/jira/browse/SOLR-4112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13610419#comment-13610419
]
Commit Tag Bot commented on SOLR-4112:
--
[branch_4x commit] Shalin Shekhar Mangar
Hi Erick,
There is a difference in *.fdt and *.fdx files between 14G and 7G files. I
have enclosed the sizes.
I also did add fl=score to the queries and lazy load is configured in
solrconfig.xml but still the performance issues exist.
I am measuring QTime.
I am seeing a huge CPU spike in the
Here are the *.fdt *.fdx file details:
14G files
-rw-rw 1 root root 7784904347 Jan 11 18:38 _12n7.fdt
-rw-rw 1 root root 82947778 Jan 11 18:38 _12n7.fdx
7G files
-rw-rw 1 root root 3162548974 Jan 11 18:57 _43v.fdt
-rw-rw 1 root root1052674 Jan 11 18:56 _43v.fdx
One more update we did try a master slave setup with v4.0 but the query
performance is as bad as the Solr4.1
CPU just spikes after a few minutes of running our test the load average is
more than 300.
load average: 353.46, 242.38, 141.74
Please suggest how this can be improved.
Thanks,
--
The other thing is that we have configured large JVM memory for the Solr
process.
-XX:+UseParallelGC -XX:NewSize=30g -Xms60g -Xmx60g -Xss256k -server
--
View this message in context:
[
https://issues.apache.org/jira/browse/SOLR-4112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13551095#comment-13551095
]
Erick Erickson commented on SOLR-4112:
--
Shalin:
Thanks! Since you did the hard part,
[
https://issues.apache.org/jira/browse/SOLR-4112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13551115#comment-13551115
]
Shalin Shekhar Mangar commented on SOLR-4112:
-
I'm about to do just that. I was
[
https://issues.apache.org/jira/browse/SOLR-4112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13551120#comment-13551120
]
Erick Erickson commented on SOLR-4112:
--
Two minor nits then
[
https://issues.apache.org/jira/browse/SOLR-4112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13551124#comment-13551124
]
Shalin Shekhar Mangar commented on SOLR-4112:
-
Oops, I committed it already
Sausarkar:
When you say the index went from 14G to 7G, did you notice whether the
difference was tin the *.fdt and *.fdx files? That would be due to
compression of stored fields which is now the default If you could,
would you let us know the sizes of the files with those two extensions
We are using solr-meter for generating query load of around 110 Queries per
second per node.
With 4.1 with the average query time is 300 msec if we switch to 4.0 the
average query time is around 11 msec. We used the same load test params and
same 10 million records, only differences are the
We are also hitting this DIH issue in 4.1 this issue was not happening in the
4.0 release. Please let us know when this will be resolved, this is delaying
our SolrCloud implementation release. btw... We tried the night release from
1/1/2013 but this issue is not resolved.
Thanks.
--
View this
You might try the supplied patch against your 4.1 checkout. Manual verification
that it works might prompt a faster commit. Hopefully Shalin or Erick or James
will be able to get to it soon.
- Mark
On Jan 2, 2013, at 6:29 PM, sausarkar sausar...@ebay.com wrote:
We are also hitting this DIH
sausar...@ebay.commailto:sausar...@ebay.com
Subject: Re: [jira] [Commented] (SOLR-4112) Dataimporting with SolrCloud Fails
You might try the supplied patch against your 4.1 checkout. Manual verification
that it works might prompt a faster commit. Hopefully Shalin or Erick or James
will be able
On Jan 7, 2013, at 7:13 PM, sausarkar sausar...@ebay.com wrote:
Hi Mark,
We have applied the patch and reindexed 10 million records. We did a load
test and it seems that the query time per second has increased about 10 times
in the 4.1x version. In the 4.0 version we also noticed that
On 1/7/2013 5:39 PM, Mark Miller wrote:
Interesting. It would be good to try and see if this slowdown is indeed due to
the compression. It's now the default and you can read more about it here:
http://blog.jpountz.net/post/35667727458/stored-fields-compression-in-lucene-4-1
[
https://issues.apache.org/jira/browse/SOLR-4112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13542634#comment-13542634
]
Sauvik Sarkar commented on SOLR-4112:
-
We are stuck with this issue after we upgraded
[
https://issues.apache.org/jira/browse/SOLR-4112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13541364#comment-13541364
]
Erick Erickson commented on SOLR-4112:
--
I _really_ want to insure that this gets into
[
https://issues.apache.org/jira/browse/SOLR-4112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13541372#comment-13541372
]
Shalin Shekhar Mangar commented on SOLR-4112:
-
I can take this up and write
[
https://issues.apache.org/jira/browse/SOLR-4112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13539270#comment-13539270
]
Erick Erickson commented on SOLR-4112:
--
I'm going to go ahead and commit this in a day
[
https://issues.apache.org/jira/browse/SOLR-4112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13532471#comment-13532471
]
Erick Erickson commented on SOLR-4112:
--
I've been working with a client that has this
[
https://issues.apache.org/jira/browse/SOLR-4112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13532498#comment-13532498
]
James Dyer commented on SOLR-4112:
--
Erick, I certainly mean for this to be committed
[
https://issues.apache.org/jira/browse/SOLR-4112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13532530#comment-13532530
]
Mark Miller commented on SOLR-4112:
---
Yup, we already have some base classes that I would
[
https://issues.apache.org/jira/browse/SOLR-4112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13505762#comment-13505762
]
James Dyer commented on SOLR-4112:
--
It looks like all we need for this now is a unit test
[
https://issues.apache.org/jira/browse/SOLR-4112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13505774#comment-13505774
]
Mark Miller commented on SOLR-4112:
---
bq. don't know how to write a good test for
[
https://issues.apache.org/jira/browse/SOLR-4112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13504279#comment-13504279
]
Deniz Durmus commented on SOLR-4112:
As a feedback, would like to say that the patch
26 matches
Mail list logo
