Re: Solr performance issue on querying --> Solr 6.5.1

2017-09-30 Thread sasarun
Hi Erick, As suggested, I did try nonHDFS solr cloud instance and it response looks to be really better. From the configuration side to, I am mostly using default configurations and with block.cache.direct.memory.allocation as false. On analysis of hdfs cache, evictions seems to be on higher

Re: Solr performance issue on querying --> Solr 6.5.1

2017-09-27 Thread Emir Arnautović
Hi Arun, It is hard to measure something without affecting it, but we could use debug results and combine with QTime without debug: If we ignore merging results, it seems that majority of time is spent for retrieving docs (~500ms). You should consider reducing number of rows if you want better

Re: Solr performance issue on querying --> Solr 6.5.1

2017-09-27 Thread sasarun
Hi Emir, Please find the response without bq parameter and debugQuery set to true. Also it was noted that Qtime comes down drastically without the debug parameter to about 700-800. true 0 3446 ("hybrid electric powerplant" "hybrid electric powerplants" "Electric" "Electrical" "Electricity"

Re: Solr performance issue on querying --> Solr 6.5.1

2017-09-27 Thread sasarun
Hi Erick, Qtime comes down with rows set as 1. Also it was noted that qtime comes down when debug parameter is not added with the query. It comes to about 900. Thanks, Arun -- Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html

Re: Solr performance issue on querying --> Solr 6.5.1

2017-09-27 Thread Toke Eskildsen
On Tue, 2017-09-26 at 07:43 -0700, sasarun wrote: > Allocated heap size for young generation is about 8 gb and old  > generation is about 24 gb. And gc analysis showed peak > size utlisation is really low compared to these values. That does not come as a surprise. Your collections would normally

Re: Solr performance issue on querying --> Solr 6.5.1

2017-09-27 Thread Emir Arnautović
Hi Arun, This is not the most simple query either - a dozen of phrase queries on several fields + the same query as bq. Can you provide debugQuery info. I did not look much into debug times and what includes what, but one thing that is strange to me is that QTime is 4s while query in debug is

Re: Solr performance issue on querying --> Solr 6.5.1

2017-09-26 Thread Erick Erickson
Well, 15 second responses are not what I'd expect either. But two things (just looked again) 1> note that the time to assemble the debug information is a large majority of your total time (14 of 15.3 seconds). 2> you're specifying 600 rows which is quite a lot as each one requires that a 16K

Re: Solr performance issue on querying --> Solr 6.5.1

2017-09-26 Thread sasarun
Hi Erick, Thank you for the quick response. Query time was relatively faster once it is read from memory. But personally I always felt response time could be far better. As suggested, We will try and set up in a non HDFS environment and update on the results. Thanks, Arun -- Sent from:

Re: Solr performance issue on querying --> Solr 6.5.1

2017-09-26 Thread Erick Erickson
Does the query time _stay_ low? Once the data is read from HDFS it should pretty much stay in memory. So my question is whether, once Solr warms up you see this kind of query response time. Have you tried this on a non HDFS system? That would be useful to help figure out where to look. And given

Solr performance issue on querying --> Solr 6.5.1

2017-09-26 Thread sasarun
Hi All, I have been using Solr for some time now but mostly in standalone mode. Now my current project is using Solr 6.5.1 hosted on hadoop. My solrconfig.xml has the following configuration. In the prod environment the performance on querying seems to really slow. Can anyone help me with few

Issue with Querying Solr

2015-12-08 Thread Salman Ansari
Hi, I have created a cluster of Solr and Zookeepers on 3 machines connected together. Currently, I am facing a weird problem. My collection has only 261 documents and when I try to query the documents using the browser such as http://

Re: Issue with Querying Solr

2015-12-08 Thread Andrea Gazzarini
I would set up logging in the admin console (queries should be logged out by default), and then check the difference between the two invocations. I don't believe the two clients are doing the *same* thing, there should be some difference. Another chance could be that the OOM is just behind the

Re: Issue with Querying Solr

2015-12-08 Thread Alexandre Rafalovitch
Solr by default only returns 10 rows. SolrNet by default returns many rows. I don't know why that would cause OOM, but that's definitely your difference unless you dealt with it: https://github.com/mausch/SolrNet/blob/master/Documentation/Querying.md#pagination Regards, Alex. Newsletter

Re: Issue with Querying Solr

2015-12-08 Thread Salman Ansari
Thanks Andrea and Alexandre for your responses. Indeed it was the problem that Solr.NET was returning many rows (as I captured this by fiddler). Currently, my setup has only 500MB of JVM (which I will definitely increase) but at least I found the culprit by reducing the number of rows returned.

Re: Issue with Querying Solr

2015-12-08 Thread Don Bosco Durai
You only have 261 documents. That shouldn't be a problem, unless your document size is huge. I feel, the problem still exists somewhere. You have just deferred it... Bosco On Tue, Dec 8, 2015 at 6:48 AM -0800, "Salman Ansari" wrote: Thanks Andrea and