Re: Performance if there is a large number of field

2018-05-10 Thread Deepak Goel
Make In India : http://www.makeinindia.com/home On Thu, May 10, 2018 at 10:50 PM, Shawn Heisey <apa...@elyograg.org> wrote: > On 5/10/2018 10:58 AM, Deepak Goel wrote: > >> I wonder what does Solr stores in the document for fields which are not >> being used. And if the qu

Re: Performance if there is a large number of field

2018-05-10 Thread Deepak Goel
I wonder what does Solr stores in the document for fields which are not being used. And if the queries have a performance difference https://lucene.apache.org/solr/guide/6_6/defining-fields.html (A default value that will be added automatically to any document that does not have a value in this

Re: Performance if there is a large number of field

2018-05-11 Thread Deepak Goel
Make In India : http://www.makeinindia.com/home On Fri, May 11, 2018 at 8:15 PM, Shawn Heisey <apa...@elyograg.org> wrote: > On 5/10/2018 2:22 PM, Deepak Goel wrote: > >> Are there any benchmarks for this approach? If not, I can give it a spin. >> Also wondering if there

Re: Performance if there is a large number of field

2018-05-10 Thread Deepak Goel
On Fri, 11 May 2018, 01:15 Shawn Heisey, <apa...@elyograg.org> wrote: > On 5/10/2018 11:49 AM, Deepak Goel wrote: > > Sorry but I am unclear about - "What if there is no default value and the > > field does not contain anything"? What does Solr pass on to Luc

Re: Re[2]: Solr CPU usage

2018-05-16 Thread Deepak Goel
; wrote: > > Master/slave are working on single computer with Intel Core i5 3.2GHz (it > is 4 cores). > > It is standard visualVm ui with CPU usage. I think that it show overall > CPU usage (for all cores). > >Среда, 16 мая 2018, 17:42 +03:00 от Deepak Goel <deic...@gm

Re: Solr CPU usage

2018-05-16 Thread Deepak Goel
How many CPU's do you have in master/slave? The graphs shown by you are for 'a single CPU' or 'All the CPU'? Deepak "The greatness of a nation can be judged by the way its animals are treated. Please stop cruelty to Animals, become a Vegan" +91 73500 12833 deic...@gmail.com Facebook:

Re: Thoughts on scaling strategy for Solr deployed on AWS EC2 instances - Scale up / out and which instance type?

2018-05-21 Thread Deepak Goel
On Mon, May 21, 2018 at 7:55 PM, Kelly, Frank wrote: > Using Solr 5.3.1 - index > > We have an indexing heavy workload (we do more indexing than searching) > and for those searches we do perform we have very few cache hits (25% of > our index is in memory and the hit rate

Re: Navigating through Solr Source Code

2018-05-21 Thread Deepak Goel
If you can find out how Solr evolved over the years, you can perhaps follow that same path On Mon, 21 May 2018, 18:35 Erick Erickson, wrote: > Another useful trick is the class hierarchy displays most modern IDE's > have available to get a sense of what class is where.

Re: Getting more documents from resultsSet

2018-05-18 Thread Deepak Goel
I wonder if in-memory-filesystem would help... On Sat, 19 May 2018, 01:03 Erick Erickson, wrote: > If you only return fields that are docValue=true that'll largely > eliminate the disk seeks. 30 seconds does seem kind of excessive even > with disk seeks though. > >

Re: Hardware-Aware Solr Coud Sharding?

2018-06-12 Thread Deepak Goel
What does your base hardware configuration look like? You could have several VM's on machines with higher configuration. Deepak "The greatness of a nation can be judged by the way its animals are treated. Please consider stopping the cruelty by becoming a Vegan" +91 73500 12833

Re: 7.3.1 creates thousands of threads after start up

2018-06-08 Thread Deepak Goel
Do these machines have a firewall in-between? On Fri, 8 Jun 2018, 20:29 Markus Jelsma, wrote: > Hello Shawn, > > The logs appear useless, they are littered with these: > > 2018-06-08 14:02:47.382 ERROR (qtp1458849419-1263) [ ] > o.a.s.s.HttpSolrCall null:org.apache.solr.common.SolrException:

Re: Slower queries with 7.3.1?

2018-05-26 Thread Deepak Goel
Is it possible to profile the code to find the exact points which are taking more time comparatively? On Sun, 27 May 2018, 06:02 Will Currie, wrote: > I raised https://issues.apache.org/jira/browse/SOLR-12407. In case anybody > else sees a similar slowdown with boosts. > > On

Re: Windows monitoring software for Solr recommendation

2018-06-06 Thread Deepak Goel
It would be a bit extensive, but would be interesting to know if a similar error/situation occurs in Linux too (there are kernel level debugging tools available for this open source OS) On Wed, 6 Jun 2018, 10:59 Shawn Heisey, wrote: > On 6/5/2018 10:26 PM, TK Solr wrote: > > I visualized the GC

Re: SolrCloud Heterogenous Hardware setup

2018-05-01 Thread Deepak Goel
I had a similar problem some time back. Although it might not be the best way, but I used cron to move data from a high-end-spec to a lower-end-spec. It worked beautifully Deepak "The greatness of a nation can be judged by the way its animals are treated. Please stop cruelty to Animals, become

Re: Shard size variation

2018-04-30 Thread Deepak Goel
Could you please also give the machine details of the two clouds you are running? Deepak "The greatness of a nation can be judged by the way its animals are treated. Please stop cruelty to Animals, become a Vegan" +91 73500 12833 deic...@gmail.com Facebook: https://www.facebook.com/deicool

Newbie Question

2018-01-08 Thread Deepak Goel
Hello *I am trying to search for documents in my collection (Shakespeare). The code is as follows:* SolrClient client = new HttpSolrClient.Builder(" http://localhost:8983/solr/shakespeare;).build(); SolrDocument doc = client.getById("2"); *However this does not return any document. What mistake

Re: Newbie Question

2018-01-08 Thread Deepak Goel
On Mon, Jan 8, 2018 at 10:55 PM, Alexandre Rafalovitch <arafa...@gmail.com> wrote: > I think you are missing /query handler endpoint in the URL. Plus actual > search parameters. > > You may try using the admin UI to build your queries first. > > Regards, > Alex > > On

Re: Newbie Question

2018-01-08 Thread Deepak Goel
Got it . Thank You for your help Deepak "Please stop cruelty to Animals, help by becoming a Vegan" +91 73500 12833 deic...@gmail.com Facebook: https://www.facebook.com/deicool LinkedIn: www.linkedin.com/in/deicool "Plant a Tree, Go Green" On Mon, Jan 8, 2018 at 11:48 P

Re: Newbie Question

2018-01-09 Thread Deepak Goel
om/email-signature?utm_medium=email_source=link_campaign=sig-email_content=webmail> Virus-free. www.avg.com <http://www.avg.com/email-signature?utm_medium=email_source=link_campaign=sig-email_content=webmail> <#DAB4FAD8-2DD7-40BB-A1B8-4E2AA1F9FDF2> Deepak "Please sto

Solr Exception: Undefined Field

2018-01-17 Thread Deepak Goel
*Hello* *In Solr Admin: I type the q parameter as - * *text_entry:** *It gives the following exception (In the schema I do see a field as text_entry):* { "responseHeader":{ "zkConnected":true, "status":400, "QTime":2, "params":{ "q":"text_entry:*", "_":"1516190134181"}}, "error":{ "metadata":[

Re: Solr Exception: Undefined Field

2018-01-18 Thread Deepak Goel
er":"13", "line_number":"3.3.37", "speaker":"HENRY BOLINGBROKE", "text_entry":"Henry Bolingbroke", "id":"9428c765-a4e8-4116-937a-9b70e8a8e2de", "_version_":1588569205789163522, "speaker_str&q

Re: query response time is too high

2018-01-29 Thread Deepak Goel
FYI. I recently did a study on 'Performance of Solr' https://www.linkedin.com/pulse/performance-comparison-solr-elasticsearch-deepak-goel/?trackingId=N2j9xWvVEQQaZYa%2BoEsy%2Bw%3D%3D Deepak "Please stop cruelty to Animals, help by becoming a Vegan" +91 73500 12833 deic...@gmail.com

Re: Solr4 To Solr6 CPU load issues

2018-02-12 Thread Deepak Goel
I would suggest to keep the load same both for solr4 and solr6. And then test. Also please post exact concurrent hits On 12 Feb 2018 12:48, "~$alpha`" wrote: When both solr4 and solr6 have concurrent hits: 1. 30 to 40 : Avg response time 470ms vs 380ms Load

Re: Solr4 To Solr6 CPU load issues

2018-02-12 Thread Deepak Goel
This would then mean that solr6 is reaching some kind of saturation (number of threads, etc) at about loads of 60 Hits which then drives the performance of it to be very bad ! Deepak "Please stop cruelty to Animals, help by becoming a Vegan" +91 73500 12833 deic...@gmail.com Facebook:

Re: Solr4 To Solr6 CPU load issues

2018-02-12 Thread Deepak Goel
Please test for higher number of hits till cpu load reaches 100% On 12 Feb 2018 19:44, "~$alpha`" wrote: > Hits 41 : > Avg response time470ms vs 380ms > CPU Load reaches6 vs 10 > > Hits 82: > Avg response time 500ms vs 620ms

Re: Solr4 To Solr6 CPU load issues

2018-02-12 Thread Deepak Goel
One more idea could be is to have multiple vm's (8 cpu each) on your server and load balance them. That would help Solr6 scale nicely On 12 Feb 2018 23:05, "Deepak Goel" <deic...@gmail.com> wrote: > If the community cannot help, the only way i can think is either to > pro

Re: Solr4 To Solr6 CPU load issues

2018-02-12 Thread Deepak Goel
If the community cannot help, the only way i can think is either to profile Solr (java) under a load test to find the problem. You could also use an APM. On 12 Feb 2018 23:00, "~$alpha`" wrote: > Yes, but how to move ahead now. > Its strange solr4 is better behaving

Re: Solr4 To Solr6 CPU load issues

2018-02-11 Thread Deepak Goel
Two things trouble me: 1. It is a shared resource, so results are unreliable 2. Since cache results have increased, memory access will increase and it will result in an increase in cpu usage. However response times will also improve To support more load you will have to increase server capacity

Re: Solr4 To Solr6 CPU load issues

2018-02-11 Thread Deepak Goel
Can you please give the configuration of your server? On 11 Feb 2018 19:17, "~$alpha`" wrote: > I have upgraded Solr4.0 Beta to Solr6.6. The Cache results look Awesome but > overall the CPU load on solr6.6 is double the load on solr4.0 and hence I > am > not able to roll

Re: Solr4 To Solr6 CPU load issues

2018-02-11 Thread Deepak Goel
Also can you please post the throughputs for both of your tests On 12 Feb 2018 00:35, "Deepak Goel" <deic...@gmail.com> wrote: > Yup. Improvement of response time would hurt the cpu usage. The other > thing is more memory usage (cache) which gets included into the cpu

Re: Solr4 To Solr6 CPU load issues

2018-02-11 Thread Deepak Goel
Yup. Improvement of response time would hurt the cpu usage. The other thing is more memory usage (cache) which gets included into the cpu usage. Deepak "Please stop cruelty to Animals, help by becoming a Vegan" +91 73500 12833 deic...@gmail.com Facebook: https://www.facebook.com/deicool

Re: Indexing timeout issues with SolrCloud 7.1

2018-02-23 Thread Deepak Goel
Can you please post all the errors? The current error is only for the node 'solr-2d' On 23 Feb 2018 09:42, "Tom Peters" wrote: I'm trying to debug why indexing in SolrCloud 7.1 is having so many issues. It will hang most of the time, and timeout the rest. Here's an

Re: Indexing timeout issues with SolrCloud 7.1

2018-02-24 Thread Deepak Goel
79060 > On Feb 23, 2018, at 4:15 PM, Deepak Goel <deic...@gmail.com> wrote: > > Can you please post all the errors? The current error is only for the node > 'solr-2d' > > On 23 Feb 2018 09:42, "Tom Peters" <tpet...@synacor.com> wrote: > > I'm tryin

Re: Some performance questions....

2018-03-11 Thread Deepak Goel
To rephrase your Question "Does Solr do well with Scale-up or Scale-out?" Are there any Performance Benchmarks for the same out there supporting the claim? On 11 Mar 2018 23:05, "BlackIce" wrote: > Hi, > > I have some questions regarding performance. > > Lets says I

Re: Some performance questions....

2018-03-11 Thread Deepak Goel
On 12 Mar 2018 05:51, "Shawn Heisey" wrote: On 3/11/2018 11:35 AM, BlackIce wrote: > I have some questions regarding performance. > > Lets says I have a dual CPU with a total of 8 cores and 24 GB RAM for my > Solr and some other stuff. > > Would it be more beneficial to

Re: Some performance questions....

2018-03-12 Thread Deepak Goel
found this for running multiple apache servers on multiple VMs as compared to a single instance (not Solr). But i am pretty sure it would be same for Solr too On 12 Mar 2018 12:42, "Shawn Heisey" <apa...@elyograg.org> wrote: > On 3/11/2018 7:39 PM, Deepak Goel wrote: > >

Re: Some performance questions....

2018-03-12 Thread Deepak Goel
much thought to Solr, asides shemal.xml and > solrconfig.xml > > and I'm just diving into a bit more deeper stuff! > > > > Greetz > > > > RRK > > > > On Sun, Mar 11, 2018 at 8:58 PM, Deepak Goel <deic...@gmail.com> wrote: > > > >> To

Re: Some performance questions....

2018-03-12 Thread Deepak Goel
t;BlackIce" <blackice...@gmail.com> wrote: > > > OK, so we're gone nowhere, since I've already lost lots of time... A > few > > days more or less won't make a difference I'd be willing to > benchmark > > if some tells me how to. > > > > &g

Re: Some performance questions....

2018-03-14 Thread Deepak Goel
> for now.. collect some logs and then do some testing further down the > road. > > For now just get the sucker up and running. > > > > Thanks all > > > > On Mon, Mar 12, 2018 at 7:23 PM, Deepak Goel <deic...@gmail.com> wrote: > > > >

Re: Some performance questions....

2018-03-15 Thread Deepak Goel
Please see inline... Deepak "Please stop cruelty to Animals, help by becoming a Vegan" +91 73500 12833 deic...@gmail.com Facebook: https://www.facebook.com/deicool LinkedIn: www.linkedin.com/in/deicool "Plant a Tree, Go Green" On Thu, Mar 15, 2018 at 6:04 PM, BlackIce

Re: Some performance questions....

2018-03-14 Thread Deepak Goel
Have you measured the overhead of VM anytime? Or have you read it somewhere? On 14 Mar 2018 18:10, "BlackIce" <blackice...@gmail.com> wrote: > but it should be possible, without the overhead of VM's > > On Wed, Mar 14, 2018 at 1:30 PM, Deepak Goel <deic...@gm

Re: Solr OOM Crashes / JVM tuning advice

2018-04-11 Thread Deepak Goel
A few observations: 1. The Old Gen Heap on 9th April is about 6GB occupied which then runs up to 9+GB on 10th April (It steadily increases throughout the day) 2. The Old Gen GC is never able to reclaim any free memory Deepak "Please stop cruelty to Animals, help by becoming a Vegan" +91 73500

Re: Performance & CPU Usage of 6.2.1 vs 6.5.1 & above

2018-04-17 Thread Deepak Goel
Please post the exact results. Many a times the high cpu utilisation may be a boon as it improves query response times On Tue, 17 Apr 2018, 13:55 mganeshs, wrote: > Regarding query times, we couldn't see big improvements. Both are more or > less same. > > Our main worry is

Re: Performance & CPU Usage of 6.2.1 vs 6.5.1 & above

2018-04-16 Thread Deepak Goel
Do you see a performance improvement in your 'Query Times' (6.2.1 vis-a-vis 6.5.1)? Deepak "Please stop cruelty to Animals, help by becoming a Vegan" +91 73500 12833 deic...@gmail.com Facebook: https://www.facebook.com/deicool LinkedIn: www.linkedin.com/in/deicool "Plant a Tree, Go Green"

Re: Performance & CPU Usage of 6.2.1 vs 6.5.1 & above

2018-04-19 Thread Deepak Goel
ce with > 6.2.1 > and re-indexed all the data, and it is working very well, even with the > settings I had initially used. / > > Is anyone else facing this issue or any fixes got released in future build > for this ? > > Keep us posted > > > Deepak Goel wrote > >

Re: Some performance questions....

2018-03-24 Thread Deepak Goel
Deepak "Please stop cruelty to Animals, help by becoming a Vegan" +91 73500 12833 deic...@gmail.com Facebook: https://www.facebook.com/deicool LinkedIn: www.linkedin.com/in/deicool "Plant a Tree, Go Green" On Sat, Mar 24, 2018 at 6:03 AM, Rick Leir wrote: > > > Deep, >

Re: Some performance questions....

2018-03-24 Thread Deepak Goel
.org> wrote: > On 3/23/2018 11:31 AM, Deepak Goel wrote: > > Do you have any specific questions about the benchmark setup? > > How many docs are in the Solr index? How much disk space does it > consume? How much total memory is in the machine? How much memory is > alloca

Re: Some performance questions....

2018-03-24 Thread Deepak Goel
.org> wrote: > On 3/23/2018 1:13 PM, Deepak Goel wrote: > > Yes I am now creating a client object only once. On Linux it has superb > > results (performance improves by around two times). However on Windows it > > has no improvement > > > > *SoftwareThroughput (/sec

Re: Some performance questions....

2018-03-24 Thread Deepak Goel
.org> wrote: > On 3/24/2018 1:25 PM, Deepak Goel wrote: > >> Please check the section *Questions from ‘Around the World’* in the >> following doc for answers to your questions: >> >> *https://docs.google.com/document/d/1ZwyveG-Zjy7tbsvh9xjMug4 >> bnIMRqKn

Re: Some performance questions....

2018-03-24 Thread Deepak Goel
On 25 Mar 2018 6:49 am, "Shawn Heisey" <apa...@elyograg.org> wrote: On 3/24/2018 6:21 PM, Deepak Goel wrote: > Do you have any documented proof of the same (1 to 5ms)? Or is it an > educated guess > Just now, I did a test. I did a "*:*" query (all do

Re: Some performance questions....

2018-03-25 Thread Deepak Goel
Deepak "Please stop cruelty to Animals, help by becoming a Vegan" +91 73500 12833 deic...@gmail.com Facebook: https://www.facebook.com/deicool LinkedIn: www.linkedin.com/in/deicool "Plant a Tree, Go Green" On Sun, Mar 25, 2018 at 2:24 PM, Shawn Heisey wrote: > On

Re: Some performance questions....

2018-03-25 Thread Deepak Goel
<apa...@elyograg.org> wrote: > On 3/25/2018 7:15 AM, Deepak Goel wrote: > >> $ Why is the 'qps' not increasing with increase in threads? (If I >> understand the qps parameter right?) >> > > Likely because I sent all these queries to a single copy of the index. We

Re: Some performance questions....

2018-03-16 Thread Deepak Goel
un...@wunderwood.org> wrote: > On Mar 16, 2018, at 6:38 AM, Deepak Goel <deic...@gmail.com> wrote: > > > > I did a performance study of Solr a while back. And I found that it does > > not scale beyond a particular point on a single machine (could be due to >

Re: Some performance questions....

2018-03-16 Thread Deepak Goel
> On Mar 16, 2018, at 6:26 AM, Deepak Goel <deic...@gmail.com> wrote: > > I would try multiple Solr instances rather a single Solr instance (it > definitely will give a performance boost) > I would avoid multiple Solr instances on single machine. I can use all 36 cores on our

Re: Some performance questions....

2018-03-16 Thread Deepak Goel
On Fri, Mar 16, 2018 at 6:03 PM, Shawn Heisey wrote: > On 3/15/2018 6:34 AM, BlackIce wrote: > >> However the main app that will be >> running is more or less a single threated app which takes advantage when >> run under several instances, ie: parallelism, so I thought,

Re: Some performance questions....

2018-03-16 Thread Deepak Goel
On Sat, Mar 17, 2018 at 1:06 AM, Shawn Heisey <apa...@elyograg.org> wrote: > On 3/16/2018 7:38 AM, Deepak Goel wrote: > > I did a performance study of Solr a while back. And I found that it does > > not scale beyond a particular point on a single machine (could be due to

Re: Some performance questions....

2018-03-16 Thread Deepak Goel
On Sat, Mar 17, 2018 at 3:11 AM, Walter Underwood <wun...@wunderwood.org> wrote: > > On Mar 16, 2018, at 1:21 PM, Deepak Goel <deic...@gmail.com> wrote: > > > > However a single client object with thousands of queries coming in would > > surely become a bott

Re: Some performance questions....

2018-03-16 Thread Deepak Goel
On Sat, Mar 17, 2018 at 2:56 AM, Shawn Heisey <apa...@elyograg.org> wrote: > On 3/16/2018 2:21 PM, Deepak Goel wrote: > > I wanted to test how many max connections can Solr handle concurrently. > > Also I would have to implement an 'connection pooling' of the > clien

Re: Some performance questions....

2018-03-21 Thread Deepak Goel
.@wunderwood.org> wrote: > > On Mar 17, 2018, at 3:23 AM, Deepak Goel <deic...@gmail.com> wrote: > > > > Sorry for being rude. But the ' results ' please, not the ' road to the > > results ' > > We have 15 different search collections, all different sizes and all

Re: Some performance questions....

2018-03-21 Thread Deepak Goel
.org> wrote: > On 3/16/2018 2:21 PM, Deepak Goel wrote: > > I wanted to test how many max connections can Solr handle concurrently. > > Also I would have to implement an 'connection pooling' of the > client-object > > connections rather than a single connection thread >

Re: Some performance questions....

2018-03-23 Thread Deepak Goel
.org> wrote: > On 3/23/2018 11:21 AM, Deepak Goel wrote: > >> I tried the above suggestion. The throughput and utilisation remain the > >> same (they dont increase even if I increase the load). The response time > >> comes down. > >> > > Are you still c

Re: Some performance questions....

2018-03-16 Thread Deepak Goel
>I think there is no benefit in having multiple Solr instances on a single >server, unless the heap memory required by the JVM is too big. Deepak*** I would try multiple Solr instances rather a single Solr instance (it definitely will give a performance boost) Deepak*** >And remember that

Re: Some performance questions....

2018-03-17 Thread Deepak Goel
On 17 Mar 2018 05:19, "Walter Underwood" <wun...@wunderwood.org> wrote: > On Mar 16, 2018, at 3:26 PM, Deepak Goel <deic...@gmail.com> wrote: > > Can you please post results of your test? > > Please tell us the tps at 25%, 50%, 75%, 100% of your CPU reso

Re: Some performance questions....

2018-03-23 Thread Deepak Goel
Deepak "Please stop cruelty to Animals, help by becoming a Vegan" +91 73500 12833 deic...@gmail.com Facebook: https://www.facebook.com/deicool LinkedIn: www.linkedin.com/in/deicool "Plant a Tree, Go Green" On Thu, Mar 22, 2018 at 1:25 AM, Deepak Goel <deic...@gmail.com>

Re: Some performance questions....

2018-03-23 Thread Deepak Goel
.org> wrote: > On 3/16/2018 4:24 PM, Deepak Goel wrote: > > It is taking less than 100ms to create a HttpSolrClient Object > > "Less than 100ms" is vague. Let's say by that you mean it takes at > least 50 milliseconds. This is a lot slower than I expec

Re: Slow Response for less volume

2018-10-24 Thread Deepak Goel
Are you getting errors in Jmeter? On Wed, 24 Oct 2018, 21:49 Amjad Khan, wrote: > Hi, > > We recently moved to Solr Cloud (Google) with 4 nodes and have very > limited number of data. > > We are facing very weird issue here, solr cluster response time for query > is high when we have less

Re: searching is slow while adding document each time

2018-10-28 Thread Deepak Goel
What are your hardware utilisations (cpu, memory, disk, network)? I think you might have to tune lucene too On Wed, 26 Sep 2018, 14:33 Mugeesh Husain, wrote: > Hi, > > We are running 3 node solr cloud(4.4) in our production infrastructure, We > recently moved our SOLR server host softlayer to

Re: SolrCloud scaling/optimization for high request rate

2018-10-30 Thread Deepak Goel
ny kind of delay... > > ** Can you provide graphs for cpu iowait too? (For large timeframes) ** > On 30.10.18 10:21, Deepak Goel wrote: > > Yes. Swapping from disk to memory & vice versa > > > Deepak > "The greatness of a nation can be judged by the way its

Re: SolrCloud scaling/optimization for high request rate

2018-10-30 Thread Deepak Goel
k to memory, or something else? > > On 29.10.18 17:20, Deepak Goel wrote: > > I would then suspect performance is choking in memory disk layer. can you > please check the performance? > > On Mon, 29 Oct 2018, 20:30 Sofiya Strochyk, wrote: > >> Hi Deepak and thanks for your repl

Re: SolrCloud scaling/optimization for high request rate

2018-10-27 Thread Deepak Goel
On Fri, Oct 26, 2018 at 9:25 PM Sofiya Strochyk wrote: > Hi everyone, > > We have a SolrCloud setup with the following configuration: > >- 4 nodes (3x128GB RAM Intel Xeon E5-1650v2, 1x64GB RAM Intel Xeon >E5-1650v2, 12 cores, with SSDs) >- One collection, 4 shards, each has only a

Re: SolrCloud performance

2018-11-02 Thread Deepak Goel
Please see inline for my thoughts Deepak "The greatness of a nation can be judged by the way its animals are treated. Please consider stopping the cruelty by becoming a Vegan" +91 73500 12833 deic...@gmail.com Facebook: https://www.facebook.com/deicool LinkedIn: www.linkedin.com/in/deicool

Re: Index optimization takes too long

2018-11-03 Thread Deepak Goel
I would start by monitoring the hardware (CPU, Memory, Disk) & software (heap, threads) utilization's and seeing where the bottlenecks are. Or what is getting utilized the most. And then tune that parameter. I would also look at profiling the software. Deepak "The greatness of a nation can be

Re: Slow import from MsSQL and down cluster during process

2018-10-24 Thread Deepak Goel
Please check if there is a deadlock happening by taking heap dumps Deepak "The greatness of a nation can be judged by the way its animals are treated. Please consider stopping the cruelty by becoming a Vegan" +91 73500 12833 deic...@gmail.com Facebook: https://www.facebook.com/deicool

Re: SolrCloud scaling/optimization for high request rate

2018-10-29 Thread Deepak Goel
I would then suspect performance is choking in memory disk layer. can you please check the performance? On Mon, 29 Oct 2018, 20:30 Sofiya Strochyk, wrote: > Hi Deepak and thanks for your reply, > > On 27.10.18 10:35, Deepak Goel wrote: > > > Last, what is the natu

Re: one node too busy

2018-11-27 Thread Deepak Goel
You might have to use a APM tool (AppDynamics) to debug the busy solr instance Deepak "The greatness of a nation can be judged by the way its animals are treated. Please consider stopping the cruelty by becoming a Vegan" +91 73500 12833 deic...@gmail.com Facebook:

Re: Solrcloud TimeoutException: Idle timeout expired

2019-01-29 Thread Deepak Goel
Document is not being passed. It has zero content. It could be due to no memory in heap. For this please check GC logs On Tue, 29 Jan 2019, 08:54 Schaum Mallik I am seeing this error in our logs. Our Solr heap is set to more than 10G. > Any clues which anyone can provide will be very helpful. >

Re: Throughput does not increase in spite of low CPU usage

2019-09-30 Thread Deepak Goel
eMillis=250 > -XX:InitiatingHeapOccupancyPercent=75 > -XX:+UseLargePages > -XX:+AggressiveOpts > -Xmx32G > -Xms32G > -Xss256k > > > Thanks & Regards > Yasufumi. > > 2019年9月30日(月) 16:12 Deepak Goel : > > > Hello > > > > Can you please

Re: Throughput does not increase in spite of low CPU usage

2019-09-30 Thread Deepak Goel
Hello Can you please share the JVM heap settings in detail? Deepak On Mon, 30 Sep 2019, 11:15 Yasufumi Mizoguchi, wrote: > Hi, > > I am trying some tests to confirm if single Solr instance can perform over > 1000 queries per second(!). > > But now, although CPU usage is 40% or so and iowait