Re: [infinispan-dev] Staggering remote GET calls

2013-02-26 Thread Manik Surtani
| To: infinispan -Dev List infinispan-dev@lists.jboss.org | Sent: Wednesday, February 20, 2013 3:38:49 PM | Subject: Re: [infinispan-dev] Staggering remote GET calls | | Ouch, call me dumbass... I haven't checked the test results. | Something revoked my cluster allocation and the test

Re: [infinispan-dev] Staggering remote GET calls

2013-02-26 Thread Mircea Markus
On 26 Feb 2013, at 10:56, Manik Surtani wrote: I'm not surprised that read performance suffers a bit actually. Which is why we broadcast the GETs originally. But once the staggering timeout becomes configurable, this should be something people can tune. +1. Also the performance increase

Re: [infinispan-dev] Staggering remote GET calls

2013-02-26 Thread Erik Salter
Tune in real-time, of course ;) Erik From: infinispan-dev-boun...@lists.jboss.org [mailto:infinispan-dev-boun...@lists.jboss.org] On Behalf Of Mircea Markus Sent: Tuesday, February 26, 2013 7:36 AM To: infinispan -Dev List Subject: Re: [infinispan-dev] Staggering remote GET calls

Re: [infinispan-dev] Staggering remote GET calls

2013-02-26 Thread Paolo Romano
*From:*infinispan-dev-boun...@lists.jboss.org [mailto:infinispan-dev-boun...@lists.jboss.org] *On Behalf Of *Mircea Markus *Sent:* Tuesday, February 26, 2013 7:36 AM *To:* infinispan -Dev List *Subject:* Re: [infinispan-dev] Staggering remote GET calls On 26 Feb 2013, at 10:56, Manik Surtani

Re: [infinispan-dev] Staggering remote GET calls

2013-02-26 Thread Manik Surtani
Subject: Re: [infinispan-dev] Staggering remote GET calls On 26 Feb 2013, at 10:56, Manik Surtani wrote: I'm not surprised that read performance suffers a bit actually. Which is why we broadcast the GETs originally. But once the staggering timeout becomes configurable, this should

Re: [infinispan-dev] Staggering remote GET calls

2013-02-21 Thread Radim Vansa
| To: infinispan -Dev List infinispan-dev@lists.jboss.org | Sent: Wednesday, February 20, 2013 3:38:49 PM | Subject: Re: [infinispan-dev] Staggering remote GET calls | | Ouch, call me dumbass... I haven't checked the test results. | Something revoked my cluster allocation and the test was prematurely

Re: [infinispan-dev] Staggering remote GET calls

2013-02-20 Thread Dan Berindei
Radim, just to be sure, you are testing embedded mode with RadarGun, right? With HotRod most of the get operations should be initiated from the main owner, so Manik's changes shouldn't make a big difference in the number of active threads. How about throughput, has it also improved compared to

Re: [infinispan-dev] Staggering remote GET calls

2013-02-20 Thread Radim Vansa
...@gmail.com | To: infinispan -Dev List infinispan-dev@lists.jboss.org | Cc: Manik Surtani msurt...@redhat.com | Sent: Wednesday, February 20, 2013 3:24:46 PM | Subject: Re: [infinispan-dev] Staggering remote GET calls | | | Radim, just to be sure, you are testing embedded mode with RadarGun, | right

Re: [infinispan-dev] Staggering remote GET calls

2013-02-20 Thread Mircea Markus
: [infinispan-dev] Staggering remote GET calls | | | Radim, just to be sure, you are testing embedded mode with RadarGun, | right? With HotRod most of the get operations should be initiated | from the main owner, so Manik's changes shouldn't make a big | difference in the number of active

Re: [infinispan-dev] Staggering remote GET calls

2013-02-20 Thread Mircea Markus
On 20 Feb 2013, at 14:57, Radim Vansa wrote: Only library (embeded) mode, as the load is constant (10 threads issuing requests all the time) I believe that the results are more stable and comparable between runs. Thanks. As Dan suggested, the staggering of requests should ONLY have an

Re: [infinispan-dev] Staggering remote GET calls

2013-02-20 Thread Bela Ban
Excellent ! On 2/20/13 3:15 PM, Radim Vansa wrote: Hi Manik, so I have tried to compile this branch and issued a 20 minute stress test (preceded by 10 minute warmup) on 128 nodes, where each node has 10 stressor threads. While in 5.2.0.CR3 the maximum OOB threadpool size was 553 with this

Re: [infinispan-dev] Staggering remote GET calls

2013-02-20 Thread Manik Surtani
Awesome. :) Mircea, are you going to finish up my patch, make the staggering timeout configurable, etc? Sent from my mobile phone On 20 Feb 2013, at 15:15, Radim Vansa rva...@redhat.com wrote: Hi Manik, so I have tried to compile this branch and issued a 20 minute stress test (preceded

Re: [infinispan-dev] Staggering remote GET calls

2013-02-20 Thread Radim Vansa
Manik, as I have stated in later mails, the test was not executed properly, therefore these good results. Actually, I think there is a bug in the branch, as you set expected responses in FutureCollator to dest.size() but still send only one message, if the first response is not successful but

[infinispan-dev] Staggering remote GET calls

2013-02-19 Thread Manik Surtani
Guys, I have a topic branch with a fix for ISPN-825, to stagger remote GET calls. (See the JIRA for details on this patch). This should have an interesting effect on greatly reducing the pressure on the OOB thread pool. This isn't a *real* fix for the problem that Radim reported (Pedro is