Re: Benchmarking Solr

2013-05-27 Thread Otis Gospodnetic
Hi Benson, We typically use https://github.com/sematext/ActionGenerator As a matter of fact, we are using it right now to test one of our search clusters... Otis -- Solr & ElasticSearch Support http://sematext.com/ On Sun, May 26, 2013 at 10:38 AM, Benson Margulies wrote: > I'd like to run

Re: Benchmarking Solr

2013-05-26 Thread Upayavira
SolrMeter? Upayavira On Sun, May 26, 2013, at 03:38 PM, Benson Margulies wrote: > I'd like to run a repeatable test of having Solr ingest a corpus of > docs on disk, to measure the speed of some alternative things plugged > in. > > Anyone have some advice to share? One approach would be a quick

Re: Benchmarking Solr 3.3 vs. 4.0

2012-11-30 Thread Daniel Exner
Shawn Heisey wrote: [..] For best results, you'll want to ensure that Solr4 is working completely from scratch, that it has never seen a 3.3 index, so that it will use its own native format. That's why I did in the second run. Thanks for clarifying that this is in fact better. :) It may be a

Re: Benchmarking Solr 3.3 vs. 4.0

2012-11-29 Thread Shawn Heisey
On 11/29/2012 8:29 AM, Daniel Exner wrote: I'll answer both your mails in one. Shawn Heisey wrote: On 11/29/2012 3:15 AM, Daniel Exner wrote: I'm currently doing some benchmarking of a real Solr 3.3 instance vs the same ported to Solr 4.0. [..] In the graph you can see high CPU load, all the

Re: Benchmarking Solr 3.3 vs. 4.0

2012-11-29 Thread Daniel Exner
I'll answer both your mails in one. Shawn Heisey wrote: On 11/29/2012 3:15 AM, Daniel Exner wrote: I'm currently doing some benchmarking of a real Solr 3.3 instance vs the same ported to Solr 4.0. [..] In the graph you can see high CPU load, all the time. This is even the case if I reduce the

Re: Benchmarking Solr 3.3 vs. 4.0

2012-11-29 Thread Shawn Heisey
On 11/29/2012 3:15 AM, Daniel Exner wrote: I'm currently doing some benchmarking of a real Solr 3.3 instance vs the same ported to Solr 4.0. Another note specifically related to this part: Have you used the same configuration and done the minimal changes required to make it run, or have you t

Re: Benchmarking Solr 3.3 vs. 4.0

2012-11-29 Thread Shawn Heisey
On 11/29/2012 3:15 AM, Daniel Exner wrote: I'm currently doing some benchmarking of a real Solr 3.3 instance vs the same ported to Solr 4.0. Benchmarking is done using JMeter from localhost. Test scenario is a constant stream of queries from a log file out of production, at targeted 50 QPS. Af

RE: Benchmarking Solr

2010-04-14 Thread Lesyshyn, Erica
.vac...@videotron.ca] Sent: Saturday, April 10, 2010 11:04 PM To: solr-user@lucene.apache.org Subject: Re: Benchmarking Solr Hi, why don't you use JMeter? It would give you greater control over the tests you wish to make. It has many different samplers that will let you run different scena

Re: Benchmarking Solr

2010-04-14 Thread Shawn Heisey
On 4/12/2010 9:57 AM, Shawn Heisey wrote: On 4/12/2010 8:51 AM, Paolo Castagna wrote: There are already two related pages: - http://wiki.apache.org/solr/SolrPerformanceFactors - http://wiki.apache.org/solr/SolrPerformanceData Why not to create a new page? - http://wiki.apache.org/solr/Benc

Re: Benchmarking Solr

2010-04-12 Thread Shawn Heisey
On 4/12/2010 8:51 AM, Paolo Castagna wrote: There are already two related pages: - http://wiki.apache.org/solr/SolrPerformanceFactors - http://wiki.apache.org/solr/SolrPerformanceData Why not to create a new page? - http://wiki.apache.org/solr/BenchmarkingSolr (?) Done. I hope you like i

Re: Benchmarking Solr

2010-04-12 Thread Paolo Castagna
Shawn Heisey wrote: Anyone got a recommendation about where to put it on the wiki? There are already two related pages: - http://wiki.apache.org/solr/SolrPerformanceFactors - http://wiki.apache.org/solr/SolrPerformanceData Why not to create a new page? - http://wiki.apache.org/solr/Benchm

Re: Benchmarking Solr

2010-04-12 Thread Paolo Castagna
Paolo Castagna wrote: I do not have an answer to your questions. But, I have the same issue/problem you have. Some related threads: - http://markmail.org/message/pns4dtfvt54mu3vs - http://markmail.org/message/7on6lvabsosvj7bc - http://markmail.org/message/ftz7tkd7ekhnk4bc - http://markmail

RE: Benchmarking Solr

2010-04-12 Thread Nagelberg, Kallin
I have been using Jmeter to perform some load testing. In your case you might like to take a look at http://jakarta.apache.org/jmeter/usermanual/component_reference.html#CSV_Data_Set_Config . This will allow you to use a random item from your query list. Regards, Kallin Nagelberg -Original

Re: Benchmarking Solr

2010-04-12 Thread Shawn Heisey
I've got a very simple perl script (most of the work is done with modules) that I wrote which forks off multiple processes and throws requests at Solr, then gives a little bit of statistical analysis at the end. I have planned on sharing it from the beginning, I just have to clean it up for pu

Re: Benchmarking Solr

2010-04-12 Thread Markus Jelsma
Hi, You can use Siege [1] in a similar manner as AB and it can support newline separated URL files and pick random URL's. [1]:http://freshmeat.net/projects/siege/ Cheers, On Saturday 10 April 2010 03:46:56 Blargy wrote: > I am about to deploy Solr into our production environment and I woul

Re: Benchmarking Solr

2010-04-12 Thread Paolo Castagna
Hi, I do not have an answer to your questions. But, I have the same issue/problem you have. It would be good if Solr community would agree and share their approach for benchmarking Solr. Indeed, it would be good to have a benchmark for "information retrieval" systems. AFIK there isn't one. :-/ T

Re: Benchmarking Solr

2010-04-10 Thread Jean-Sebastien Vachon
Hi, why don't you use JMeter? It would give you greater control over the tests you wish to make. It has many different samplers that will let you run different scenarios using your existing set of queries. ab is great when you want to evaluate the performance of your server under heavy load.