Noone had touched that page for many years :) Thats why I removed it. If we add it back though, thats a great thought - we should mention it and how to do a standard run.
Though if we use it to compare 2.4 to 2.9, the mentioning part goes without saying. - Mark Matthew Hall wrote: > That's great... perhaps it should be listed on the Benchmark page > though ^^ > > Matt > > Mark Miller wrote: >> We have it - its the benchmark contrib - just run the mirco or standard >> benchmark alg. >> >> Matthew Hall wrote: >> >>> Sorry to interject, but I think that the most useful thing that could >>> be done to this page would be the creation of a standard benchmark >>> test suite that someone could simply download and run on own systems. >>> >>> That way the benchmarking numbers for all users could be easily >>> compared between boxes etc... etc. >>> >>> Perhaps a simple modification of the lucene demo that includes some >>> sort of .. largish data source to index, and then a configured number >>> of searches run against that corpus with known parameters? (yes you >>> could in fact go alot further than this, but I figure its a start) >>> >>> All users would have to do is download the somewhat large tar, and >>> then run some sort of test harness script that was included, and then >>> post their results. >>> >>> I'm sure its not feasible to do something like this with the current >>> release schedule, but I think it would be nice to have. >>> >>> Matt >>> >>> Chris Hostetter wrote: >>> >>>> : Prob want to run it on decent hardware as well (eg mabye I >>>> shouldn't do >>>> : it with my 5200 rpm laptop drives). >>>> >>>> as long as both are run on the same hardware, and the page lists the >>>> hardware, it's the relative numbers that matter the most. >>>> >>>> >>>> >>>> -Hoss >>>> >>>> >>>> --------------------------------------------------------------------- >>>> To unsubscribe, e-mail: java-dev-unsubscr...@lucene.apache.org >>>> For additional commands, e-mail: java-dev-h...@lucene.apache.org >>>> >>>> >>> >> >> >> > > -- - Mark http://www.lucidimagination.com --------------------------------------------------------------------- To unsubscribe, e-mail: java-dev-unsubscr...@lucene.apache.org For additional commands, e-mail: java-dev-h...@lucene.apache.org