Re: significant lucene benchmark regression: JDK11?

Yeah there are definitely more slowdowns still happening besides the GC issue! Mike McCandless http://blog.mikemccandless.com On Fri, May 10, 2019 at 2:15 AM Adrien Grand wrote: > The Russia polygon seems to be something else? It slowed down on April > 12th and then a bit more on April 20th

Re: significant lucene benchmark regression: JDK11?

The Russia polygon seems to be something else? It slowed down on April 12th and then a bit more on April 20th while you only switched to OpenJDK11 on April 23th? However some other slowdowns seem to happen at the same time as the switch to OpenJDK 11 and haven't been addressed by the change of

Re: significant lucene benchmark regression: JDK11?

Hi Team, OK I fixed nightly bench to specify ParallelGC for everything, and indeed that recovered many of the losses -- G1 sure is costly. I added annotations to the charts too. But some things still have losses, e.g. Russia Polygon filter is looking bad:

Re: significant lucene benchmark regression: JDK11?

OK I'll make this change soon and reply back. Mike McCandless http://blog.mikemccandless.com On Fri, Apr 26, 2019 at 10:17 AM David Smiley wrote: > +1 to choose the Parallel Collector temporarily as Uwe suggests so we can > see distinct effects of the separate changes. > > I suppose the

Re: significant lucene benchmark regression: JDK11?

+1 to choose the Parallel Collector temporarily as Uwe suggests so we can see distinct effects of the separate changes. I suppose the benchmarks should continue to prefer the default JVM settings, as it is how users will consume Lucene. ~ David Smiley Apache Lucene/Solr Search Developer

Re: significant lucene benchmark regression: JDK11?

Maybe do this temporary, to not have 2 changes at the same time. Uwe Am April 25, 2019 9:48:35 PM UTC schrieb Michael McCandless : >Yeah I'm just using the JDK's default in the nightly benchmarks. > >Should I override back to the parallel collector? > >Mike McCandless >

Re: significant lucene benchmark regression: JDK11?

Yeah I'm just using the JDK's default in the nightly benchmarks. Should I override back to the parallel collector? Mike McCandless http://blog.mikemccandless.com On Thu, Apr 25, 2019 at 5:44 PM Uwe Schindler wrote: > Hi, > > I am not sure how Mike's benchmarks are setup and if he chooses a

Re: significant lucene benchmark regression: JDK11?

Hi, I am not sure how Mike's benchmarks are setup and if he chooses a specific garbage collector. Java 8 defaults to ParallelGC, Java 11 defaults to G1, which may slow down up to 10% as it is not optimized for throughput. So to compare you gave to be specific in your GC choices. Uwe Am

Re: significant lucene benchmark regression: JDK11?

Strangely LatLonShape seems to move in the opposite direction, or was that due to a known functional change? On Thu, Apr 25, 2019 at 3:33 PM Robert Muir wrote: > > looks to me like the default garbage collector may play a part in > this? look at JIT/gc times > >

Re: significant lucene benchmark regression: JDK11?

looks to me like the default garbage collector may play a part in this? look at JIT/gc times https://home.apache.org/~mikemccand/lucenebench/indexing.html On Thu, Apr 25, 2019 at 1:57 PM Nicholas Knize wrote: > > Earlier this week I noticed a significant across the board performance >

significant lucene benchmark regression: JDK11?

Earlier this week I noticed a significant across the board performance regression on the nightly geo benchmarks . It appears this regression can also be seen on other lucene benchmarks

Re: Lucene Benchmark

John, It's obvious http://lucene.apache.org/core/4_8_0/benchmark/org/apache/lucene/benchmark/byTask/package-summary.html It's also described in LUA. I just get into it and understand how to use it. Feel free to ask if you face any difficulties. Beware that Lucene devs use https

Lucene Benchmark

Hi guys: Can you guys point me to some details on the Lucene Benchmark module? Specifically the grammar/syntax for the Algorithm files? Thanks -John

Re: Lucene Benchmark

Hi John, It's obvious http://lucene.apache.org/core/4_8_0/benchmark/org/apache/lucene/benchmark/byTask/package-summary.html It's also described in LUA. I just get into it and understand how to use it. Feel free to ask if you face any difficulties. Beware that Lucene devs use https

Re: Lucene Benchmark

I use the benchmark module for spatial and I intend to for highlighting performance next month. On Wednesday, September 24, 2014, Mikhail Khludnev mkhlud...@griddynamics.com wrote: Hi John, It's obvious http://lucene.apache.org/core/4_8_0/benchmark/org/apache/lucene/benchmark/byTask/package

Re: Lucene Benchmark

performance next month. On Wednesday, September 24, 2014, Mikhail Khludnev mkhlud...@griddynamics.com wrote: Hi John, It's obvious http://lucene.apache.org/core/4_8_0/benchmark/org/apache/lucene/benchmark/byTask/package-summary.html It's also described in LUA. I just get into it and understand

Re: Lucene Benchmark

Thank you Mikhail! Exactly what I was looking for! -John On Wed, Sep 24, 2014 at 12:59 AM, Mikhail Khludnev mkhlud...@griddynamics.com wrote: Hi John, It's obvious http://lucene.apache.org/core/4_8_0/benchmark/org/apache/lucene/benchmark/byTask/package-summary.html It's also described

Re: svn commit: r1492420 - in /lucene/dev/trunk/dev-tools/maven: lucene/ lucene/analysis/stempel/ lucene/benchmark/ lucene/core/src/java/ lucene/demo/ lucene/facet/ lucene/misc/ lucene/queryparser/ lu

/trunk/dev-tools/maven/lucene/analysis/stempel/pom.xml.template lucene/dev/trunk/dev-tools/maven/lucene/benchmark/pom.xml.template lucene/dev/trunk/dev-tools/maven/lucene/core/src/java/pom.xml.template lucene/dev/trunk/dev-tools/maven/lucene/demo/pom.xml.template lucene/dev/trunk/dev

Re: svn commit: r1457343 - /lucene/dev/trunk/lucene/benchmark/conf/english-porter-comparison.alg

Thanks Adrien! - Steve On Mar 16, 2013, at 7:39 PM, jpou...@apache.org wrote: Author: jpountz Date: Sat Mar 16 23:39:39 2013 New Revision: 1457343 URL: http://svn.apache.org/r1457343 Log: Add svn:eol-style. Modified: lucene/dev/trunk/lucene/benchmark/conf/english-porter

RE: svn commit: r1424762 - in /lucene/dev/branches/branch_4x: ./ dev-tools/ lucene/ lucene/analysis/ lucene/analysis/icu/src/java/org/apache/lucene/collation/ lucene/backwards/ lucene/benchmark/ lucen

/ lucene/backwards/ lucene/benchmark/ lucene/codecs/ lucene/core/ lucene/core/src/test/org/apache/l... Author: hossman Date: Thu Dec 20 23:43:47 2012 New Revision: 1424762 URL: http://svn.apache.org/viewvc?rev=1424762view=rev Log: SOLR-4136: followup: fix getBaseUrlForNodeName to never

RE: svn commit: r1424762 - in /lucene/dev/branches/branch_4x: ./ dev-tools/ lucene/ lucene/analysis/ lucene/analysis/icu/src/java/org/apache/lucene/collation/ lucene/backwards/ lucene/benchmark/ lucen

/analysis/ : lucene/analysis/icu/src/java/org/apache/lucene/collation/ : lucene/backwards/ lucene/benchmark/ lucene/codecs/ lucene/core/ : lucene/core/src/test/org/apache/l... : : Author: hossman : Date: Thu Dec 20 23:43:47 2012 : New Revision: 1424762 : : URL: http://svn.apache.org/viewvc?rev

RE: svn commit: r1417871 - /lucene/dev/trunk/lucene/benchmark/src/test/org/apache/lucene/benchmark/byTask/feeds/EnwikiContentSourceTest.java

06, 2012 2:34 PM To: comm...@lucene.apache.org Subject: svn commit: r1417871 - /lucene/dev/trunk/lucene/benchmark/src/test/org/apache/lucene/benchm ark/byTask/feeds/EnwikiContentSourceTest.java Author: doronc Date: Thu Dec 6 13:33:34 2012 New Revision: 1417871 URL: http://svn.apache.org

Re: svn commit: r1417871 - /lucene/dev/trunk/lucene/benchmark/src/test/org/apache/lucene/benchmark/byTask/feeds/EnwikiContentSourceTest.java

...@thetaphi.de -Original Message- From: dor...@apache.org [mailto:dor...@apache.org] Sent: Thursday, December 06, 2012 2:34 PM To: comm...@lucene.apache.org Subject: svn commit: r1417871 - /lucene/dev/trunk/lucene/benchmark/src/test/org/apache/lucene/benchm ark/byTask/feeds

Re: svn commit: r1417939 - /lucene/dev/trunk/lucene/benchmark/src/test/org/apache/lucene/benchmark/byTask/feeds/EnwikiContentSourceTest.java

Thanks Uwe. On Thu, Dec 6, 2012 at 5:23 PM, uschind...@apache.org wrote: Author: uschindler Date: Thu Dec 6 15:23:13 2012 New Revision: 1417939 URL: http://svn.apache.org/viewvc?rev=1417939view=rev Log: fix eol-style Modified: lucene/dev/trunk/lucene/benchmark/src/test/org/apache

Re: svn commit: r1370911 - in /lucene/dev/branches/branch_4x: ./ dev-tools/ lucene/ lucene/analysis/ lucene/analysis/icu/src/java/org/apache/lucene/collation/ lucene/backwards/ lucene/benchmark/ lucen

/ICUCollationKeyFilterFactory.java (props changed) lucene/dev/branches/branch_4x/lucene/backwards/ (props changed) lucene/dev/branches/branch_4x/lucene/benchmark/ (props changed) lucene/dev/branches/branch_4x/lucene/build.xml (props changed) lucene/dev/branches/branch_4x/lucene/common

Re: svn commit: r1369911 - /lucene/dev/trunk/lucene/benchmark/src/test/org/apache/lucene/benchmark/byTask/TestPerfTasksLogic.java

+// NOTE: cannot assert this, because on a super-slow +// system, it could be after waiting 0.5 seconds that Thanks Mike. Interesting because it's not that super-slow windows machine. A dated 2 core AMD but I wouldn't say it's a snail. Dawid

Re: svn commit: r1369911 - /lucene/dev/trunk/lucene/benchmark/src/test/org/apache/lucene/benchmark/byTask/TestPerfTasksLogic.java

On Mon, Aug 6, 2012 at 2:28 PM, Dawid Weiss dawid.we...@gmail.com wrote: +// NOTE: cannot assert this, because on a super-slow +// system, it could be after waiting 0.5 seconds that Thanks Mike. Interesting because it's not that super-slow windows machine. A dated 2 core AMD but I

Re: svn commit: r1369911 - /lucene/dev/trunk/lucene/benchmark/src/test/org/apache/lucene/benchmark/byTask/TestPerfTasksLogic.java

Hmmm well somehow those 2 search threads weren't scheduled (enough) before the 0.5 seconds was up. Very likely. 500ms isn't that much when you have competing threads and some other processes in the background (which was possibly the case). D.

RE: svn commit: r1367129 - in /lucene/dev/branches/branch_4x: ./ dev-tools/ lucene/ lucene/analysis/ lucene/analysis/icu/src/java/org/apache/lucene/collation/ lucene/backwards/ lucene/benchmark/ lucen

...@lucene.apache.org Subject: svn commit: r1367129 - in /lucene/dev/branches/branch_4x: ./ dev- tools/ lucene/ lucene/analysis/ lucene/analysis/icu/src/java/org/apache/lucene/collation/ lucene/backwards/ lucene/benchmark/ lucene/core/ lucene/demo/ lucene/facet/ lucene/grouping/ luce... Author: yonik

[jira] [Created] (LUCENE-4154) migrate luceneutil from apache extras into lucene/benchmark

Michael McCandless created LUCENE-4154: -- Summary: migrate luceneutil from apache extras into lucene/benchmark Key: LUCENE-4154 URL: https://issues.apache.org/jira/browse/LUCENE-4154 Project

[jira] [Created] (LUCENE-3159) lucene benchmark has some unnecessary files

lucene benchmark has some unnecessary files --- Key: LUCENE-3159 URL: https://issues.apache.org/jira/browse/LUCENE-3159 Project: Lucene - Java Issue Type: Task Components: modules/benchmark

[jira] [Assigned] (LUCENE-3159) lucene benchmark has some unnecessary files

[ https://issues.apache.org/jira/browse/LUCENE-3159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Muir reassigned LUCENE-3159: --- Assignee: Robert Muir lucene benchmark has some unnecessary files

[jira] [Resolved] (LUCENE-3159) lucene benchmark has some unnecessary files

(branch3x), 1129458 (branch32) See the discussion on LUCENE-3155 for why I don't think any more action is needed, source packaging is an svn export: the problem was that it was committed to svn. lucene benchmark has some unnecessary files

[jira] [Updated] (LUCENE-3010) Add the ability for the Lucene Benchmark code to read Solr configuration information for testing Analyzer/Filter Chains

[ https://issues.apache.org/jira/browse/LUCENE-3010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Doron Cohen updated LUCENE-3010: Description: I would like to be able to use the Lucene Benchmark code in Lucene contrib with Solr

RE: Using contrib Lucene Benchmark with Solr

...@gmail.com] Sent: Wednesday, March 30, 2011 7:56 PM To: dev@lucene.apache.org Subject: Re: Using contrib Lucene Benchmark with Solr On Wed, Mar 30, 2011 at 4:49 PM, Burton-West, Tom tburt...@umich.edu wrote: I would like to be able to use the Lucene Benchmark code with Solr to run some indexing tests

Re: Using contrib Lucene Benchmark with Solr

On Thu, Mar 31, 2011 at 11:24 AM, Burton-West, Tom tburt...@umich.edu wrote: Thanks Robert and Grant, Does this need a separate JIRA issue dealing specifically with the ability of benchmark to read Solr config settings, or is it subsumed in LUCENE-2845? or should I just add a comment to

[jira] [Updated] (LUCENE-3010) Add the ability for the Lucene Benchmark code to read Solr configuration information for testing Analyzer/Filter Chains

[ https://issues.apache.org/jira/browse/LUCENE-3010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tom Burton-West updated LUCENE-3010: Summary: Add the ability for the Lucene Benchmark code to read Solr configuration

Using contrib Lucene Benchmark with Solr

I would like to be able to use the Lucene Benchmark code with Solr to run some indexing tests. It would be nice if Lucene Benchmark to could read Solr configuration rather than having to translate my filter chain and other parameters into Lucene. Would it be appropriate to open a JIRA issue

Re: Using contrib Lucene Benchmark with Solr

On Wed, Mar 30, 2011 at 4:49 PM, Burton-West, Tom tburt...@umich.edu wrote: I would like to be able to use the Lucene Benchmark code with Solr to run some indexing tests.  It would be nice if Lucene Benchmark to could read Solr configuration rather than having to translate my filter chain

Re: Using contrib Lucene Benchmark with Solr

On Mar 30, 2011, at 7:56 PM, Robert Muir wrote: On Wed, Mar 30, 2011 at 4:49 PM, Burton-West, Tom tburt...@umich.edu wrote: I would like to be able to use the Lucene Benchmark code with Solr to run some indexing tests. It would be nice if Lucene Benchmark to could read Solr configuration

Re: svn commit: r1084256 - in /lucene/dev/branches/branch_3x: ./ lucene/ lucene/contrib/benchmark/src/test/org/apache/lucene/benchmark/byTask/feeds/TrecContentSourceTest.java solr/

-    assertEquals(Wrong numbre of documents created by osurce!,5,n); +    assertEquals(Wrong number of documents created by osurce!,5,n); Err... Was this meant to be 'source' in the new version? D. - To unsubscribe, e-mail:

Re: svn commit: r1084256 - in /lucene/dev/branches/branch_3x: ./ lucene/ lucene/contrib/benchmark/src/test/org/apache/lucene/benchmark/byTask/feeds/TrecContentSourceTest.java solr/

:) Thanks, will fix. On Tue, Mar 22, 2011 at 7:17 PM, Dawid Weiss dawid.we...@gmail.com wrote: -assertEquals(Wrong numbre of documents created by osurce!,5,n); +assertEquals(Wrong number of documents created by osurce!,5,n); Err... Was this meant to be 'source' in the new version?

Re: svn commit: r1067699 - in /lucene/dev/branches/branch_3x/lucene/contrib/benchmark/src: java/org/apache/lucene/benchmark/byTask/feeds/TrecDocParser.java test/org/apache/lucene/benchmark/byTask/feed

/dev/branches/branch_3x/lucene/contrib/benchmark/src/java/org/apache/lucene/benchmark/byTask/feeds/TrecDocParser.java lucene/dev/branches/branch_3x/lucene/contrib/benchmark/src/test/org/apache/lucene/benchmark/byTask/feeds/trecdocs.zip Modified: lucene/dev/branches/branch_3x/lucene

Re: svn commit: r898055 - in /lucene/java/trunk/contrib/benchmark: build.xml src/java/org/apache/lucene/benchmark/byTask/feeds/LongToEnglishContentSource.java src/java/org/apache/lucene/benchmark/byTa

Revision: 898055 URL: http://svn.apache.org/viewvc?rev=898055view=rev Log: Add support for LongToEnglish doc/query maker Added: lucene/java/trunk/contrib/benchmark/src/java/org/apache/lucene/benchmark/byTask/feeds/LongToEnglishContentSource.java (with props) lucene/java/trunk

Re: svn commit: r898055 - in /lucene/java/trunk/contrib/benchmark: build.xml src/java/org/apache/lucene/benchmark/byTask/feeds/LongToEnglishContentSource.java src/java/org/apache/lucene/benchmark/byTa

doc/query maker Added:     lucene/java/trunk/contrib/benchmark/src/java/org/apache/lucene/benchmark/byTask/feeds/LongToEnglishContentSource.java   (with props)     lucene/java/trunk/contrib/benchmark/src/java/org/apache/lucene/benchmark/byTask/feeds/LongToEnglishQueryMaker.java

[jira] Updated: (LUCENE-675) Lucene benchmark: objective performance test for Lucene

[ https://issues.apache.org/jira/browse/LUCENE-675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marvin Humphrey updated LUCENE-675: --- Attachment: (was: BenchmarkingIndexer.pm) Lucene benchmark: objective performance test

[jira] Updated: (LUCENE-675) Lucene benchmark: objective performance test for Lucene

[ https://issues.apache.org/jira/browse/LUCENE-675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marvin Humphrey updated LUCENE-675: --- Attachment: (was: LuceneIndexer.java) Lucene benchmark: objective performance test

RE: Benchmarking Solr indexing using Lucene Benchmark?

Rutherglen [mailto:jason.rutherg...@gmail.com] Sent: Monday, June 14, 2010 12:02 PM To: dev@lucene.apache.org Subject: Re: Benchmarking Solr indexing using Lucene Benchmark? Tom, This was discussed a while back, however I don't believe anything was committed. I think there's a fair bit of work involved

Benchmarking Solr indexing using Lucene Benchmark?

will be varying are at the Lucene level, we are considering using the Lucene Benchmark utilities in Lucene/contrib.Have other Solr users used Lucene Benchmark? Can anyone provide any hints for adapting it to Solr? (Are there any common gotchas etc?). Tom Tom Burton-West University of Michigan

Re: Benchmarking Solr indexing using Lucene Benchmark?

Tom, This was discussed a while back, however I don't believe anything was committed. I think there's a fair bit of work involved in that the Lucene benchmark config would not be usable, or rather, it would need to simply point to a Solr solrconfig.xml file. Other than that, the resulting

Re: svn commit: r929520 - in /lucene/dev/trunk/lucene/contrib/benchmark: ./ src/java/org/apache/lucene/benchmark/byTask/utils/ src/test/org/apache/lucene/benchmark/byTask/utils/

On Wed, Mar 31, 2010 at 9:06 AM, sh...@apache.org wrote: JIRA-2353: Config incorrectly handles Windows absolute pathnames The JIRA-2353 part is my fault - Shai asked me the right format for JIRA linking, and I got it wrong! Should be LUCENE-2353 of course. need...more...coffee... -Yonik

Re: svn commit: r928069 - in /lucene/dev/trunk: lucene/ lucene/backwards/src/test/org/apache/lucene/util/ lucene/contrib/benchmark/src/test/org/apache/lucene/benchmark/ lucene/contrib/benchmark/src/

:     lucene/dev/trunk/solr/src/test/org/apache/solr/SolrJUnitResultFormatter.java Modified:    lucene/dev/trunk/lucene/build.xml    lucene/dev/trunk/lucene/common-build.xml     lucene/dev/trunk/lucene/contrib/benchmark/src/test/org/apache/lucene/benchmark/BenchmarkTestCase.java     lucene/dev/trunk

Re: svn commit: r928069 - in /lucene/dev/trunk: lucene/ lucene/backwards/src/test/org/apache/lucene/util/ lucene/contrib/benchmark/src/test/org/apache/lucene/benchmark/ lucene/contrib/benchmark/src/

:     lucene/dev/trunk/solr/src/test/org/apache/solr/SolrJUnitResultFormatter.java Modified:    lucene/dev/trunk/lucene/build.xml    lucene/dev/trunk/lucene/common-build.xml     lucene/dev/trunk/lucene/contrib/benchmark/src/test/org/apache/lucene/benchmark/BenchmarkTestCase.java     lucene/dev/trunk

Re: svn commit: r898055 - in /lucene/java/trunk/contrib/benchmark: build.xml src/java/org/apache/lucene/benchmark/byTask/feeds/LongToEnglishContentSource.java src/java/org/apache/lucene/benchmark/by

/viewvc?rev=898055view=rev Log: Add support for LongToEnglish doc/query maker Added:     lucene/java/trunk/contrib/benchmark/src/java/org/apache/lucene/benchmark/byTask/feeds/LongToEnglishContentSource.java   (with props)     lucene/java/trunk/contrib/benchmark/src/java/org/apache/lucene

Re: svn commit: r894224 - in /lucene/java/trunk/contrib: benchmark/src/java/org/apache/lucene/benchmark/byTask/tasks/ highlighter/src/java/org/apache/lucene/search/highlight/ instantiated/src/java/o

://svn.apache.org/viewvc?rev=894224view=rev Log: fixed trivial spelling issues in javadoc Modified:     lucene/java/trunk/contrib/benchmark/src/java/org/apache/lucene/benchmark/byTask/tasks/PerfTask.java     lucene/java/trunk/contrib/highlighter/src/java/org/apache/lucene/search/highlight

Re: svn commit: r894224 - in /lucene/java/trunk/contrib: benchmark/src/java/org/apache/lucene/benchmark/byTask/tasks/ highlighter/src/java/org/apache/lucene/search/highlight/ instantiated/src/java/o

: simonw Date: Mon Dec 28 18:52:19 2009 New Revision: 894224 URL: http://svn.apache.org/viewvc?rev=894224view=rev Log: fixed trivial spelling issues in javadoc Modified: lucene/java/trunk/contrib/benchmark/src/java/org/apache/lucene/benchmark/byTask/tasks/PerfTask.java

Re: svn commit: r894224 - in /lucene/java/trunk/contrib: benchmark/src/java/org/apache/lucene/benchmark/byTask/tasks/ highlighter/src/java/org/apache/lucene/search/highlight/ instantiated/src/java/o

URL: http://svn.apache.org/viewvc?rev=894224view=rev Log: fixed trivial spelling issues in javadoc Modified:  lucene/java/trunk/contrib/benchmark/src/java/org/apache/lucene/benchmark/byTask/tasks/PerfTask.java  lucene/java/trunk/contrib/highlighter/src/java/org/apache/lucene

Re: svn commit: r617991 - /lucene/java/trunk/contrib/benchmark/src/java/org/apache/lucene/benchmark/byTask/PerfRunData.java

I sort of felt that it should be done even when eraseIndex=false, but, how about instead we make it an explicit task, and don't reset the clock inside reinit()? Here's the patch: Index: src/java/org/apache/lucene/benchmark/byTask/tasks/ ResetLogClockTask.java

Re: svn commit: r617991 - /lucene/java/trunk/contrib/benchmark/src/java/org/apache/lucene/benchmark/byTask/PerfRunData.java

: Thanks Michael but I feel moving this to a task will make writing algorithms (and reading them) more tedious. Index: src/java/org/apache/lucene/benchmark/byTask/tasks/ ResetLogClockTask.java === --- src/java/org/apache/lucene

Re: svn commit: r617991 - /lucene/java/trunk/contrib/benchmark/src/java/org/apache/lucene/benchmark/byTask/PerfRunData.java

(and reading them) more tedious. Index: src/java/org/apache/lucene/benchmark/byTask/tasks/ ResetLogClockTask.java === --- src/java/org/apache/lucene/benchmark/byTask/tasks/ ResetLogClockTask.java (revision 0) +++ src/java/org/apache/lucene

Re: svn commit: r617991 - /lucene/java/trunk/contrib/benchmark/src/java/org/apache/lucene/benchmark/byTask/PerfRunData.java

the start time (used only when printing # docs indexed) Modified: lucene/java/trunk/contrib/benchmark/src/java/org/apache/lucene/benchmark/byTask/PerfRunData.java Modified: lucene/java/trunk/contrib/benchmark/src/java/org/apache/lucene/benchmark/byTask/PerfRunData.java URL: http

Re: svn commit: r610738 - /lucene/java/trunk/contrib/benchmark/src/java/org/apache/lucene/benchmark/byTask/feeds/EnwikiDocMaker.java

Michael McCandless wrote: OK I carried my two fixes (LUCENE-1117, LUCENE-1125) to 2.3 branch! Mike Great! I'll build RC2 soon! - To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED]

Re: svn commit: r603856 - in /lucene/java/trunk/contrib/benchmark: ./ src/java/org/apache/lucene/benchmark/byTask/feeds/

Thanks for the review Erik! LUCENE-1086 solved a problem for people trying to run the benchmark from e.g. Eclipse rather than by using ant, and specifying absolute path for the docs dir. Problem was that the benchmark Java code assumed that the path for docs dir is relative, under work, and when

Re: svn commit: r603856 - in /lucene/java/trunk/contrib/benchmark: ./ src/java/org/apache/lucene/benchmark/byTask/feeds/

On Dec 13, 2007, at 12:58 AM, [EMAIL PROTECTED] wrote: +12/13/07 + LUCENE-1086: DocMakers setup for the docs.dir property + fixed to properly handle absolute paths. (Shai Erera via Doron Cohen) + I haven't looked at the details of this beyond the commit messages that went by, but if

[jira] Commented: (LUCENE-675) Lucene benchmark: objective performance test for Lucene

again, Grant Lucene benchmark: objective performance test for Lucene --- Key: LUCENE-675 URL: https://issues.apache.org/jira/browse/LUCENE-675 Project: Lucene - Java Issue Type

[jira] Resolved: (LUCENE-675) Lucene benchmark: objective performance test for Lucene

. Bugs can now be opened specific to the code in the contrib area. Lucene benchmark: objective performance test for Lucene --- Key: LUCENE-675 URL: https://issues.apache.org/jira/browse/LUCENE-675

[jira] Commented: (LUCENE-675) Lucene benchmark: objective performance test for Lucene

to use Class.getName in place of Class.getSimpleName, right? I think once I do that plus change the String.contains calls to String.indexOf it should all be fine, right? I have it compiling and running, so that is a good sign. I will look to commit soon. -Grant Lucene benchmark: objective

[jira] Updated: (LUCENE-675) Lucene benchmark: objective performance test for Lucene

[ https://issues.apache.org/jira/browse/LUCENE-675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Doron Cohen updated LUCENE-675: --- Attachment: byTask.jre1.4.patch.txt Lucene benchmark: objective performance test for Lucene

[jira] Commented: (LUCENE-675) Lucene benchmark: objective performance test for Lucene

the Java 1.5 dependency. Thanks for catching this! Doron Lucene benchmark: objective performance test for Lucene --- Key: LUCENE-675 URL: https://issues.apache.org/jira/browse/LUCENE-675 Project

[jira] Commented: (LUCENE-675) Lucene benchmark: objective performance test for Lucene

using this for benchmarking - quite easy to add new stuff - and in fact I added some stuff lately but did not update here because wasn't sure if others are interested. I will verify what I have with svn head and pack it here as an updated patch. Regards, Doron Lucene benchmark: objective

[jira] Updated: (LUCENE-675) Lucene benchmark: objective performance test for Lucene

[ https://issues.apache.org/jira/browse/LUCENE-675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Doron Cohen updated LUCENE-675: --- Attachment: byTask.2.patch.txt Lucene benchmark: objective performance test for Lucene

[jira] Commented: (LUCENE-675) Lucene benchmark: objective performance test for Lucene

, perhaps using a command line tool? Looking at the patch file, I am not sure what the issue is. Otherwise, based on the documentation, this sounds really interesting and useful. Based on some of your other patches, I assume you are using this to do benchmarking, no? Thanks, Grant Lucene

[jira] Updated: (LUCENE-675) Lucene benchmark: objective performance test for Lucene

[ http://issues.apache.org/jira/browse/LUCENE-675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Grant Ingersoll updated LUCENE-675: --- Priority: Minor (was: Major) Lucene benchmark: objective performance test for Lucene

Re: [jira] Updated: (LUCENE-675) Lucene benchmark: objective performance test for Lucene

Paul Elschot [EMAIL PROTECTED] wrote on 16/11/2006 14:03:23: Did you svn add the new files locally before doing svn diff? It took me a quite while to get the hang of that. It is mentioned here: http://wiki.apache.org/jakarta-lucene/HowToContribute Thanks Paul, In fact TortoiseSVN does the

Re: [jira] Updated: (LUCENE-675) Lucene benchmark: objective performance test for Lucene

Steven Rowe [EMAIL PROTECTED] wrote on 16/11/2006 14:21:37: I haven't tried to use TortoiseSVN to create patches, but my experience with it for other purposes has been negative enough, especially in trying to use it on the same working copy on which I use a Cygwin command-line version of SVN,

Re: [jira] Updated: (LUCENE-675) Lucene benchmark: objective performance test for Lucene

Doron Cohen wrote: And, for applying the patch, again from cygwin shell: - patch -p0 -i patchFile.patch The -p0 was also something that I was missing. FYI, I had endless issues with 'patch' with patches from contributors on the derby project, depending on if they were running windows or

[jira] Updated: (LUCENE-675) Lucene benchmark: objective performance test for Lucene

something basic about SVN, but I thought it'd be better to share this experience here - might save some time for others trying to apply this patch or other patches ... Lucene benchmark: objective performance test for Lucene

Re: [jira] Updated: (LUCENE-675) Lucene benchmark: objective performance test for Lucene

Doron Cohen (JIRA) wrote: [ http://issues.apache.org/jira/browse/LUCENE-675?page=all ] (I used Tortoise SVN to create the patch). I haven't tried to use TortoiseSVN to create patches, but my experience with it for other purposes has been negative enough, especially in trying to use it on

[jira] Commented: (LUCENE-675) Lucene benchmark: objective performance test for Lucene

). Regards, Doron Lucene benchmark: objective performance test for Lucene --- Key: LUCENE-675 URL: http://issues.apache.org/jira/browse/LUCENE-675 Project: Lucene - Java Issue Type

[jira] Commented: (LUCENE-675) Lucene benchmark: objective performance test for Lucene

[ http://issues.apache.org/jira/browse/LUCENE-675?page=comments#action_12450041 ] Grant Ingersoll commented on LUCENE-675: Committed the benchmark patch plus Doron's update to TestData and TimeData Lucene benchmark: objective

[jira] Commented: (LUCENE-675) Lucene benchmark: objective performance test for Lucene

, more than as propetries based. Lucene benchmark: objective performance test for Lucene --- Key: LUCENE-675 URL: http://issues.apache.org/jira/browse/LUCENE-675 Project: Lucene - Java

[jira] Commented: (LUCENE-675) Lucene benchmark: objective performance test for Lucene

[ http://issues.apache.org/jira/browse/LUCENE-675?page=comments#action_12449409 ] Grant Ingersoll commented on LUCENE-675: OK, how about I commit my changes, then you can add a patch that shows your ideas? Lucene benchmark: objective

[jira] Commented: (LUCENE-675) Lucene benchmark: objective performance test for Lucene

have no dependencies in org.apache.lucene.benchmark.). I will also add tarkets in buid.xml, and add .alg, and .alg files under conf. Makes sense? Do you already know when you are going to commit it? Lucene benchmark: objective performance test for Lucene

[jira] Commented: (LUCENE-675) Lucene benchmark: objective performance test for Lucene

will try to commit tonight or tomorrow morning. Lucene benchmark: objective performance test for Lucene --- Key: LUCENE-675 URL: http://issues.apache.org/jira/browse/LUCENE-675 Project: Lucene - Java

[jira] Commented: (LUCENE-675) Lucene benchmark: objective performance test for Lucene

do you (and you) think? - Doron Lucene benchmark: objective performance test for Lucene --- Key: LUCENE-675 URL: http://issues.apache.org/jira/browse/LUCENE-675 Project: Lucene - Java

[jira] Updated: (LUCENE-675) Lucene benchmark: objective performance test for Lucene

to understand how this works. Lucene benchmark: objective performance test for Lucene --- Key: LUCENE-675 URL: http://issues.apache.org/jira/browse/LUCENE-675 Project: Lucene - Java Issue

[jira] Updated: (LUCENE-675) Lucene benchmark: objective performance test for Lucene

8,326,046 23,048,192 [java] addDocument 1 2000 441.87,310,929 22,206,872 Attached timedata.zip has modifies TimeData.java and TestData.java for [1 to 5] above, and for the NAN/inifinite. Lucene benchmark: objective

[jira] Commented: (LUCENE-675) Lucene benchmark: objective performance test for Lucene

the Standard one or implement there own that reads in a config file. I will try to put in a fully parameterized version soon. GSI: Thanks for the fixes, I will incorporate into my version and post another patch soon. Lucene benchmark: objective performance test for Lucene

[jira] Commented: (LUCENE-675) Lucene benchmark: objective performance test for Lucene

for specific areas of Lucene not covered by this version. Thanks to all who contributed their code/thoughts. Patch to follow Lucene benchmark: objective performance test for Lucene --- Key: LUCENE-675 URL: http

[jira] Commented: (LUCENE-675) Lucene benchmark: objective performance test for Lucene

. Lucene benchmark: objective performance test for Lucene --- Key: LUCENE-675 URL: http://issues.apache.org/jira/browse/LUCENE-675 Project: Lucene - Java Issue Type: Improvement

[jira] Updated: (LUCENE-675) Lucene benchmark: objective performance test for Lucene

wrote. Here are the relevant files, contributed with the expectation they will be cannibalized, not included verbatim. Lucene benchmark: objective performance test for Lucene --- Key: LUCENE-675 URL: http

[jira] Updated: (LUCENE-675) Lucene benchmark: objective performance test for Lucene

[ http://issues.apache.org/jira/browse/LUCENE-675?page=all ] Marvin Humphrey updated LUCENE-675: --- Attachment: LuceneIndexer.java One more file... Lucene benchmark: objective performance test for Lucene

[jira] Commented: (LUCENE-675) Lucene benchmark: objective performance test for Lucene

be to have three baselines: 1. quick validation (5 minutes to run...) 2. standard (15-45) 3. exhaustive (1-10 hours). I know several others have built benchmarking suites for their internal use, what has been your strategy? Thoughts, ideas, insights? Thanks, Grant Lucene benchmark

[jira] Commented: (LUCENE-675) Lucene benchmark: objective performance test for Lucene

standard test is to do 1000 docs and 6 reps. Within a couple seconds the first rep is done and the app is printing out results. For rapid development, having something that speedy is really handy. Lucene benchmark: objective performance test for Lucene

[jira] Assigned: (LUCENE-675) Lucene benchmark: objective performance test for Lucene

[ http://issues.apache.org/jira/browse/LUCENE-675?page=all ] Grant Ingersoll reassigned LUCENE-675: -- Assignee: Grant Ingersoll Lucene benchmark: objective performance test for Lucene

[jira] Commented: (LUCENE-675) Lucene benchmark: objective performance test for Lucene

which depends first on this issue being complete. Lucene benchmark: objective performance test for Lucene --- Key: LUCENE-675 URL: http://issues.apache.org/jira/browse/LUCENE-675 Project: Lucene

[jira] Commented: (LUCENE-675) Lucene benchmark: objective performance test for Lucene

important thing when using benchmarks is being aware of the limitations of the benchmark and methodology used. Lucene benchmark: objective performance test for Lucene --- Key: LUCENE-675 URL: http

[jira] Commented: (LUCENE-675) Lucene benchmark: objective performance test for Lucene

is the ability to do a before and after evaluation (that runs each test several times) as you make changes. Anybody should be able to do the same. Run the benchmark, apply the patch and then rerun the benchmark. Lucene benchmark: objective performance test for Lucene

[jira] Commented: (LUCENE-675) Lucene benchmark: objective performance test for Lucene

then). If folks are interested I can dig out that performance logger and maybe adopt it to what Grant comes up with. Lucene benchmark: objective performance test for Lucene --- Key: LUCENE-675 URL: http

[jira] Commented: (LUCENE-675) Lucene benchmark: objective performance test for Lucene

. And that a standardized HW/SW testing environment is not really realistic now. GSI: perhaps you can contribute once this is setup I will try! Lucene benchmark: objective performance test for Lucene --- Key: LUCENE-675

  1   2   >