This is now great times to use joint Lucene/Solr development: I have Lucene checked out at a different place, if I invoke Gradle on Solr like that, you can hack lucene in the different folder and run Solr tests against the lucene checkout. Just pass:
-Plucene.dev.path=/path/to/lucene/checkout to Gradle: C:\Users\Uwe Schindler\Projects\lucene\solr>gradlew :solr:core:test --tests TestRandomDVFaceting.testRandomFaceting -Dtests.seed=3B93BA61C91F26D4 -Dtests.slow=true -Dtests.locale=uz-Latn -Dtests.timezone=America/Santa_Isabel -Dtests.asserts=true -Dtests.file.encoding=UTF-8 -Plucene.dev.path="C:\Users\Uwe Schindler\Projects\lucene\lucene" To honour the JVM settings for this build a single-use Daemon process will be forked. See https://docs.gradle.org/7.2/userguide/gradle_daemon.html#sec:disabling_the_daemon. Daemon will be stopped at the end of the build Local Lucene development repository will be used substituting 9.0.0: C:\Users\Uwe Schindler\Projects\lucene\lucene > Task :altJvmWarning NOTE: Alternative java toolchain will be used for compilation and tests: Project will use 17 (OpenJDK 17+35-2724, home at: C:\Program Files\Java\jdk-17) Gradle runs with 11 (Eclipse Adoptium JDK 11.0.13+8, home at: C:\Program Files\Java\jdk-11.0.13) > Task :randomizationInfo Running tests with randomization seed: tests.seed=3B93BA61C91F26D4 > Task :errorProneSkipped WARNING: errorprone disabled (won't work with JDK 17) > Task :lucene:altJvmWarning NOTE: Alternative java toolchain will be used for compilation and tests: Project will use 17 (OpenJDK 17+35-2724, home at: C:\Program Files\Java\jdk-17) Gradle runs with 11 (Eclipse Adoptium JDK 11.0.13+8, home at: C:\Program Files\Java\jdk-11.0.13) > Task :lucene:errorProneSkipped WARNING: errorprone disabled (skipped on non-nightly runs) <====---------> 33% EXECUTING [31s] > IDLE > :lucene:lucene:core:compileJava > IDLE > IDLE ----- Uwe Schindler Achterdiek 19, D-28357 Bremen https://www.thetaphi.de eMail: [email protected] > -----Original Message----- > From: Uwe Schindler <[email protected]> > Sent: Wednesday, December 8, 2021 8:16 PM > To: [email protected] > Subject: RE: Strange error in Solr with Lucene 9.0.0 > > I was able to also reprodiuce it with TEST_JVM_ARGS=-Xint > > So this is not a JVM bug, it’s a real problem in Lucene 9.0.0 (and was > introduced > in summer). Robert and I were wondering why the assertions did not hit, but it > looks like the bitshift afterwards makes it negative. > > We have to investigate and write a bug report for Lucene with reference to > Solr. > > Uwe > > P.S.: For easier testing I merged over the rerun tests patch (LUCENE-9660) by > Dawid from Lucene over to Solr. > > ----- > Uwe Schindler > Achterdiek 19, D-28357 Bremen > https://www.thetaphi.de > eMail: [email protected] > > > -----Original Message----- > > From: Robert Muir <[email protected]> > > Sent: Wednesday, December 8, 2021 8:13 PM > > To: [email protected] > > Cc: [email protected] > > Subject: Re: Strange error in Solr with Lucene 9.0.0 > > > > I'm able to reproduce this TestRandomDVFaceting one with Uwe's > > instructions. Just had no luck with the SimpleFacets test i was trying > > earlier. > > > > On Wed, Dec 8, 2021 at 2:07 PM Uwe Schindler <[email protected]> wrote: > > > > > > I was able to reproduce the problems with JDK 11.0.13 and also JDK 17: > > > > > > export TEST_JVM_ARGS=-XX:+UseCompressedOops -XX:+UseG1GC > > > gradlew :solr:core:test -Ptests.iters=1000 --tests > > TestRandomDVFaceting.testRandomFaceting - > Dtests.seed=3B93BA61C91F26D4 > > -Dtests.slow=true -Dtests.locale=uz-Latn - > > Dtests.timezone=America/Santa_Isabel -Dtests.asserts=true - > > Dtests.file.encoding=UTF-8 > > > > > > This is important to do: > > > * use -Ptests.iters=1000 to run the same test over and over in same JVM > > > * use the above TEST_JVM_ARGS to not run it with tiered compilation > turned > > off. > > > > > > It looks like a JVM issue in all JVMs after 11. So this is a serious bug. > > > In > Lucene > > tests we havent seen this! > > > > > > Uwe > > > > > > ----- > > > Uwe Schindler > > > Achterdiek 19, D-28357 Bremen > > > https://www.thetaphi.de > > > eMail: [email protected] > > > > > > > -----Original Message----- > > > > From: Robert Muir <[email protected]> > > > > Sent: Wednesday, December 8, 2021 6:44 PM > > > > To: [email protected] > > > > Cc: [email protected] > > > > Subject: Re: Strange error in Solr with Lucene 9.0.0 > > > > > > > > Uwe, it looks a little crazy: > > > > > > > > we've got asserts here that "index" is in bounds and certainly not -1 > > > > right before the method call! > > > > > > > https://github.com/apache/lucene/blob/main/lucene/core/src/java/org/apache > > > > /lucene/codecs/lucene90/Lucene90DocValuesProducer.java#L1123-L1125 > > > > > > > > On Wed, Dec 8, 2021 at 12:33 PM Uwe Schindler <[email protected]> > > wrote: > > > > > > > > > > I updated the dependencies of Solr's main branch to Lucene 9.0 > > > > > > > > > > On Mac and Linux, the following error occurs sometimes: > > > > > https://jenkins.thetaphi.de/job/Solr-main- > > Linux/2070/testReport/junit/org.ap > > > > > > > > > > > > ache.solr.request/SimpleFacetsTest/testRangeFacetFilterVsDocValuesRandom/ > > > > > https://jenkins.thetaphi.de/job/Solr-main- > > > > MacOSX/517/testReport/junit/org.ap > > > > > ache.solr/TestRandomDVFaceting/testRandomFaceting/ > > > > > > > > > > "ArrayIndexOutOfBoundsException: Index -1 out of bounds for length 1" > > at > > > > > > > > > > > > org.apache.lucene.util.packed.DirectMonotonicReader.get(DirectMonotonicRea > > > > de > > > > > r.java:161) > > > > > > > > > > This looks like a bug (or is Solr not using something with docvalues > > > > > correctly, but an AIOOBE should not happen)! > > > > > > > > > > When searching through the failure mails, it looks like this was > > > > > already > > > > > there with the Lucene preview from summer 2021. > > > > > > > > > > Uwe > > > > > > > > > > ----- > > > > > Uwe Schindler > > > > > Achterdiek 19, D-28357 Bremen > > > > > https://www.thetaphi.de > > > > > eMail: [email protected] > > > > > > > > > > > > > > > > > > > > --------------------------------------------------------------------- > > > > > To unsubscribe, e-mail: [email protected] > > > > > For additional commands, e-mail: [email protected] > > > > > > > > > > > > > --------------------------------------------------------------------- > > > > To unsubscribe, e-mail: [email protected] > > > > For additional commands, e-mail: [email protected] > > > > > > > > > --------------------------------------------------------------------- > > > To unsubscribe, e-mail: [email protected] > > > For additional commands, e-mail: [email protected] > > > > > > > --------------------------------------------------------------------- > > To unsubscribe, e-mail: [email protected] > > For additional commands, e-mail: [email protected] > > > --------------------------------------------------------------------- > To unsubscribe, e-mail: [email protected] > For additional commands, e-mail: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
