I was able to also reprodiuce it with TEST_JVM_ARGS=-Xint

So this is not a JVM bug, it’s a real problem in Lucene 9.0.0 (and was 
introduced in summer). Robert and I were wondering why the assertions did not 
hit, but it looks like the bitshift afterwards makes it negative.

We have to investigate and write a bug report for Lucene with reference to Solr.

Uwe

P.S.: For easier testing I merged over the rerun tests patch (LUCENE-9660) by 
Dawid from Lucene over to Solr.

-----
Uwe Schindler
Achterdiek 19, D-28357 Bremen
https://www.thetaphi.de
eMail: [email protected]

> -----Original Message-----
> From: Robert Muir <[email protected]>
> Sent: Wednesday, December 8, 2021 8:13 PM
> To: [email protected]
> Cc: [email protected]
> Subject: Re: Strange error in Solr with Lucene 9.0.0
> 
> I'm able to reproduce this TestRandomDVFaceting one with Uwe's
> instructions. Just had no luck with the SimpleFacets test i was trying
> earlier.
> 
> On Wed, Dec 8, 2021 at 2:07 PM Uwe Schindler <[email protected]> wrote:
> >
> > I was able to reproduce the problems with JDK 11.0.13 and also JDK 17:
> >
> > export TEST_JVM_ARGS=-XX:+UseCompressedOops -XX:+UseG1GC
> > gradlew :solr:core:test -Ptests.iters=1000 --tests
> TestRandomDVFaceting.testRandomFaceting -Dtests.seed=3B93BA61C91F26D4
> -Dtests.slow=true -Dtests.locale=uz-Latn -
> Dtests.timezone=America/Santa_Isabel -Dtests.asserts=true -
> Dtests.file.encoding=UTF-8
> >
> > This is important to do:
> > * use -Ptests.iters=1000 to run the same test over and over in same JVM
> > * use the above TEST_JVM_ARGS to not run it with tiered compilation turned
> off.
> >
> > It looks like a JVM issue in all JVMs after 11. So this is a serious bug. 
> > In Lucene
> tests we havent seen this!
> >
> > Uwe
> >
> > -----
> > Uwe Schindler
> > Achterdiek 19, D-28357 Bremen
> > https://www.thetaphi.de
> > eMail: [email protected]
> >
> > > -----Original Message-----
> > > From: Robert Muir <[email protected]>
> > > Sent: Wednesday, December 8, 2021 6:44 PM
> > > To: [email protected]
> > > Cc: [email protected]
> > > Subject: Re: Strange error in Solr with Lucene 9.0.0
> > >
> > > Uwe, it looks a little crazy:
> > >
> > > we've got asserts here that "index" is in bounds and certainly not -1
> > > right before the method call!
> > >
> https://github.com/apache/lucene/blob/main/lucene/core/src/java/org/apache
> > > /lucene/codecs/lucene90/Lucene90DocValuesProducer.java#L1123-L1125
> > >
> > > On Wed, Dec 8, 2021 at 12:33 PM Uwe Schindler <[email protected]>
> wrote:
> > > >
> > > > I updated the dependencies of Solr's main branch to Lucene 9.0
> > > >
> > > > On Mac and Linux, the following error occurs sometimes:
> > > > https://jenkins.thetaphi.de/job/Solr-main-
> Linux/2070/testReport/junit/org.ap
> > > >
> > >
> ache.solr.request/SimpleFacetsTest/testRangeFacetFilterVsDocValuesRandom/
> > > > https://jenkins.thetaphi.de/job/Solr-main-
> > > MacOSX/517/testReport/junit/org.ap
> > > > ache.solr/TestRandomDVFaceting/testRandomFaceting/
> > > >
> > > > "ArrayIndexOutOfBoundsException: Index -1 out of bounds for length 1"
> at
> > > >
> > >
> org.apache.lucene.util.packed.DirectMonotonicReader.get(DirectMonotonicRea
> > > de
> > > > r.java:161)
> > > >
> > > > This looks like a bug (or is Solr not using something with docvalues
> > > > correctly, but an AIOOBE should not happen)!
> > > >
> > > > When searching through the failure mails, it looks like this was already
> > > > there with the Lucene preview from summer 2021.
> > > >
> > > > Uwe
> > > >
> > > > -----
> > > > Uwe Schindler
> > > > Achterdiek 19, D-28357 Bremen
> > > > https://www.thetaphi.de
> > > > eMail: [email protected]
> > > >
> > > >
> > > >
> > > > ---------------------------------------------------------------------
> > > > To unsubscribe, e-mail: [email protected]
> > > > For additional commands, e-mail: [email protected]
> > > >
> > >
> > > ---------------------------------------------------------------------
> > > To unsubscribe, e-mail: [email protected]
> > > For additional commands, e-mail: [email protected]
> >
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: [email protected]
> > For additional commands, e-mail: [email protected]
> >
> 
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: [email protected]
> For additional commands, e-mail: [email protected]


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to