I hit this one running the smoke tester on 9.9.0 RC 0, and it repros. I'll open an issue ... I think it's just a missing null check in the SlowCompositeCodecReaderWrapper.
Mike McCandless http://blog.mikemccandless.com On Tue, Nov 28, 2023 at 6:37 PM Apache Jenkins Server < jenk...@builds.apache.org> wrote: > Build: > https://ci-builds.apache.org/job/Lucene/job/Lucene-Check-main/10750/ > > 2 tests failed. > FAILED: > org.apache.lucene.search.TestPointQueries.testAllPointDocsWereDeletedAndThenMergedAgain > > Error Message: > java.io.IOException: background merge hit exception: > _3(10.0.0):C2:[diagnostics={lucene.version=10.0.0, source=merge, > os.arch=amd64, java.runtime.version=17.0.7+7, mergeFactor=1, os=Linux, > java.vendor=Eclipse Adoptium, os.version=5.4.0-167-generic, > timestamp=1701213730838, > mergeMaxNumSegments=1}]:[attributes={Lucene90StoredFieldsFormat.mode=BEST_SPEED}] > :id=4i1dci11qy6ymdhw6cirss6iz into _4 [maxNumSegments=1] > > Stack Trace: > java.io.IOException: background merge hit exception: > _3(10.0.0):C2:[diagnostics={lucene.version=10.0.0, source=merge, > os.arch=amd64, java.runtime.version=17.0.7+7, mergeFactor=1, os=Linux, > java.vendor=Eclipse Adoptium, os.version=5.4.0-167-generic, > timestamp=1701213730838, > mergeMaxNumSegments=1}]:[attributes={Lucene90StoredFieldsFormat.mode=BEST_SPEED}] > :id=4i1dci11qy6ymdhw6cirss6iz into _4 [maxNumSegments=1] > at > __randomizedtesting.SeedInfo.seed([F9345050587589D4:B625E461757388B1]:0) > at > org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:2170) > at > org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:2099) > at > org.apache.lucene.search.TestPointQueries.testAllPointDocsWereDeletedAndThenMergedAgain(TestPointQueries.java:1212) > at > java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native > Method) > at > java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77) > at > java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.base/java.lang.reflect.Method.invoke(Method.java:568) > at > com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1758) > at > com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:946) > at > com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:982) > at > com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:996) > at > org.apache.lucene.tests.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:48) > at > org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43) > at > org.apache.lucene.tests.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:45) > at > org.apache.lucene.tests.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:60) > at > org.apache.lucene.tests.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:44) > at org.junit.rules.RunRules.evaluate(RunRules.java:20) > at > com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) > at > com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:390) > at > com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:843) > at > com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:490) > at > com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:955) > at > com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:840) > at > com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:891) > at > com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:902) > at > org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43) > at > com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) > at > org.apache.lucene.tests.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:38) > at > com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) > at > com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) > at > com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) > at > com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) > at > org.apache.lucene.tests.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53) > at > org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43) > at > org.apache.lucene.tests.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:44) > at > org.apache.lucene.tests.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:60) > at > org.apache.lucene.tests.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:47) > at org.junit.rules.RunRules.evaluate(RunRules.java:20) > at > com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) > at > com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:390) > at > com.carrotsearch.randomizedtesting.ThreadLeakControl.lambda$forkTimeoutingTask$0(ThreadLeakControl.java:850) > at java.base/java.lang.Thread.run(Thread.java:833) > Caused by: java.lang.NullPointerException: Cannot invoke > "org.apache.lucene.index.PointValues.size()" because "this.in" is null > at > org.apache.lucene.index.SortingCodecReader$SortingPointValues.size(SortingCodecReader.java:116) > at > org.apache.lucene.codecs.PointsWriter.mergeOneField(PointsWriter.java:51) > at > org.apache.lucene.codecs.PointsWriter.merge(PointsWriter.java:231) > at > org.apache.lucene.codecs.lucene90.Lucene90PointsWriter.merge(Lucene90PointsWriter.java:187) > at > org.apache.lucene.tests.codecs.asserting.AssertingPointsFormat$AssertingPointsWriter.merge(AssertingPointsFormat.java:133) > at > org.apache.lucene.index.SegmentMerger.mergePoints(SegmentMerger.java:185) > at > org.apache.lucene.index.SegmentMerger.mergeWithLogging(SegmentMerger.java:298) > at > org.apache.lucene.index.SegmentMerger.merge(SegmentMerger.java:145) > at > org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:5244) > at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:4732) > at > org.apache.lucene.index.IndexWriter$IndexWriterMergeSource.merge(IndexWriter.java:6533) > at > org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:639) > at > org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:700) > > > FAILED: org.apache.lucene.search.TestPointQueries.testWrongNumBytes > > Error Message: > com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an > uncaught exception in thread: Thread[id=981, name=Lucene Merge Thread #2, > state=RUNNABLE, group=TGRP-TestPointQueries] > > Stack Trace: > com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an > uncaught exception in thread: Thread[id=981, name=Lucene Merge Thread #2, > state=RUNNABLE, group=TGRP-TestPointQueries] > at > __randomizedtesting.SeedInfo.seed([F9345050587589D4:3ED723D709FA79D1]:0) > Caused by: org.apache.lucene.index.MergePolicy$MergeException: > java.lang.NullPointerException: Cannot invoke > "org.apache.lucene.index.PointValues.size()" because "this.in" is null > at __randomizedtesting.SeedInfo.seed([F9345050587589D4]:0) > at > app//org.apache.lucene.index.ConcurrentMergeScheduler.handleMergeException(ConcurrentMergeScheduler.java:735) > at > app//org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:727) > Caused by: java.lang.NullPointerException: Cannot invoke > "org.apache.lucene.index.PointValues.size()" because "this.in" is null > at > org.apache.lucene.index.SortingCodecReader$SortingPointValues.size(SortingCodecReader.java:116) > at > org.apache.lucene.codecs.PointsWriter.mergeOneField(PointsWriter.java:51) > at > org.apache.lucene.codecs.PointsWriter.merge(PointsWriter.java:231) > at > org.apache.lucene.codecs.lucene90.Lucene90PointsWriter.merge(Lucene90PointsWriter.java:187) > at > org.apache.lucene.tests.codecs.asserting.AssertingPointsFormat$AssertingPointsWriter.merge(AssertingPointsFormat.java:133) > at > org.apache.lucene.index.SegmentMerger.mergePoints(SegmentMerger.java:185) > at > org.apache.lucene.index.SegmentMerger.mergeWithLogging(SegmentMerger.java:298) > at > org.apache.lucene.index.SegmentMerger.merge(SegmentMerger.java:145) > at > org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:5244) > at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:4732) > at > org.apache.lucene.index.IndexWriter$IndexWriterMergeSource.merge(IndexWriter.java:6533) > at > org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:639) > at > org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:700) > > > > > Build Log: > [...truncated 1739 lines...] > ERROR: The following test(s) have failed: > - > org.apache.lucene.search.TestPointQueries.testAllPointDocsWereDeletedAndThenMergedAgain > (:lucene:core) > Test output: > /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Check-main/lucene/core/build/test-results/test/outputs/OUTPUT-org.apache.lucene.search.TestPointQueries.txt > Reproduce with: gradlew :lucene:core:test --tests > "org.apache.lucene.search.TestPointQueries.testAllPointDocsWereDeletedAndThenMergedAgain" > -Ptests.jvms=4 -Ptests.jvmargs= -Ptests.seed=F9345050587589D4 > -Ptests.multiplier=2 -Ptests.gui=true -Ptests.file.encoding=UTF-8 > -Ptests.vectorsize=512 > > - org.apache.lucene.search.TestPointQueries.testWrongNumBytes > (:lucene:core) > Test output: > /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Check-main/lucene/core/build/test-results/test/outputs/OUTPUT-org.apache.lucene.search.TestPointQueries.txt > Reproduce with: gradlew :lucene:core:test --tests > "org.apache.lucene.search.TestPointQueries.testWrongNumBytes" > -Ptests.jvms=4 -Ptests.jvmargs= -Ptests.seed=F9345050587589D4 > -Ptests.multiplier=2 -Ptests.gui=true -Ptests.file.encoding=UTF-8 > -Ptests.vectorsize=512 > > > Deprecated Gradle features were used in this build, making it incompatible > with Gradle 9.0. > > You can use '--warning-mode all' to show the individual deprecation > warnings and determine if they come from your own scripts or plugins. > > For more on this, please refer to > https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings > in the Gradle documentation. > > BUILD SUCCESSFUL in 31m 59s > 835 actionable tasks: 835 executed > > Publishing build scan... > https://ge.apache.org/s/ocgfxrfpsvfde > > Build step 'Invoke Gradle script' changed build result to SUCCESS > Archiving artifacts > hudson.FilePath$ValidateAntFileMask$1Cancel > at > hudson.FilePath$ValidateAntFileMask$1.isCaseSensitive(FilePath.java:3300) > at > org.apache.tools.ant.DirectoryScanner.lambda$isIncluded$3(DirectoryScanner.java:1374) > at > java.base/java.util.stream.MatchOps$1MatchSink.accept(MatchOps.java:90) > at > java.base/java.util.Spliterators$ArraySpliterator.tryAdvance(Spliterators.java:958) > at > java.base/java.util.stream.ReferencePipeline.forEachWithCancel(ReferencePipeline.java:127) > at > java.base/java.util.stream.AbstractPipeline.copyIntoWithCancel(AbstractPipeline.java:502) > at > java.base/java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:488) > at > java.base/java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:474) > at > java.base/java.util.stream.MatchOps$MatchOp.evaluateSequential(MatchOps.java:230) > at > java.base/java.util.stream.MatchOps$MatchOp.evaluateSequential(MatchOps.java:196) > at > java.base/java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) > at > java.base/java.util.stream.ReferencePipeline.anyMatch(ReferencePipeline.java:528) > at > org.apache.tools.ant.DirectoryScanner.isIncluded(DirectoryScanner.java:1374) > at > org.apache.tools.ant.DirectoryScanner.scandir(DirectoryScanner.java:1241) > at > org.apache.tools.ant.DirectoryScanner.scandir(DirectoryScanner.java:1267) > at > org.apache.tools.ant.DirectoryScanner.scandir(DirectoryScanner.java:1267) > at > org.apache.tools.ant.DirectoryScanner.scandir(DirectoryScanner.java:1267) > at > org.apache.tools.ant.DirectoryScanner.scandir(DirectoryScanner.java:1267) > at > org.apache.tools.ant.DirectoryScanner.scandir(DirectoryScanner.java:1267) > at > org.apache.tools.ant.DirectoryScanner.scandir(DirectoryScanner.java:1267) > at > org.apache.tools.ant.DirectoryScanner.scandir(DirectoryScanner.java:1267) > at > org.apache.tools.ant.DirectoryScanner.scandir(DirectoryScanner.java:1267) > at > org.apache.tools.ant.DirectoryScanner.scandir(DirectoryScanner.java:1267) > at > org.apache.tools.ant.DirectoryScanner.scandir(DirectoryScanner.java:1267) > at > org.apache.tools.ant.DirectoryScanner.scandir(DirectoryScanner.java:1267) > at > org.apache.tools.ant.DirectoryScanner.scandir(DirectoryScanner.java:1194) > at > org.apache.tools.ant.DirectoryScanner.scandir(DirectoryScanner.java:1156) > at > org.apache.tools.ant.DirectoryScanner.checkIncludePatterns(DirectoryScanner.java:954) > at > org.apache.tools.ant.DirectoryScanner.scan(DirectoryScanner.java:912) > at hudson.FilePath$ValidateAntFileMask.hasMatch(FilePath.java:3313) > Caused: hudson.FilePath$FileMaskNoMatchesFoundException: no matches found > within 10000 > at hudson.FilePath$ValidateAntFileMask.hasMatch(FilePath.java:3318) > at hudson.FilePath$ValidateAntFileMask.invoke(FilePath.java:3196) > at hudson.FilePath$ValidateAntFileMask.invoke(FilePath.java:3174) > at hudson.FilePath$FileCallableWrapper.call(FilePath.java:3578) > Also: hudson.remoting.Channel$CallSiteStackTrace: Remote call to > lucene-solr-2 > at > hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1784) > at > hudson.remoting.UserRequest$ExceptionResponse.retrieve(UserRequest.java:356) > at hudson.remoting.Channel.call(Channel.java:1000) > at hudson.FilePath.act(FilePath.java:1192) > at hudson.FilePath.act(FilePath.java:1181) > at hudson.FilePath.validateAntFileMask(FilePath.java:3171) > at > hudson.tasks.ArtifactArchiver.perform(ArtifactArchiver.java:271) > at > hudson.tasks.BuildStepCompatibilityLayer.perform(BuildStepCompatibilityLayer.java:80) > at > hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20) > at > hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:818) > at > hudson.model.AbstractBuild$AbstractBuildExecution.performAllBuildSteps(AbstractBuild.java:767) > at hudson.model.Build$BuildExecution.post2(Build.java:179) > at > hudson.model.AbstractBuild$AbstractBuildExecution.post(AbstractBuild.java:711) > at hudson.model.Run.execute(Run.java:1925) > at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:44) > at > hudson.model.ResourceController.execute(ResourceController.java:101) > at hudson.model.Executor.run(Executor.java:442) > Caused: hudson.FilePath$TunneledInterruptedException > at hudson.FilePath$FileCallableWrapper.call(FilePath.java:3580) > at hudson.remoting.UserRequest.perform(UserRequest.java:211) > at hudson.remoting.UserRequest.perform(UserRequest.java:54) > at hudson.remoting.Request$2.run(Request.java:377) > at > hudson.remoting.InterceptingExecutorService.lambda$wrap$0(InterceptingExecutorService.java:78) > at > java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264) > at > java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) > at > java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) > at java.base/java.lang.Thread.run(Thread.java:829) > Caused: java.lang.InterruptedException: > hudson.FilePath$FileMaskNoMatchesFoundException: no matches found within > 10000 > at hudson.FilePath.act(FilePath.java:1194) > at hudson.FilePath.act(FilePath.java:1181) > at hudson.FilePath.validateAntFileMask(FilePath.java:3171) > at hudson.tasks.ArtifactArchiver.perform(ArtifactArchiver.java:271) > at > hudson.tasks.BuildStepCompatibilityLayer.perform(BuildStepCompatibilityLayer.java:80) > at > hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20) > at > hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:818) > at > hudson.model.AbstractBuild$AbstractBuildExecution.performAllBuildSteps(AbstractBuild.java:767) > at hudson.model.Build$BuildExecution.post2(Build.java:179) > at > hudson.model.AbstractBuild$AbstractBuildExecution.post(AbstractBuild.java:711) > at hudson.model.Run.execute(Run.java:1925) > at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:44) > at > hudson.model.ResourceController.execute(ResourceController.java:101) > at hudson.model.Executor.run(Executor.java:442) > No artifacts found that match the file pattern > "**/*.events,heapdumps/**,**/hs_err_pid*". Configuration error? > Recording test results > [Checks API] No suitable checks publisher found. > Build step 'Publish JUnit test result report' changed build result to > UNSTABLE > Email was triggered for: Unstable (Test Failures) > Sending email for trigger: Unstable (Test Failures) > > --------------------------------------------------------------------- > To unsubscribe, e-mail: builds-unsubscr...@lucene.apache.org > For additional commands, e-mail: builds-h...@lucene.apache.org