[jira] [Commented] (LUCENE-9070) TestLRUCache failures

2019-11-28 Thread Atri Sharma (Jira)


[ 
https://issues.apache.org/jira/browse/LUCENE-9070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16984474#comment-16984474
 ] 

Atri Sharma commented on LUCENE-9070:
-

[~jpountz] Done

> TestLRUCache failures
> -
>
> Key: LUCENE-9070
> URL: https://issues.apache.org/jira/browse/LUCENE-9070
> Project: Lucene - Core
>  Issue Type: Bug
>Reporter: Adrien Grand
>Priority: Major
>
> {noformat}
> 02:11:11[junit4] Suite: org.apache.lucene.search.TestLRUQueryCache
> 02:11:11[junit4] IGNOR/A 0.00s J3 | 
> TestLRUQueryCache.testRamBytesUsedAgreesWithRamUsageTester
> 02:11:11[junit4]> Assumption #1: LUCENE-7595: RamUsageTester does not 
> work exact in Java 9 (estimations for maps and lists)
> 02:11:11[junit4] IGNOR/A 0.00s J3 | 
> TestLRUQueryCache.testRamBytesUsedConstantEntryOverhead
> 02:11:11[junit4]> Assumption #1: LUCENE-7595: RamUsageTester does not 
> work exact in Java 9 (estimations for maps and lists)
> 02:11:11[junit4] IGNOR/A 0.00s J3 | 
> TestLRUQueryCache.testDetectMutatedQueries
> 02:11:11[junit4]> Assumption #1: LUCENE-7604: For some unknown reason 
> the non-constant BadQuery#hashCode() does not trigger 
> ConcurrentModificationException on Java 9 b150
> 02:11:11[junit4]   2> NOTE: reproduce with: ant test  
> -Dtestcase=TestLRUQueryCache -Dtests.method=testLRUConcurrentLoadsOfSameQuery 
> -Dtests.seed=205F9EFCF29BA4D6 -Dtests.slow=true -Dtests.badapples=true 
> -Dtests.locale=so-ET -Dtests.timezone=Europe/Ljubljana -Dtests.asserts=true 
> -Dtests.file.encoding=UTF-8
> 02:11:11[junit4] ERROR   0.02s J3 | 
> TestLRUQueryCache.testLRUConcurrentLoadsOfSameQuery <<<
> 02:11:11[junit4]> Throwable #1: java.lang.RuntimeException: 
> MockDirectoryWrapper: cannot close: there are still 1 open files: {_0.cfs=1}
> 02:11:11[junit4]> at 
> __randomizedtesting.SeedInfo.seed([205F9EFCF29BA4D6:5E7DB1C91CF54294]:0)
> 02:11:11[junit4]> at 
> org.apache.lucene.store.MockDirectoryWrapper.close(MockDirectoryWrapper.java:807)
> 02:11:11[junit4]> at 
> org.apache.lucene.search.TestLRUQueryCache.testLRUConcurrentLoadsOfSameQuery(TestLRUQueryCache.java:465)
> 02:11:11[junit4]> at 
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 02:11:11[junit4]> at 
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> 02:11:11[junit4]> at 
> java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 02:11:11[junit4]> at 
> java.base/java.lang.reflect.Method.invoke(Method.java:566)
> 02:11:11[junit4]> at 
> java.base/java.lang.Thread.run(Thread.java:834)
> 02:11:11[junit4]> Caused by: java.lang.RuntimeException: unclosed 
> IndexInput: _0.cfs
> 02:11:11[junit4]> at 
> org.apache.lucene.store.MockDirectoryWrapper.addFileHandle(MockDirectoryWrapper.java:725)
> 02:11:11[junit4]> at 
> org.apache.lucene.store.MockDirectoryWrapper.openInput(MockDirectoryWrapper.java:768)
> 02:11:11[junit4]> at 
> org.apache.lucene.codecs.lucene50.Lucene50CompoundReader.(Lucene50CompoundReader.java:79)
> 02:11:11[junit4]> at 
> org.apache.lucene.codecs.lucene50.Lucene50CompoundFormat.getCompoundReader(Lucene50CompoundFormat.java:70)
> 02:11:11[junit4]> at 
> org.apache.lucene.index.SegmentCoreReaders.(SegmentCoreReaders.java:101)
> 02:11:11[junit4]> at 
> org.apache.lucene.index.SegmentReader.(SegmentReader.java:84)
> 02:11:11[junit4]> at 
> org.apache.lucene.index.ReadersAndUpdates.getReader(ReadersAndUpdates.java:177)
> 02:11:11[junit4]> at 
> org.apache.lucene.index.ReadersAndUpdates.getReadOnlyClone(ReadersAndUpdates.java:219)
> 02:11:11[junit4]> at 
> org.apache.lucene.index.StandardDirectoryReader.open(StandardDirectoryReader.java:109)
> 02:11:11[junit4]> at 
> org.apache.lucene.index.IndexWriter.getReader(IndexWriter.java:526)
> 02:11:11[junit4]> at 
> org.apache.lucene.index.RandomIndexWriter.getReader(RandomIndexWriter.java:442)
> 02:11:11[junit4]> at 
> org.apache.lucene.index.RandomIndexWriter.getReader(RandomIndexWriter.java:376)
> 02:11:11[junit4]> at 
> org.apache.lucene.search.TestLRUQueryCache.testLRUConcurrentLoadsOfSameQuery(TestLRUQueryCache.java:418)
> 02:11:11[junit4]> ... 35 more
> 02:11:11[junit4]   2> NOTE: leaving temporary files on disk at: 
> /var/lib/jenkins/workspace/apache+lucene-solr+master/lucene/build/core/test/J3/temp/lucene.search.TestLRUQueryCache_205F9EFCF29BA4D6-001
> 02:11:11[junit4]   2> Nov 27, 2019 12:10:48 AM 
> com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
> 02:11:11

[jira] [Commented] (LUCENE-9070) TestLRUCache failures

2019-11-28 Thread Adrien Grand (Jira)


[ 
https://issues.apache.org/jira/browse/LUCENE-9070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16984467#comment-16984467
 ] 

Adrien Grand commented on LUCENE-9070:
--

Can you revert for now then?

> TestLRUCache failures
> -
>
> Key: LUCENE-9070
> URL: https://issues.apache.org/jira/browse/LUCENE-9070
> Project: Lucene - Core
>  Issue Type: Bug
>Reporter: Adrien Grand
>Priority: Major
>
> {noformat}
> 02:11:11[junit4] Suite: org.apache.lucene.search.TestLRUQueryCache
> 02:11:11[junit4] IGNOR/A 0.00s J3 | 
> TestLRUQueryCache.testRamBytesUsedAgreesWithRamUsageTester
> 02:11:11[junit4]> Assumption #1: LUCENE-7595: RamUsageTester does not 
> work exact in Java 9 (estimations for maps and lists)
> 02:11:11[junit4] IGNOR/A 0.00s J3 | 
> TestLRUQueryCache.testRamBytesUsedConstantEntryOverhead
> 02:11:11[junit4]> Assumption #1: LUCENE-7595: RamUsageTester does not 
> work exact in Java 9 (estimations for maps and lists)
> 02:11:11[junit4] IGNOR/A 0.00s J3 | 
> TestLRUQueryCache.testDetectMutatedQueries
> 02:11:11[junit4]> Assumption #1: LUCENE-7604: For some unknown reason 
> the non-constant BadQuery#hashCode() does not trigger 
> ConcurrentModificationException on Java 9 b150
> 02:11:11[junit4]   2> NOTE: reproduce with: ant test  
> -Dtestcase=TestLRUQueryCache -Dtests.method=testLRUConcurrentLoadsOfSameQuery 
> -Dtests.seed=205F9EFCF29BA4D6 -Dtests.slow=true -Dtests.badapples=true 
> -Dtests.locale=so-ET -Dtests.timezone=Europe/Ljubljana -Dtests.asserts=true 
> -Dtests.file.encoding=UTF-8
> 02:11:11[junit4] ERROR   0.02s J3 | 
> TestLRUQueryCache.testLRUConcurrentLoadsOfSameQuery <<<
> 02:11:11[junit4]> Throwable #1: java.lang.RuntimeException: 
> MockDirectoryWrapper: cannot close: there are still 1 open files: {_0.cfs=1}
> 02:11:11[junit4]> at 
> __randomizedtesting.SeedInfo.seed([205F9EFCF29BA4D6:5E7DB1C91CF54294]:0)
> 02:11:11[junit4]> at 
> org.apache.lucene.store.MockDirectoryWrapper.close(MockDirectoryWrapper.java:807)
> 02:11:11[junit4]> at 
> org.apache.lucene.search.TestLRUQueryCache.testLRUConcurrentLoadsOfSameQuery(TestLRUQueryCache.java:465)
> 02:11:11[junit4]> at 
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 02:11:11[junit4]> at 
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> 02:11:11[junit4]> at 
> java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 02:11:11[junit4]> at 
> java.base/java.lang.reflect.Method.invoke(Method.java:566)
> 02:11:11[junit4]> at 
> java.base/java.lang.Thread.run(Thread.java:834)
> 02:11:11[junit4]> Caused by: java.lang.RuntimeException: unclosed 
> IndexInput: _0.cfs
> 02:11:11[junit4]> at 
> org.apache.lucene.store.MockDirectoryWrapper.addFileHandle(MockDirectoryWrapper.java:725)
> 02:11:11[junit4]> at 
> org.apache.lucene.store.MockDirectoryWrapper.openInput(MockDirectoryWrapper.java:768)
> 02:11:11[junit4]> at 
> org.apache.lucene.codecs.lucene50.Lucene50CompoundReader.(Lucene50CompoundReader.java:79)
> 02:11:11[junit4]> at 
> org.apache.lucene.codecs.lucene50.Lucene50CompoundFormat.getCompoundReader(Lucene50CompoundFormat.java:70)
> 02:11:11[junit4]> at 
> org.apache.lucene.index.SegmentCoreReaders.(SegmentCoreReaders.java:101)
> 02:11:11[junit4]> at 
> org.apache.lucene.index.SegmentReader.(SegmentReader.java:84)
> 02:11:11[junit4]> at 
> org.apache.lucene.index.ReadersAndUpdates.getReader(ReadersAndUpdates.java:177)
> 02:11:11[junit4]> at 
> org.apache.lucene.index.ReadersAndUpdates.getReadOnlyClone(ReadersAndUpdates.java:219)
> 02:11:11[junit4]> at 
> org.apache.lucene.index.StandardDirectoryReader.open(StandardDirectoryReader.java:109)
> 02:11:11[junit4]> at 
> org.apache.lucene.index.IndexWriter.getReader(IndexWriter.java:526)
> 02:11:11[junit4]> at 
> org.apache.lucene.index.RandomIndexWriter.getReader(RandomIndexWriter.java:442)
> 02:11:11[junit4]> at 
> org.apache.lucene.index.RandomIndexWriter.getReader(RandomIndexWriter.java:376)
> 02:11:11[junit4]> at 
> org.apache.lucene.search.TestLRUQueryCache.testLRUConcurrentLoadsOfSameQuery(TestLRUQueryCache.java:418)
> 02:11:11[junit4]> ... 35 more
> 02:11:11[junit4]   2> NOTE: leaving temporary files on disk at: 
> /var/lib/jenkins/workspace/apache+lucene-solr+master/lucene/build/core/test/J3/temp/lucene.search.TestLRUQueryCache_205F9EFCF29BA4D6-001
> 02:11:11[junit4]   2> Nov 27, 2019 12:10:48 AM 
> com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
> 

[jira] [Commented] (LUCENE-9070) TestLRUCache failures

2019-11-28 Thread Atri Sharma (Jira)


[ 
https://issues.apache.org/jira/browse/LUCENE-9070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16984462#comment-16984462
 ] 

Atri Sharma commented on LUCENE-9070:
-

I am +1 for reverting, though trying to identify if it is more of a test issue 
rather than a functionality issue. I beasted the test suite using the seeds 
that were mentioned in the stack trace of the failing tests but to no avail. 
The last failure seems more of an edge case of how a List is printed in Java (I 
believe there is no guarantee to the order in which elements would be printed 
when printing a list, and the test seems to be taking a dependency on that).

> TestLRUCache failures
> -
>
> Key: LUCENE-9070
> URL: https://issues.apache.org/jira/browse/LUCENE-9070
> Project: Lucene - Core
>  Issue Type: Bug
>Reporter: Adrien Grand
>Priority: Major
>
> {noformat}
> 02:11:11[junit4] Suite: org.apache.lucene.search.TestLRUQueryCache
> 02:11:11[junit4] IGNOR/A 0.00s J3 | 
> TestLRUQueryCache.testRamBytesUsedAgreesWithRamUsageTester
> 02:11:11[junit4]> Assumption #1: LUCENE-7595: RamUsageTester does not 
> work exact in Java 9 (estimations for maps and lists)
> 02:11:11[junit4] IGNOR/A 0.00s J3 | 
> TestLRUQueryCache.testRamBytesUsedConstantEntryOverhead
> 02:11:11[junit4]> Assumption #1: LUCENE-7595: RamUsageTester does not 
> work exact in Java 9 (estimations for maps and lists)
> 02:11:11[junit4] IGNOR/A 0.00s J3 | 
> TestLRUQueryCache.testDetectMutatedQueries
> 02:11:11[junit4]> Assumption #1: LUCENE-7604: For some unknown reason 
> the non-constant BadQuery#hashCode() does not trigger 
> ConcurrentModificationException on Java 9 b150
> 02:11:11[junit4]   2> NOTE: reproduce with: ant test  
> -Dtestcase=TestLRUQueryCache -Dtests.method=testLRUConcurrentLoadsOfSameQuery 
> -Dtests.seed=205F9EFCF29BA4D6 -Dtests.slow=true -Dtests.badapples=true 
> -Dtests.locale=so-ET -Dtests.timezone=Europe/Ljubljana -Dtests.asserts=true 
> -Dtests.file.encoding=UTF-8
> 02:11:11[junit4] ERROR   0.02s J3 | 
> TestLRUQueryCache.testLRUConcurrentLoadsOfSameQuery <<<
> 02:11:11[junit4]> Throwable #1: java.lang.RuntimeException: 
> MockDirectoryWrapper: cannot close: there are still 1 open files: {_0.cfs=1}
> 02:11:11[junit4]> at 
> __randomizedtesting.SeedInfo.seed([205F9EFCF29BA4D6:5E7DB1C91CF54294]:0)
> 02:11:11[junit4]> at 
> org.apache.lucene.store.MockDirectoryWrapper.close(MockDirectoryWrapper.java:807)
> 02:11:11[junit4]> at 
> org.apache.lucene.search.TestLRUQueryCache.testLRUConcurrentLoadsOfSameQuery(TestLRUQueryCache.java:465)
> 02:11:11[junit4]> at 
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 02:11:11[junit4]> at 
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> 02:11:11[junit4]> at 
> java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 02:11:11[junit4]> at 
> java.base/java.lang.reflect.Method.invoke(Method.java:566)
> 02:11:11[junit4]> at 
> java.base/java.lang.Thread.run(Thread.java:834)
> 02:11:11[junit4]> Caused by: java.lang.RuntimeException: unclosed 
> IndexInput: _0.cfs
> 02:11:11[junit4]> at 
> org.apache.lucene.store.MockDirectoryWrapper.addFileHandle(MockDirectoryWrapper.java:725)
> 02:11:11[junit4]> at 
> org.apache.lucene.store.MockDirectoryWrapper.openInput(MockDirectoryWrapper.java:768)
> 02:11:11[junit4]> at 
> org.apache.lucene.codecs.lucene50.Lucene50CompoundReader.(Lucene50CompoundReader.java:79)
> 02:11:11[junit4]> at 
> org.apache.lucene.codecs.lucene50.Lucene50CompoundFormat.getCompoundReader(Lucene50CompoundFormat.java:70)
> 02:11:11[junit4]> at 
> org.apache.lucene.index.SegmentCoreReaders.(SegmentCoreReaders.java:101)
> 02:11:11[junit4]> at 
> org.apache.lucene.index.SegmentReader.(SegmentReader.java:84)
> 02:11:11[junit4]> at 
> org.apache.lucene.index.ReadersAndUpdates.getReader(ReadersAndUpdates.java:177)
> 02:11:11[junit4]> at 
> org.apache.lucene.index.ReadersAndUpdates.getReadOnlyClone(ReadersAndUpdates.java:219)
> 02:11:11[junit4]> at 
> org.apache.lucene.index.StandardDirectoryReader.open(StandardDirectoryReader.java:109)
> 02:11:11[junit4]> at 
> org.apache.lucene.index.IndexWriter.getReader(IndexWriter.java:526)
> 02:11:11[junit4]> at 
> org.apache.lucene.index.RandomIndexWriter.getReader(RandomIndexWriter.java:442)
> 02:11:11[junit4]> at 
> org.apache.lucene.index.RandomIndexWriter.getReader(RandomIndexWriter.java:376)
> 02:11:11[junit4]> at 
> 

[jira] [Commented] (LUCENE-9070) TestLRUCache failures

2019-11-28 Thread Andrzej Bialecki (Jira)


[ 
https://issues.apache.org/jira/browse/LUCENE-9070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16984459#comment-16984459
 ] 

Andrzej Bialecki commented on LUCENE-9070:
--

Sometimes I have a better luck reproducing elusive jenkins failures by running 
tests while generating heavy load, eg. video encoding, {{find / -exec grep foo 
{}\;}} or something like that...

> TestLRUCache failures
> -
>
> Key: LUCENE-9070
> URL: https://issues.apache.org/jira/browse/LUCENE-9070
> Project: Lucene - Core
>  Issue Type: Bug
>Reporter: Adrien Grand
>Priority: Major
>
> {noformat}
> 02:11:11[junit4] Suite: org.apache.lucene.search.TestLRUQueryCache
> 02:11:11[junit4] IGNOR/A 0.00s J3 | 
> TestLRUQueryCache.testRamBytesUsedAgreesWithRamUsageTester
> 02:11:11[junit4]> Assumption #1: LUCENE-7595: RamUsageTester does not 
> work exact in Java 9 (estimations for maps and lists)
> 02:11:11[junit4] IGNOR/A 0.00s J3 | 
> TestLRUQueryCache.testRamBytesUsedConstantEntryOverhead
> 02:11:11[junit4]> Assumption #1: LUCENE-7595: RamUsageTester does not 
> work exact in Java 9 (estimations for maps and lists)
> 02:11:11[junit4] IGNOR/A 0.00s J3 | 
> TestLRUQueryCache.testDetectMutatedQueries
> 02:11:11[junit4]> Assumption #1: LUCENE-7604: For some unknown reason 
> the non-constant BadQuery#hashCode() does not trigger 
> ConcurrentModificationException on Java 9 b150
> 02:11:11[junit4]   2> NOTE: reproduce with: ant test  
> -Dtestcase=TestLRUQueryCache -Dtests.method=testLRUConcurrentLoadsOfSameQuery 
> -Dtests.seed=205F9EFCF29BA4D6 -Dtests.slow=true -Dtests.badapples=true 
> -Dtests.locale=so-ET -Dtests.timezone=Europe/Ljubljana -Dtests.asserts=true 
> -Dtests.file.encoding=UTF-8
> 02:11:11[junit4] ERROR   0.02s J3 | 
> TestLRUQueryCache.testLRUConcurrentLoadsOfSameQuery <<<
> 02:11:11[junit4]> Throwable #1: java.lang.RuntimeException: 
> MockDirectoryWrapper: cannot close: there are still 1 open files: {_0.cfs=1}
> 02:11:11[junit4]> at 
> __randomizedtesting.SeedInfo.seed([205F9EFCF29BA4D6:5E7DB1C91CF54294]:0)
> 02:11:11[junit4]> at 
> org.apache.lucene.store.MockDirectoryWrapper.close(MockDirectoryWrapper.java:807)
> 02:11:11[junit4]> at 
> org.apache.lucene.search.TestLRUQueryCache.testLRUConcurrentLoadsOfSameQuery(TestLRUQueryCache.java:465)
> 02:11:11[junit4]> at 
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 02:11:11[junit4]> at 
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> 02:11:11[junit4]> at 
> java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 02:11:11[junit4]> at 
> java.base/java.lang.reflect.Method.invoke(Method.java:566)
> 02:11:11[junit4]> at 
> java.base/java.lang.Thread.run(Thread.java:834)
> 02:11:11[junit4]> Caused by: java.lang.RuntimeException: unclosed 
> IndexInput: _0.cfs
> 02:11:11[junit4]> at 
> org.apache.lucene.store.MockDirectoryWrapper.addFileHandle(MockDirectoryWrapper.java:725)
> 02:11:11[junit4]> at 
> org.apache.lucene.store.MockDirectoryWrapper.openInput(MockDirectoryWrapper.java:768)
> 02:11:11[junit4]> at 
> org.apache.lucene.codecs.lucene50.Lucene50CompoundReader.(Lucene50CompoundReader.java:79)
> 02:11:11[junit4]> at 
> org.apache.lucene.codecs.lucene50.Lucene50CompoundFormat.getCompoundReader(Lucene50CompoundFormat.java:70)
> 02:11:11[junit4]> at 
> org.apache.lucene.index.SegmentCoreReaders.(SegmentCoreReaders.java:101)
> 02:11:11[junit4]> at 
> org.apache.lucene.index.SegmentReader.(SegmentReader.java:84)
> 02:11:11[junit4]> at 
> org.apache.lucene.index.ReadersAndUpdates.getReader(ReadersAndUpdates.java:177)
> 02:11:11[junit4]> at 
> org.apache.lucene.index.ReadersAndUpdates.getReadOnlyClone(ReadersAndUpdates.java:219)
> 02:11:11[junit4]> at 
> org.apache.lucene.index.StandardDirectoryReader.open(StandardDirectoryReader.java:109)
> 02:11:11[junit4]> at 
> org.apache.lucene.index.IndexWriter.getReader(IndexWriter.java:526)
> 02:11:11[junit4]> at 
> org.apache.lucene.index.RandomIndexWriter.getReader(RandomIndexWriter.java:442)
> 02:11:11[junit4]> at 
> org.apache.lucene.index.RandomIndexWriter.getReader(RandomIndexWriter.java:376)
> 02:11:11[junit4]> at 
> org.apache.lucene.search.TestLRUQueryCache.testLRUConcurrentLoadsOfSameQuery(TestLRUQueryCache.java:418)
> 02:11:11[junit4]> ... 35 more
> 02:11:11[junit4]   2> NOTE: leaving temporary files on disk at: 
> 

[jira] [Commented] (LUCENE-9070) TestLRUCache failures

2019-11-28 Thread Adrien Grand (Jira)


[ 
https://issues.apache.org/jira/browse/LUCENE-9070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16984452#comment-16984452
 ] 

Adrien Grand commented on LUCENE-9070:
--

I believe some of these failures don't reproduce because they depend on timing 
(I haven't looked in details), but we should still work on fixing them. If this 
doesn't look like an easy fix, then let's revert asynchronous caching in order 
to not get flooded by test failures?

> TestLRUCache failures
> -
>
> Key: LUCENE-9070
> URL: https://issues.apache.org/jira/browse/LUCENE-9070
> Project: Lucene - Core
>  Issue Type: Bug
>Reporter: Adrien Grand
>Priority: Major
>
> {noformat}
> 02:11:11[junit4] Suite: org.apache.lucene.search.TestLRUQueryCache
> 02:11:11[junit4] IGNOR/A 0.00s J3 | 
> TestLRUQueryCache.testRamBytesUsedAgreesWithRamUsageTester
> 02:11:11[junit4]> Assumption #1: LUCENE-7595: RamUsageTester does not 
> work exact in Java 9 (estimations for maps and lists)
> 02:11:11[junit4] IGNOR/A 0.00s J3 | 
> TestLRUQueryCache.testRamBytesUsedConstantEntryOverhead
> 02:11:11[junit4]> Assumption #1: LUCENE-7595: RamUsageTester does not 
> work exact in Java 9 (estimations for maps and lists)
> 02:11:11[junit4] IGNOR/A 0.00s J3 | 
> TestLRUQueryCache.testDetectMutatedQueries
> 02:11:11[junit4]> Assumption #1: LUCENE-7604: For some unknown reason 
> the non-constant BadQuery#hashCode() does not trigger 
> ConcurrentModificationException on Java 9 b150
> 02:11:11[junit4]   2> NOTE: reproduce with: ant test  
> -Dtestcase=TestLRUQueryCache -Dtests.method=testLRUConcurrentLoadsOfSameQuery 
> -Dtests.seed=205F9EFCF29BA4D6 -Dtests.slow=true -Dtests.badapples=true 
> -Dtests.locale=so-ET -Dtests.timezone=Europe/Ljubljana -Dtests.asserts=true 
> -Dtests.file.encoding=UTF-8
> 02:11:11[junit4] ERROR   0.02s J3 | 
> TestLRUQueryCache.testLRUConcurrentLoadsOfSameQuery <<<
> 02:11:11[junit4]> Throwable #1: java.lang.RuntimeException: 
> MockDirectoryWrapper: cannot close: there are still 1 open files: {_0.cfs=1}
> 02:11:11[junit4]> at 
> __randomizedtesting.SeedInfo.seed([205F9EFCF29BA4D6:5E7DB1C91CF54294]:0)
> 02:11:11[junit4]> at 
> org.apache.lucene.store.MockDirectoryWrapper.close(MockDirectoryWrapper.java:807)
> 02:11:11[junit4]> at 
> org.apache.lucene.search.TestLRUQueryCache.testLRUConcurrentLoadsOfSameQuery(TestLRUQueryCache.java:465)
> 02:11:11[junit4]> at 
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 02:11:11[junit4]> at 
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> 02:11:11[junit4]> at 
> java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 02:11:11[junit4]> at 
> java.base/java.lang.reflect.Method.invoke(Method.java:566)
> 02:11:11[junit4]> at 
> java.base/java.lang.Thread.run(Thread.java:834)
> 02:11:11[junit4]> Caused by: java.lang.RuntimeException: unclosed 
> IndexInput: _0.cfs
> 02:11:11[junit4]> at 
> org.apache.lucene.store.MockDirectoryWrapper.addFileHandle(MockDirectoryWrapper.java:725)
> 02:11:11[junit4]> at 
> org.apache.lucene.store.MockDirectoryWrapper.openInput(MockDirectoryWrapper.java:768)
> 02:11:11[junit4]> at 
> org.apache.lucene.codecs.lucene50.Lucene50CompoundReader.(Lucene50CompoundReader.java:79)
> 02:11:11[junit4]> at 
> org.apache.lucene.codecs.lucene50.Lucene50CompoundFormat.getCompoundReader(Lucene50CompoundFormat.java:70)
> 02:11:11[junit4]> at 
> org.apache.lucene.index.SegmentCoreReaders.(SegmentCoreReaders.java:101)
> 02:11:11[junit4]> at 
> org.apache.lucene.index.SegmentReader.(SegmentReader.java:84)
> 02:11:11[junit4]> at 
> org.apache.lucene.index.ReadersAndUpdates.getReader(ReadersAndUpdates.java:177)
> 02:11:11[junit4]> at 
> org.apache.lucene.index.ReadersAndUpdates.getReadOnlyClone(ReadersAndUpdates.java:219)
> 02:11:11[junit4]> at 
> org.apache.lucene.index.StandardDirectoryReader.open(StandardDirectoryReader.java:109)
> 02:11:11[junit4]> at 
> org.apache.lucene.index.IndexWriter.getReader(IndexWriter.java:526)
> 02:11:11[junit4]> at 
> org.apache.lucene.index.RandomIndexWriter.getReader(RandomIndexWriter.java:442)
> 02:11:11[junit4]> at 
> org.apache.lucene.index.RandomIndexWriter.getReader(RandomIndexWriter.java:376)
> 02:11:11[junit4]> at 
> org.apache.lucene.search.TestLRUQueryCache.testLRUConcurrentLoadsOfSameQuery(TestLRUQueryCache.java:418)
> 02:11:11[junit4]> ... 35 more
> 02:11:11[junit4]   2> NOTE: leaving temporary files on disk at: 
> 

[jira] [Commented] (LUCENE-9070) TestLRUCache failures

2019-11-28 Thread Atri Sharma (Jira)


[ 
https://issues.apache.org/jira/browse/LUCENE-9070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16984433#comment-16984433
 ] 

Atri Sharma commented on LUCENE-9070:
-

[~jpountz] I investigated the two that you pointed a few hours back -- could 
not reproduce them

Looking at the latest one now

> TestLRUCache failures
> -
>
> Key: LUCENE-9070
> URL: https://issues.apache.org/jira/browse/LUCENE-9070
> Project: Lucene - Core
>  Issue Type: Bug
>Reporter: Adrien Grand
>Priority: Major
>
> {noformat}
> 02:11:11[junit4] Suite: org.apache.lucene.search.TestLRUQueryCache
> 02:11:11[junit4] IGNOR/A 0.00s J3 | 
> TestLRUQueryCache.testRamBytesUsedAgreesWithRamUsageTester
> 02:11:11[junit4]> Assumption #1: LUCENE-7595: RamUsageTester does not 
> work exact in Java 9 (estimations for maps and lists)
> 02:11:11[junit4] IGNOR/A 0.00s J3 | 
> TestLRUQueryCache.testRamBytesUsedConstantEntryOverhead
> 02:11:11[junit4]> Assumption #1: LUCENE-7595: RamUsageTester does not 
> work exact in Java 9 (estimations for maps and lists)
> 02:11:11[junit4] IGNOR/A 0.00s J3 | 
> TestLRUQueryCache.testDetectMutatedQueries
> 02:11:11[junit4]> Assumption #1: LUCENE-7604: For some unknown reason 
> the non-constant BadQuery#hashCode() does not trigger 
> ConcurrentModificationException on Java 9 b150
> 02:11:11[junit4]   2> NOTE: reproduce with: ant test  
> -Dtestcase=TestLRUQueryCache -Dtests.method=testLRUConcurrentLoadsOfSameQuery 
> -Dtests.seed=205F9EFCF29BA4D6 -Dtests.slow=true -Dtests.badapples=true 
> -Dtests.locale=so-ET -Dtests.timezone=Europe/Ljubljana -Dtests.asserts=true 
> -Dtests.file.encoding=UTF-8
> 02:11:11[junit4] ERROR   0.02s J3 | 
> TestLRUQueryCache.testLRUConcurrentLoadsOfSameQuery <<<
> 02:11:11[junit4]> Throwable #1: java.lang.RuntimeException: 
> MockDirectoryWrapper: cannot close: there are still 1 open files: {_0.cfs=1}
> 02:11:11[junit4]> at 
> __randomizedtesting.SeedInfo.seed([205F9EFCF29BA4D6:5E7DB1C91CF54294]:0)
> 02:11:11[junit4]> at 
> org.apache.lucene.store.MockDirectoryWrapper.close(MockDirectoryWrapper.java:807)
> 02:11:11[junit4]> at 
> org.apache.lucene.search.TestLRUQueryCache.testLRUConcurrentLoadsOfSameQuery(TestLRUQueryCache.java:465)
> 02:11:11[junit4]> at 
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 02:11:11[junit4]> at 
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> 02:11:11[junit4]> at 
> java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 02:11:11[junit4]> at 
> java.base/java.lang.reflect.Method.invoke(Method.java:566)
> 02:11:11[junit4]> at 
> java.base/java.lang.Thread.run(Thread.java:834)
> 02:11:11[junit4]> Caused by: java.lang.RuntimeException: unclosed 
> IndexInput: _0.cfs
> 02:11:11[junit4]> at 
> org.apache.lucene.store.MockDirectoryWrapper.addFileHandle(MockDirectoryWrapper.java:725)
> 02:11:11[junit4]> at 
> org.apache.lucene.store.MockDirectoryWrapper.openInput(MockDirectoryWrapper.java:768)
> 02:11:11[junit4]> at 
> org.apache.lucene.codecs.lucene50.Lucene50CompoundReader.(Lucene50CompoundReader.java:79)
> 02:11:11[junit4]> at 
> org.apache.lucene.codecs.lucene50.Lucene50CompoundFormat.getCompoundReader(Lucene50CompoundFormat.java:70)
> 02:11:11[junit4]> at 
> org.apache.lucene.index.SegmentCoreReaders.(SegmentCoreReaders.java:101)
> 02:11:11[junit4]> at 
> org.apache.lucene.index.SegmentReader.(SegmentReader.java:84)
> 02:11:11[junit4]> at 
> org.apache.lucene.index.ReadersAndUpdates.getReader(ReadersAndUpdates.java:177)
> 02:11:11[junit4]> at 
> org.apache.lucene.index.ReadersAndUpdates.getReadOnlyClone(ReadersAndUpdates.java:219)
> 02:11:11[junit4]> at 
> org.apache.lucene.index.StandardDirectoryReader.open(StandardDirectoryReader.java:109)
> 02:11:11[junit4]> at 
> org.apache.lucene.index.IndexWriter.getReader(IndexWriter.java:526)
> 02:11:11[junit4]> at 
> org.apache.lucene.index.RandomIndexWriter.getReader(RandomIndexWriter.java:442)
> 02:11:11[junit4]> at 
> org.apache.lucene.index.RandomIndexWriter.getReader(RandomIndexWriter.java:376)
> 02:11:11[junit4]> at 
> org.apache.lucene.search.TestLRUQueryCache.testLRUConcurrentLoadsOfSameQuery(TestLRUQueryCache.java:418)
> 02:11:11[junit4]> ... 35 more
> 02:11:11[junit4]   2> NOTE: leaving temporary files on disk at: 
> /var/lib/jenkins/workspace/apache+lucene-solr+master/lucene/build/core/test/J3/temp/lucene.search.TestLRUQueryCache_205F9EFCF29BA4D6-001
> 02:11:11[junit4]   2> Nov 

[jira] [Commented] (LUCENE-9070) TestLRUCache failures

2019-11-28 Thread Adrien Grand (Jira)


[ 
https://issues.apache.org/jira/browse/LUCENE-9070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16984413#comment-16984413
 ] 

Adrien Grand commented on LUCENE-9070:
--

Another one https://builds.apache.org/job/Lucene-Solr-NightlyTests-master/2031/

> TestLRUCache failures
> -
>
> Key: LUCENE-9070
> URL: https://issues.apache.org/jira/browse/LUCENE-9070
> Project: Lucene - Core
>  Issue Type: Bug
>Reporter: Adrien Grand
>Priority: Major
>
> {noformat}
> 02:11:11[junit4] Suite: org.apache.lucene.search.TestLRUQueryCache
> 02:11:11[junit4] IGNOR/A 0.00s J3 | 
> TestLRUQueryCache.testRamBytesUsedAgreesWithRamUsageTester
> 02:11:11[junit4]> Assumption #1: LUCENE-7595: RamUsageTester does not 
> work exact in Java 9 (estimations for maps and lists)
> 02:11:11[junit4] IGNOR/A 0.00s J3 | 
> TestLRUQueryCache.testRamBytesUsedConstantEntryOverhead
> 02:11:11[junit4]> Assumption #1: LUCENE-7595: RamUsageTester does not 
> work exact in Java 9 (estimations for maps and lists)
> 02:11:11[junit4] IGNOR/A 0.00s J3 | 
> TestLRUQueryCache.testDetectMutatedQueries
> 02:11:11[junit4]> Assumption #1: LUCENE-7604: For some unknown reason 
> the non-constant BadQuery#hashCode() does not trigger 
> ConcurrentModificationException on Java 9 b150
> 02:11:11[junit4]   2> NOTE: reproduce with: ant test  
> -Dtestcase=TestLRUQueryCache -Dtests.method=testLRUConcurrentLoadsOfSameQuery 
> -Dtests.seed=205F9EFCF29BA4D6 -Dtests.slow=true -Dtests.badapples=true 
> -Dtests.locale=so-ET -Dtests.timezone=Europe/Ljubljana -Dtests.asserts=true 
> -Dtests.file.encoding=UTF-8
> 02:11:11[junit4] ERROR   0.02s J3 | 
> TestLRUQueryCache.testLRUConcurrentLoadsOfSameQuery <<<
> 02:11:11[junit4]> Throwable #1: java.lang.RuntimeException: 
> MockDirectoryWrapper: cannot close: there are still 1 open files: {_0.cfs=1}
> 02:11:11[junit4]> at 
> __randomizedtesting.SeedInfo.seed([205F9EFCF29BA4D6:5E7DB1C91CF54294]:0)
> 02:11:11[junit4]> at 
> org.apache.lucene.store.MockDirectoryWrapper.close(MockDirectoryWrapper.java:807)
> 02:11:11[junit4]> at 
> org.apache.lucene.search.TestLRUQueryCache.testLRUConcurrentLoadsOfSameQuery(TestLRUQueryCache.java:465)
> 02:11:11[junit4]> at 
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 02:11:11[junit4]> at 
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> 02:11:11[junit4]> at 
> java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 02:11:11[junit4]> at 
> java.base/java.lang.reflect.Method.invoke(Method.java:566)
> 02:11:11[junit4]> at 
> java.base/java.lang.Thread.run(Thread.java:834)
> 02:11:11[junit4]> Caused by: java.lang.RuntimeException: unclosed 
> IndexInput: _0.cfs
> 02:11:11[junit4]> at 
> org.apache.lucene.store.MockDirectoryWrapper.addFileHandle(MockDirectoryWrapper.java:725)
> 02:11:11[junit4]> at 
> org.apache.lucene.store.MockDirectoryWrapper.openInput(MockDirectoryWrapper.java:768)
> 02:11:11[junit4]> at 
> org.apache.lucene.codecs.lucene50.Lucene50CompoundReader.(Lucene50CompoundReader.java:79)
> 02:11:11[junit4]> at 
> org.apache.lucene.codecs.lucene50.Lucene50CompoundFormat.getCompoundReader(Lucene50CompoundFormat.java:70)
> 02:11:11[junit4]> at 
> org.apache.lucene.index.SegmentCoreReaders.(SegmentCoreReaders.java:101)
> 02:11:11[junit4]> at 
> org.apache.lucene.index.SegmentReader.(SegmentReader.java:84)
> 02:11:11[junit4]> at 
> org.apache.lucene.index.ReadersAndUpdates.getReader(ReadersAndUpdates.java:177)
> 02:11:11[junit4]> at 
> org.apache.lucene.index.ReadersAndUpdates.getReadOnlyClone(ReadersAndUpdates.java:219)
> 02:11:11[junit4]> at 
> org.apache.lucene.index.StandardDirectoryReader.open(StandardDirectoryReader.java:109)
> 02:11:11[junit4]> at 
> org.apache.lucene.index.IndexWriter.getReader(IndexWriter.java:526)
> 02:11:11[junit4]> at 
> org.apache.lucene.index.RandomIndexWriter.getReader(RandomIndexWriter.java:442)
> 02:11:11[junit4]> at 
> org.apache.lucene.index.RandomIndexWriter.getReader(RandomIndexWriter.java:376)
> 02:11:11[junit4]> at 
> org.apache.lucene.search.TestLRUQueryCache.testLRUConcurrentLoadsOfSameQuery(TestLRUQueryCache.java:418)
> 02:11:11[junit4]> ... 35 more
> 02:11:11[junit4]   2> NOTE: leaving temporary files on disk at: 
> /var/lib/jenkins/workspace/apache+lucene-solr+master/lucene/build/core/test/J3/temp/lucene.search.TestLRUQueryCache_205F9EFCF29BA4D6-001
> 02:11:11[junit4]   2> Nov 27, 2019 12:10:48 AM 
> 

[jira] [Commented] (LUCENE-9070) TestLRUCache failures

2019-11-28 Thread Adrien Grand (Jira)


[ 
https://issues.apache.org/jira/browse/LUCENE-9070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16984251#comment-16984251
 ] 

Adrien Grand commented on LUCENE-9070:
--

[~atri] FYI more LRUQueryCache failures keep coming, see e.g. 
https://builds.apache.org/job/Lucene-Solr-Tests-master/3925/.

> TestLRUCache failures
> -
>
> Key: LUCENE-9070
> URL: https://issues.apache.org/jira/browse/LUCENE-9070
> Project: Lucene - Core
>  Issue Type: Bug
>Reporter: Adrien Grand
>Priority: Major
>
> {noformat}
> 02:11:11[junit4] Suite: org.apache.lucene.search.TestLRUQueryCache
> 02:11:11[junit4] IGNOR/A 0.00s J3 | 
> TestLRUQueryCache.testRamBytesUsedAgreesWithRamUsageTester
> 02:11:11[junit4]> Assumption #1: LUCENE-7595: RamUsageTester does not 
> work exact in Java 9 (estimations for maps and lists)
> 02:11:11[junit4] IGNOR/A 0.00s J3 | 
> TestLRUQueryCache.testRamBytesUsedConstantEntryOverhead
> 02:11:11[junit4]> Assumption #1: LUCENE-7595: RamUsageTester does not 
> work exact in Java 9 (estimations for maps and lists)
> 02:11:11[junit4] IGNOR/A 0.00s J3 | 
> TestLRUQueryCache.testDetectMutatedQueries
> 02:11:11[junit4]> Assumption #1: LUCENE-7604: For some unknown reason 
> the non-constant BadQuery#hashCode() does not trigger 
> ConcurrentModificationException on Java 9 b150
> 02:11:11[junit4]   2> NOTE: reproduce with: ant test  
> -Dtestcase=TestLRUQueryCache -Dtests.method=testLRUConcurrentLoadsOfSameQuery 
> -Dtests.seed=205F9EFCF29BA4D6 -Dtests.slow=true -Dtests.badapples=true 
> -Dtests.locale=so-ET -Dtests.timezone=Europe/Ljubljana -Dtests.asserts=true 
> -Dtests.file.encoding=UTF-8
> 02:11:11[junit4] ERROR   0.02s J3 | 
> TestLRUQueryCache.testLRUConcurrentLoadsOfSameQuery <<<
> 02:11:11[junit4]> Throwable #1: java.lang.RuntimeException: 
> MockDirectoryWrapper: cannot close: there are still 1 open files: {_0.cfs=1}
> 02:11:11[junit4]> at 
> __randomizedtesting.SeedInfo.seed([205F9EFCF29BA4D6:5E7DB1C91CF54294]:0)
> 02:11:11[junit4]> at 
> org.apache.lucene.store.MockDirectoryWrapper.close(MockDirectoryWrapper.java:807)
> 02:11:11[junit4]> at 
> org.apache.lucene.search.TestLRUQueryCache.testLRUConcurrentLoadsOfSameQuery(TestLRUQueryCache.java:465)
> 02:11:11[junit4]> at 
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 02:11:11[junit4]> at 
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> 02:11:11[junit4]> at 
> java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 02:11:11[junit4]> at 
> java.base/java.lang.reflect.Method.invoke(Method.java:566)
> 02:11:11[junit4]> at 
> java.base/java.lang.Thread.run(Thread.java:834)
> 02:11:11[junit4]> Caused by: java.lang.RuntimeException: unclosed 
> IndexInput: _0.cfs
> 02:11:11[junit4]> at 
> org.apache.lucene.store.MockDirectoryWrapper.addFileHandle(MockDirectoryWrapper.java:725)
> 02:11:11[junit4]> at 
> org.apache.lucene.store.MockDirectoryWrapper.openInput(MockDirectoryWrapper.java:768)
> 02:11:11[junit4]> at 
> org.apache.lucene.codecs.lucene50.Lucene50CompoundReader.(Lucene50CompoundReader.java:79)
> 02:11:11[junit4]> at 
> org.apache.lucene.codecs.lucene50.Lucene50CompoundFormat.getCompoundReader(Lucene50CompoundFormat.java:70)
> 02:11:11[junit4]> at 
> org.apache.lucene.index.SegmentCoreReaders.(SegmentCoreReaders.java:101)
> 02:11:11[junit4]> at 
> org.apache.lucene.index.SegmentReader.(SegmentReader.java:84)
> 02:11:11[junit4]> at 
> org.apache.lucene.index.ReadersAndUpdates.getReader(ReadersAndUpdates.java:177)
> 02:11:11[junit4]> at 
> org.apache.lucene.index.ReadersAndUpdates.getReadOnlyClone(ReadersAndUpdates.java:219)
> 02:11:11[junit4]> at 
> org.apache.lucene.index.StandardDirectoryReader.open(StandardDirectoryReader.java:109)
> 02:11:11[junit4]> at 
> org.apache.lucene.index.IndexWriter.getReader(IndexWriter.java:526)
> 02:11:11[junit4]> at 
> org.apache.lucene.index.RandomIndexWriter.getReader(RandomIndexWriter.java:442)
> 02:11:11[junit4]> at 
> org.apache.lucene.index.RandomIndexWriter.getReader(RandomIndexWriter.java:376)
> 02:11:11[junit4]> at 
> org.apache.lucene.search.TestLRUQueryCache.testLRUConcurrentLoadsOfSameQuery(TestLRUQueryCache.java:418)
> 02:11:11[junit4]> ... 35 more
> 02:11:11[junit4]   2> NOTE: leaving temporary files on disk at: 
> /var/lib/jenkins/workspace/apache+lucene-solr+master/lucene/build/core/test/J3/temp/lucene.search.TestLRUQueryCache_205F9EFCF29BA4D6-001
> 02:11:11[junit4]   2> Nov 27, 

[jira] [Commented] (LUCENE-9070) TestLRUCache failures

2019-11-27 Thread Atri Sharma (Jira)


[ 
https://issues.apache.org/jira/browse/LUCENE-9070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16984136#comment-16984136
 ] 

Atri Sharma commented on LUCENE-9070:
-

[~jpountz] Investigated. I could not reproduce the first one and the second one 
was an over zealous assert in the test which was not actually related to the 
test itself (checking if number of segments generated in current random run is 
more than 1). That should not be an assert since it is not a deterministic 
scenario and also does not affect the functionality that the test is checking. 
I pushed a fix to remove the same and beasted the test 20 times with the seed 
that triggered the failure – no run failed

> TestLRUCache failures
> -
>
> Key: LUCENE-9070
> URL: https://issues.apache.org/jira/browse/LUCENE-9070
> Project: Lucene - Core
>  Issue Type: Bug
>Reporter: Adrien Grand
>Priority: Major
>
> {noformat}
> 02:11:11[junit4] Suite: org.apache.lucene.search.TestLRUQueryCache
> 02:11:11[junit4] IGNOR/A 0.00s J3 | 
> TestLRUQueryCache.testRamBytesUsedAgreesWithRamUsageTester
> 02:11:11[junit4]> Assumption #1: LUCENE-7595: RamUsageTester does not 
> work exact in Java 9 (estimations for maps and lists)
> 02:11:11[junit4] IGNOR/A 0.00s J3 | 
> TestLRUQueryCache.testRamBytesUsedConstantEntryOverhead
> 02:11:11[junit4]> Assumption #1: LUCENE-7595: RamUsageTester does not 
> work exact in Java 9 (estimations for maps and lists)
> 02:11:11[junit4] IGNOR/A 0.00s J3 | 
> TestLRUQueryCache.testDetectMutatedQueries
> 02:11:11[junit4]> Assumption #1: LUCENE-7604: For some unknown reason 
> the non-constant BadQuery#hashCode() does not trigger 
> ConcurrentModificationException on Java 9 b150
> 02:11:11[junit4]   2> NOTE: reproduce with: ant test  
> -Dtestcase=TestLRUQueryCache -Dtests.method=testLRUConcurrentLoadsOfSameQuery 
> -Dtests.seed=205F9EFCF29BA4D6 -Dtests.slow=true -Dtests.badapples=true 
> -Dtests.locale=so-ET -Dtests.timezone=Europe/Ljubljana -Dtests.asserts=true 
> -Dtests.file.encoding=UTF-8
> 02:11:11[junit4] ERROR   0.02s J3 | 
> TestLRUQueryCache.testLRUConcurrentLoadsOfSameQuery <<<
> 02:11:11[junit4]> Throwable #1: java.lang.RuntimeException: 
> MockDirectoryWrapper: cannot close: there are still 1 open files: {_0.cfs=1}
> 02:11:11[junit4]> at 
> __randomizedtesting.SeedInfo.seed([205F9EFCF29BA4D6:5E7DB1C91CF54294]:0)
> 02:11:11[junit4]> at 
> org.apache.lucene.store.MockDirectoryWrapper.close(MockDirectoryWrapper.java:807)
> 02:11:11[junit4]> at 
> org.apache.lucene.search.TestLRUQueryCache.testLRUConcurrentLoadsOfSameQuery(TestLRUQueryCache.java:465)
> 02:11:11[junit4]> at 
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 02:11:11[junit4]> at 
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> 02:11:11[junit4]> at 
> java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 02:11:11[junit4]> at 
> java.base/java.lang.reflect.Method.invoke(Method.java:566)
> 02:11:11[junit4]> at 
> java.base/java.lang.Thread.run(Thread.java:834)
> 02:11:11[junit4]> Caused by: java.lang.RuntimeException: unclosed 
> IndexInput: _0.cfs
> 02:11:11[junit4]> at 
> org.apache.lucene.store.MockDirectoryWrapper.addFileHandle(MockDirectoryWrapper.java:725)
> 02:11:11[junit4]> at 
> org.apache.lucene.store.MockDirectoryWrapper.openInput(MockDirectoryWrapper.java:768)
> 02:11:11[junit4]> at 
> org.apache.lucene.codecs.lucene50.Lucene50CompoundReader.(Lucene50CompoundReader.java:79)
> 02:11:11[junit4]> at 
> org.apache.lucene.codecs.lucene50.Lucene50CompoundFormat.getCompoundReader(Lucene50CompoundFormat.java:70)
> 02:11:11[junit4]> at 
> org.apache.lucene.index.SegmentCoreReaders.(SegmentCoreReaders.java:101)
> 02:11:11[junit4]> at 
> org.apache.lucene.index.SegmentReader.(SegmentReader.java:84)
> 02:11:11[junit4]> at 
> org.apache.lucene.index.ReadersAndUpdates.getReader(ReadersAndUpdates.java:177)
> 02:11:11[junit4]> at 
> org.apache.lucene.index.ReadersAndUpdates.getReadOnlyClone(ReadersAndUpdates.java:219)
> 02:11:11[junit4]> at 
> org.apache.lucene.index.StandardDirectoryReader.open(StandardDirectoryReader.java:109)
> 02:11:11[junit4]> at 
> org.apache.lucene.index.IndexWriter.getReader(IndexWriter.java:526)
> 02:11:11[junit4]> at 
> org.apache.lucene.index.RandomIndexWriter.getReader(RandomIndexWriter.java:442)
> 02:11:11[junit4]> at 
> org.apache.lucene.index.RandomIndexWriter.getReader(RandomIndexWriter.java:376)
> 02:11:11[junit4]> at 
> 

[jira] [Commented] (LUCENE-9070) TestLRUCache failures

2019-11-27 Thread Atri Sharma (Jira)


[ 
https://issues.apache.org/jira/browse/LUCENE-9070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16984120#comment-16984120
 ] 

Atri Sharma commented on LUCENE-9070:
-

Looking

> TestLRUCache failures
> -
>
> Key: LUCENE-9070
> URL: https://issues.apache.org/jira/browse/LUCENE-9070
> Project: Lucene - Core
>  Issue Type: Bug
>Reporter: Adrien Grand
>Priority: Major
>
> {noformat}
> 02:11:11[junit4] Suite: org.apache.lucene.search.TestLRUQueryCache
> 02:11:11[junit4] IGNOR/A 0.00s J3 | 
> TestLRUQueryCache.testRamBytesUsedAgreesWithRamUsageTester
> 02:11:11[junit4]> Assumption #1: LUCENE-7595: RamUsageTester does not 
> work exact in Java 9 (estimations for maps and lists)
> 02:11:11[junit4] IGNOR/A 0.00s J3 | 
> TestLRUQueryCache.testRamBytesUsedConstantEntryOverhead
> 02:11:11[junit4]> Assumption #1: LUCENE-7595: RamUsageTester does not 
> work exact in Java 9 (estimations for maps and lists)
> 02:11:11[junit4] IGNOR/A 0.00s J3 | 
> TestLRUQueryCache.testDetectMutatedQueries
> 02:11:11[junit4]> Assumption #1: LUCENE-7604: For some unknown reason 
> the non-constant BadQuery#hashCode() does not trigger 
> ConcurrentModificationException on Java 9 b150
> 02:11:11[junit4]   2> NOTE: reproduce with: ant test  
> -Dtestcase=TestLRUQueryCache -Dtests.method=testLRUConcurrentLoadsOfSameQuery 
> -Dtests.seed=205F9EFCF29BA4D6 -Dtests.slow=true -Dtests.badapples=true 
> -Dtests.locale=so-ET -Dtests.timezone=Europe/Ljubljana -Dtests.asserts=true 
> -Dtests.file.encoding=UTF-8
> 02:11:11[junit4] ERROR   0.02s J3 | 
> TestLRUQueryCache.testLRUConcurrentLoadsOfSameQuery <<<
> 02:11:11[junit4]> Throwable #1: java.lang.RuntimeException: 
> MockDirectoryWrapper: cannot close: there are still 1 open files: {_0.cfs=1}
> 02:11:11[junit4]> at 
> __randomizedtesting.SeedInfo.seed([205F9EFCF29BA4D6:5E7DB1C91CF54294]:0)
> 02:11:11[junit4]> at 
> org.apache.lucene.store.MockDirectoryWrapper.close(MockDirectoryWrapper.java:807)
> 02:11:11[junit4]> at 
> org.apache.lucene.search.TestLRUQueryCache.testLRUConcurrentLoadsOfSameQuery(TestLRUQueryCache.java:465)
> 02:11:11[junit4]> at 
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 02:11:11[junit4]> at 
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> 02:11:11[junit4]> at 
> java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 02:11:11[junit4]> at 
> java.base/java.lang.reflect.Method.invoke(Method.java:566)
> 02:11:11[junit4]> at 
> java.base/java.lang.Thread.run(Thread.java:834)
> 02:11:11[junit4]> Caused by: java.lang.RuntimeException: unclosed 
> IndexInput: _0.cfs
> 02:11:11[junit4]> at 
> org.apache.lucene.store.MockDirectoryWrapper.addFileHandle(MockDirectoryWrapper.java:725)
> 02:11:11[junit4]> at 
> org.apache.lucene.store.MockDirectoryWrapper.openInput(MockDirectoryWrapper.java:768)
> 02:11:11[junit4]> at 
> org.apache.lucene.codecs.lucene50.Lucene50CompoundReader.(Lucene50CompoundReader.java:79)
> 02:11:11[junit4]> at 
> org.apache.lucene.codecs.lucene50.Lucene50CompoundFormat.getCompoundReader(Lucene50CompoundFormat.java:70)
> 02:11:11[junit4]> at 
> org.apache.lucene.index.SegmentCoreReaders.(SegmentCoreReaders.java:101)
> 02:11:11[junit4]> at 
> org.apache.lucene.index.SegmentReader.(SegmentReader.java:84)
> 02:11:11[junit4]> at 
> org.apache.lucene.index.ReadersAndUpdates.getReader(ReadersAndUpdates.java:177)
> 02:11:11[junit4]> at 
> org.apache.lucene.index.ReadersAndUpdates.getReadOnlyClone(ReadersAndUpdates.java:219)
> 02:11:11[junit4]> at 
> org.apache.lucene.index.StandardDirectoryReader.open(StandardDirectoryReader.java:109)
> 02:11:11[junit4]> at 
> org.apache.lucene.index.IndexWriter.getReader(IndexWriter.java:526)
> 02:11:11[junit4]> at 
> org.apache.lucene.index.RandomIndexWriter.getReader(RandomIndexWriter.java:442)
> 02:11:11[junit4]> at 
> org.apache.lucene.index.RandomIndexWriter.getReader(RandomIndexWriter.java:376)
> 02:11:11[junit4]> at 
> org.apache.lucene.search.TestLRUQueryCache.testLRUConcurrentLoadsOfSameQuery(TestLRUQueryCache.java:418)
> 02:11:11[junit4]> ... 35 more
> 02:11:11[junit4]   2> NOTE: leaving temporary files on disk at: 
> /var/lib/jenkins/workspace/apache+lucene-solr+master/lucene/build/core/test/J3/temp/lucene.search.TestLRUQueryCache_205F9EFCF29BA4D6-001
> 02:11:11[junit4]   2> Nov 27, 2019 12:10:48 AM 
> com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
> 02:11:11[junit4]   2>