Is segments.gen good enough or should we look into atomic rename?

On Thu, Sep 4, 2014 at 5:16 AM, Michael McCandless
<[email protected]> wrote:
> I committed a fix ... the replicator first replicates main index
> files, then replicates taxo index files, then copies & fsyncs taxo
> index segments_N, then copies & fsyncs main index segments_M.
>
> But if an exc happens on 4th step, it goes and tries to remove all
> files it had copied.
>
> Then, virus checker can refuse to remove the taxo index segments_N,
> yet succeed in removing other files referenced by segments_N, leaving
> a broken latest commit.
>
> It looks like corruption if you run CheckIndex, but not if you open a
> reader (the SIS retry logic will succeed in falling back to the last
> commit), so it's really a "false" corruption, and I fixed the test to
> detect when this false corruption strikes, forcefully remove the
> latest segments_N, and then confirm the index is not corrupt.
>
> The same thing can also happen to a plain Lucene index...
>
> Mike McCandless
>
> http://blog.mikemccandless.com
>
>
> On Wed, Sep 3, 2014 at 4:47 PM, Dawid Weiss
> <[email protected]> wrote:
>> I know what this (false report of exceeded output) is. I filed
>> https://issues.apache.org/jira/browse/LUCENE-5921, but it's not really
>> a "bug"; it's a side effect of how test rules and thread exception
>> tracking is ordered.
>>
>> Dawid
>>
>> On Wed, Sep 3, 2014 at 4:55 PM, Robert Muir <[email protected]> wrote:
>>> Thank you Dawid.
>>>
>>>
>>> On Wed, Sep 3, 2014 at 7:58 AM, Dawid Weiss
>>> <[email protected]> wrote:
>>>> I'll take a look at why this is printed:
>>>>
>>>>    [junit4] ERROR   0.00s J1 | IndexAndTaxonomyReplicationClientTest 
>>>> (suite) <<<
>>>>    [junit4]    > Throwable #1: java.lang.AssertionError: The test or
>>>> suite printed 20384 bytes to stdout and stderr, even though the limit
>>>> was set to 8192 bytes. Increase the limit with @Limit, ignore it
>>>> completely with @SuppressSysoutChecks or run with -Dtests.verbose=true
>>>>    [junit4]    > at __randomizedtesting.SeedInfo.seed([F78E514819F85101]:0)
>>>>    [junit4]    > at java.lang.Thread.run(Thread.java:745)
>>>>    [junit4] Completed on J1 in 4.87s, 5 tests, 1 failure, 1 error <<< 
>>>> FAILURES!
>>>>
>>>> It shouldn't be (in case of failures/ previous exceptions).
>>>>
>>>> Dawid
>>>>
>>>> On Wed, Sep 3, 2014 at 1:34 PM, Robert Muir <[email protected]> wrote:
>>>>> It reproduces easily. I will investigate after I review Mike's fix on
>>>>> LUCENE-5919
>>>>>
>>>>> On Tue, Sep 2, 2014 at 7:53 PM, Policeman Jenkins Server
>>>>> <[email protected]> wrote:
>>>>>> Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-Linux/11032/
>>>>>> Java: 32bit/jdk1.7.0_67 -server -XX:+UseParallelGC
>>>>>>
>>>>>> 2 tests failed.
>>>>>> FAILED:  
>>>>>> junit.framework.TestSuite.org.apache.lucene.replicator.IndexAndTaxonomyReplicationClientTest
>>>>>>
>>>>>> Error Message:
>>>>>> The test or suite printed 20384 bytes to stdout and stderr, even though 
>>>>>> the limit was set to 8192 bytes. Increase the limit with @Limit, ignore 
>>>>>> it completely with @SuppressSysoutChecks or run with -Dtests.verbose=true
>>>>>>
>>>>>> Stack Trace:
>>>>>> java.lang.AssertionError: The test or suite printed 20384 bytes to 
>>>>>> stdout and stderr, even though the limit was set to 8192 bytes. Increase 
>>>>>> the limit with @Limit, ignore it completely with @SuppressSysoutChecks 
>>>>>> or run with -Dtests.verbose=true
>>>>>>         at __randomizedtesting.SeedInfo.seed([F78E514819F85101]:0)
>>>>>>         at 
>>>>>> org.apache.lucene.util.TestRuleLimitSysouts.afterIfSuccessful(TestRuleLimitSysouts.java:210)
>>>>>>         at 
>>>>>> com.carrotsearch.randomizedtesting.rules.TestRuleAdapter$1.afterIfSuccessful(TestRuleAdapter.java:36)
>>>>>>         at 
>>>>>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:37)
>>>>>>         at 
>>>>>> org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
>>>>>>         at 
>>>>>> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
>>>>>>         at 
>>>>>> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
>>>>>>         at 
>>>>>> org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
>>>>>>         at 
>>>>>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>>>>>>         at 
>>>>>> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
>>>>>>         at java.lang.Thread.run(Thread.java:745)
>>>>>>
>>>>>>
>>>>>> REGRESSION:  
>>>>>> org.apache.lucene.replicator.IndexAndTaxonomyReplicationClientTest.testConsistencyOnExceptions
>>>>>>
>>>>>> Error Message:
>>>>>> Captured an uncaught exception in thread: Thread[id=20, 
>>>>>> name=ReplicationThread-indexAndTaxo, state=RUNNABLE, 
>>>>>> group=TGRP-IndexAndTaxonomyReplicationClientTest]
>>>>>>
>>>>>> Stack Trace:
>>>>>> com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an 
>>>>>> uncaught exception in thread: Thread[id=20, 
>>>>>> name=ReplicationThread-indexAndTaxo, state=RUNNABLE, 
>>>>>> group=TGRP-IndexAndTaxonomyReplicationClientTest]
>>>>>>         at 
>>>>>> __randomizedtesting.SeedInfo.seed([F78E514819F85101:7800B6E80B94A2FE]:0)
>>>>>> Caused by: java.lang.RuntimeException: CheckIndex failed
>>>>>>         at __randomizedtesting.SeedInfo.seed([F78E514819F85101]:0)
>>>>>>         at org.apache.lucene.util.TestUtil.checkIndex(TestUtil.java:211)
>>>>>>         at org.apache.lucene.util.TestUtil.checkIndex(TestUtil.java:196)
>>>>>>         at org.apache.lucene.util.TestUtil.checkIndex(TestUtil.java:192)
>>>>>>         at 
>>>>>> org.apache.lucene.replicator.IndexAndTaxonomyReplicationClientTest$4.handleUpdateException(IndexAndTaxonomyReplicationClientTest.java:407)
>>>>>>         at 
>>>>>> org.apache.lucene.replicator.ReplicationClient$ReplicationThread.run(ReplicationClient.java:78)
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> Build Log:
>>>>>> [...truncated 9501 lines...]
>>>>>>    [junit4] Suite: 
>>>>>> org.apache.lucene.replicator.IndexAndTaxonomyReplicationClientTest
>>>>>>    [junit4]   1> CheckIndex failed
>>>>>>    [junit4]   1> Segments file=segments_7 numSegments=8 version=4.11.0 
>>>>>> id=00000000000000009a0248c614355555 format= userData={index.epoch=1}
>>>>>>    [junit4]   1>   1 of 8: name=_0 docCount=1
>>>>>>    [junit4]   1>     version=4.11.0
>>>>>>    [junit4]   1>     id=00000000000000009a0248c614355539
>>>>>>    [junit4]   1>     
>>>>>> codec=FastCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=FAST,
>>>>>>  chunkSize=16384), 
>>>>>> termVectorsFormat=CompressingTermVectorsFormat(compressionMode=FAST, 
>>>>>> chunkSize=16384))
>>>>>>    [junit4]   1>     compound=true
>>>>>>    [junit4]   1>     numFiles=3
>>>>>>    [junit4]   1>     size (MB)=0.001
>>>>>>    [junit4]   1>     diagnostics = {os.arch=i386, 
>>>>>> timestamp=1409702008306, java.version=1.7.0_67, lucene.version=4.11.0, 
>>>>>> source=flush, os.version=3.13.0-35-generic, java.vendor=Oracle 
>>>>>> Corporation, os=Linux}
>>>>>>    [junit4]   1>     no deletions
>>>>>>    [junit4]   1>     test: open reader.........OK
>>>>>>    [junit4]   1>     test: check integrity.....OK
>>>>>>    [junit4]   1>     test: check live docs.....OK
>>>>>>    [junit4]   1>     test: fields..............OK [2 fields]
>>>>>>    [junit4]   1>     test: field norms.........OK [0 fields]
>>>>>>    [junit4]   1>     test: terms, freq, prox...OK [2 terms; 2 terms/docs 
>>>>>> pairs; 1 tokens]
>>>>>>    [junit4]   1>     test: stored fields.......OK [1 total field count; 
>>>>>> avg 1 fields per doc]
>>>>>>    [junit4]   1>     test: term vectors........OK [0 total vector count; 
>>>>>> avg 0 term/freq vector fields per doc]
>>>>>>    [junit4]   1>     test: docvalues...........OK [0 docvalues fields; 0 
>>>>>> BINARY; 0 NUMERIC; 0 SORTED; 0 SORTED_NUMERIC; 0 SORTED_SET]
>>>>>>    [junit4]   1>
>>>>>>    [junit4]   1>   2 of 8: name=_1 docCount=2
>>>>>>    [junit4]   1>     version=4.11.0
>>>>>>    [junit4]   1>     id=00000000000000009a0248c61435553a
>>>>>>    [junit4]   1>     
>>>>>> codec=FastCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=FAST,
>>>>>>  chunkSize=16384), 
>>>>>> termVectorsFormat=CompressingTermVectorsFormat(compressionMode=FAST, 
>>>>>> chunkSize=16384))
>>>>>>    [junit4]   1>     compound=true
>>>>>>    [junit4]   1>     numFiles=3
>>>>>>    [junit4]   1>     size (MB)=0.001
>>>>>>    [junit4]   1>     diagnostics = {os.arch=i386, 
>>>>>> timestamp=1409702008311, java.version=1.7.0_67, lucene.version=4.11.0, 
>>>>>> source=flush, os.version=3.13.0-35-generic, java.vendor=Oracle 
>>>>>> Corporation, os=Linux}
>>>>>>    [junit4]   1>     no deletions
>>>>>>    [junit4]   1>     test: open reader.........OK
>>>>>>    [junit4]   1>     test: check integrity.....OK
>>>>>>    [junit4]   1>     test: check live docs.....OK
>>>>>>    [junit4]   1>     test: fields..............OK [2 fields]
>>>>>>    [junit4]   1>     test: field norms.........OK [0 fields]
>>>>>>    [junit4]   1>     test: terms, freq, prox...OK [3 terms; 4 terms/docs 
>>>>>> pairs; 2 tokens]
>>>>>>    [junit4]   1>     test: stored fields.......OK [2 total field count; 
>>>>>> avg 1 fields per doc]
>>>>>>    [junit4]   1>     test: term vectors........OK [0 total vector count; 
>>>>>> avg 0 term/freq vector fields per doc]
>>>>>>    [junit4]   1>     test: docvalues...........OK [0 docvalues fields; 0 
>>>>>> BINARY; 0 NUMERIC; 0 SORTED; 0 SORTED_NUMERIC; 0 SORTED_SET]
>>>>>>    [junit4]   1>
>>>>>>    [junit4]   1>   3 of 8: name=_2 docCount=1
>>>>>>    [junit4]   1>     version=4.11.0
>>>>>>    [junit4]   1>     id=00000000000000009a0248c61435553e
>>>>>>    [junit4]   1>     
>>>>>> codec=FastCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=FAST,
>>>>>>  chunkSize=16384), 
>>>>>> termVectorsFormat=CompressingTermVectorsFormat(compressionMode=FAST, 
>>>>>> chunkSize=16384))
>>>>>>    [junit4]   1>     compound=true
>>>>>>    [junit4]   1>     numFiles=3
>>>>>>    [junit4]   1>     size (MB)=0.001
>>>>>>    [junit4]   1>     diagnostics = {os.arch=i386, 
>>>>>> timestamp=1409702008326, java.version=1.7.0_67, lucene.version=4.11.0, 
>>>>>> source=flush, os.version=3.13.0-35-generic, java.vendor=Oracle 
>>>>>> Corporation, os=Linux}
>>>>>>    [junit4]   1>     no deletions
>>>>>>    [junit4]   1>     test: open reader.........OK
>>>>>>    [junit4]   1>     test: check integrity.....OK
>>>>>>    [junit4]   1>     test: check live docs.....OK
>>>>>>    [junit4]   1>     test: fields..............OK [2 fields]
>>>>>>    [junit4]   1>     test: field norms.........OK [0 fields]
>>>>>>    [junit4]   1>     test: terms, freq, prox...OK [2 terms; 2 terms/docs 
>>>>>> pairs; 1 tokens]
>>>>>>    [junit4]   1>     test: stored fields.......OK [1 total field count; 
>>>>>> avg 1 fields per doc]
>>>>>>    [junit4]   1>     test: term vectors........OK [0 total vector count; 
>>>>>> avg 0 term/freq vector fields per doc]
>>>>>>    [junit4]   1>     test: docvalues...........OK [0 docvalues fields; 0 
>>>>>> BINARY; 0 NUMERIC; 0 SORTED; 0 SORTED_NUMERIC; 0 SORTED_SET]
>>>>>>    [junit4]   1>
>>>>>>    [junit4]   1>   4 of 8: name=_3 docCount=1
>>>>>>    [junit4]   1>     version=4.11.0
>>>>>>    [junit4]   1>     id=00000000000000009a0248c614355542
>>>>>>    [junit4]   1>     
>>>>>> codec=FastCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=FAST,
>>>>>>  chunkSize=16384), 
>>>>>> termVectorsFormat=CompressingTermVectorsFormat(compressionMode=FAST, 
>>>>>> chunkSize=16384))
>>>>>>    [junit4]   1>     compound=true
>>>>>>    [junit4]   1>     numFiles=3
>>>>>>    [junit4]   1>     size (MB)=0.001
>>>>>>    [junit4]   1>     diagnostics = {os.arch=i386, 
>>>>>> timestamp=1409702008434, java.version=1.7.0_67, lucene.version=4.11.0, 
>>>>>> source=flush, os.version=3.13.0-35-generic, java.vendor=Oracle 
>>>>>> Corporation, os=Linux}
>>>>>>    [junit4]   1>     no deletions
>>>>>>    [junit4]   1>     test: open reader.........OK
>>>>>>    [junit4]   1>     test: check integrity.....OK
>>>>>>    [junit4]   1>     test: check live docs.....OK
>>>>>>    [junit4]   1>     test: fields..............OK [2 fields]
>>>>>>    [junit4]   1>     test: field norms.........OK [0 fields]
>>>>>>    [junit4]   1>     test: terms, freq, prox...OK [2 terms; 2 terms/docs 
>>>>>> pairs; 1 tokens]
>>>>>>    [junit4]   1>     test: stored fields.......OK [1 total field count; 
>>>>>> avg 1 fields per doc]
>>>>>>    [junit4]   1>     test: term vectors........OK [0 total vector count; 
>>>>>> avg 0 term/freq vector fields per doc]
>>>>>>    [junit4]   1>     test: docvalues...........OK [0 docvalues fields; 0 
>>>>>> BINARY; 0 NUMERIC; 0 SORTED; 0 SORTED_NUMERIC; 0 SORTED_SET]
>>>>>>    [junit4]   1>
>>>>>>    [junit4]   1>   5 of 8: name=_4 docCount=1
>>>>>>    [junit4]   1>     version=4.11.0
>>>>>>    [junit4]   1>     id=00000000000000009a0248c614355546
>>>>>>    [junit4]   1>     
>>>>>> codec=FastCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=FAST,
>>>>>>  chunkSize=16384), 
>>>>>> termVectorsFormat=CompressingTermVectorsFormat(compressionMode=FAST, 
>>>>>> chunkSize=16384))
>>>>>>    [junit4]   1>     compound=true
>>>>>>    [junit4]   1>     numFiles=3
>>>>>>    [junit4]   1>     size (MB)=0.001
>>>>>>    [junit4]   1>     diagnostics = {os.arch=i386, 
>>>>>> timestamp=1409702008600, java.version=1.7.0_67, lucene.version=4.11.0, 
>>>>>> source=flush, os.version=3.13.0-35-generic, java.vendor=Oracle 
>>>>>> Corporation, os=Linux}
>>>>>>    [junit4]   1>     no deletions
>>>>>>    [junit4]   1>     test: open reader.........OK
>>>>>>    [junit4]   1>     test: check integrity.....OK
>>>>>>    [junit4]   1>     test: check live docs.....OK
>>>>>>    [junit4]   1>     test: fields..............OK [2 fields]
>>>>>>    [junit4]   1>     test: field norms.........OK [0 fields]
>>>>>>    [junit4]   1>     test: terms, freq, prox...OK [2 terms; 2 terms/docs 
>>>>>> pairs; 1 tokens]
>>>>>>    [junit4]   1>     test: stored fields.......OK [1 total field count; 
>>>>>> avg 1 fields per doc]
>>>>>>    [junit4]   1>     test: term vectors........OK [0 total vector count; 
>>>>>> avg 0 term/freq vector fields per doc]
>>>>>>    [junit4]   1>     test: docvalues...........OK [0 docvalues fields; 0 
>>>>>> BINARY; 0 NUMERIC; 0 SORTED; 0 SORTED_NUMERIC; 0 SORTED_SET]
>>>>>>    [junit4]   1>
>>>>>>    [junit4]   1>   6 of 8: name=_5 docCount=1
>>>>>>    [junit4]   1>     version=4.11.0
>>>>>>    [junit4]   1>     id=00000000000000009a0248c61435554a
>>>>>>    [junit4]   1>     
>>>>>> codec=FastCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=FAST,
>>>>>>  chunkSize=16384), 
>>>>>> termVectorsFormat=CompressingTermVectorsFormat(compressionMode=FAST, 
>>>>>> chunkSize=16384))
>>>>>>    [junit4]   1>     compound=true
>>>>>>    [junit4]   1>     numFiles=3
>>>>>>    [junit4]   1>     size (MB)=0.001
>>>>>>    [junit4]   1>     diagnostics = {os.arch=i386, 
>>>>>> timestamp=1409702008713, java.version=1.7.0_67, lucene.version=4.11.0, 
>>>>>> source=flush, os.version=3.13.0-35-generic, java.vendor=Oracle 
>>>>>> Corporation, os=Linux}
>>>>>>    [junit4]   1>     no deletions
>>>>>>    [junit4]   1>     test: open reader.........OK
>>>>>>    [junit4]   1>     test: check integrity.....OK
>>>>>>    [junit4]   1>     test: check live docs.....OK
>>>>>>    [junit4]   1>     test: fields..............OK [2 fields]
>>>>>>    [junit4]   1>     test: field norms.........OK [0 fields]
>>>>>>    [junit4]   1>     test: terms, freq, prox...OK [2 terms; 2 terms/docs 
>>>>>> pairs; 1 tokens]
>>>>>>    [junit4]   1>     test: stored fields.......OK [1 total field count; 
>>>>>> avg 1 fields per doc]
>>>>>>    [junit4]   1>     test: term vectors........OK [0 total vector count; 
>>>>>> avg 0 term/freq vector fields per doc]
>>>>>>    [junit4]   1>     test: docvalues...........OK [0 docvalues fields; 0 
>>>>>> BINARY; 0 NUMERIC; 0 SORTED; 0 SORTED_NUMERIC; 0 SORTED_SET]
>>>>>>    [junit4]   1>
>>>>>>    [junit4]   1>   7 of 8: name=_6 docCount=1
>>>>>>    [junit4]   1>     version=4.11.0
>>>>>>    [junit4]   1>     id=00000000000000009a0248c61435554e
>>>>>>    [junit4]   1>     
>>>>>> codec=FastCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=FAST,
>>>>>>  chunkSize=16384), 
>>>>>> termVectorsFormat=CompressingTermVectorsFormat(compressionMode=FAST, 
>>>>>> chunkSize=16384))
>>>>>>    [junit4]   1>     compound=true
>>>>>>    [junit4]   1>     numFiles=3
>>>>>>    [junit4]   1>     size (MB)=0.001
>>>>>>    [junit4]   1>     diagnostics = {os.arch=i386, 
>>>>>> timestamp=1409702008824, java.version=1.7.0_67, lucene.version=4.11.0, 
>>>>>> source=flush, os.version=3.13.0-35-generic, java.vendor=Oracle 
>>>>>> Corporation, os=Linux}
>>>>>>    [junit4]   1>     no deletions
>>>>>>    [junit4]   1>     test: open reader.........OK
>>>>>>    [junit4]   1>     test: check integrity.....OK
>>>>>>    [junit4]   1>     test: check live docs.....OK
>>>>>>    [junit4]   1>     test: fields..............OK [2 fields]
>>>>>>    [junit4]   1>     test: field norms.........OK [0 fields]
>>>>>>    [junit4]   1>     test: terms, freq, prox...OK [2 terms; 2 terms/docs 
>>>>>> pairs; 1 tokens]
>>>>>>    [junit4]   1>     test: stored fields.......OK [1 total field count; 
>>>>>> avg 1 fields per doc]
>>>>>>    [junit4]   1>     test: term vectors........OK [0 total vector count; 
>>>>>> avg 0 term/freq vector fields per doc]
>>>>>>    [junit4]   1>     test: docvalues...........OK [0 docvalues fields; 0 
>>>>>> BINARY; 0 NUMERIC; 0 SORTED; 0 SORTED_NUMERIC; 0 SORTED_SET]
>>>>>>    [junit4]   1>
>>>>>>    [junit4]   1>   8 of 8: name=_7 docCount=1
>>>>>>    [junit4]   1>     version=4.11.0
>>>>>>    [junit4]   1>     id=00000000000000009a0248c614355552
>>>>>>    [junit4]   1>     
>>>>>> codec=FastCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=FAST,
>>>>>>  chunkSize=16384), 
>>>>>> termVectorsFormat=CompressingTermVectorsFormat(compressionMode=FAST, 
>>>>>> chunkSize=16384))
>>>>>>    [junit4]   1>     compound=true
>>>>>>    [junit4]   1>     numFiles=3
>>>>>>    [junit4]   1> FAILED
>>>>>>    [junit4]   1>     WARNING: fixIndex() would remove reference to this 
>>>>>> segment; full exception:
>>>>>>    [junit4]   1> java.io.FileNotFoundException: _7.cfe
>>>>>>    [junit4]   1>        at 
>>>>>> org.apache.lucene.store.RAMDirectory.fileLength(RAMDirectory.java:138)
>>>>>>    [junit4]   1>        at 
>>>>>> org.apache.lucene.index.SegmentCommitInfo.sizeInBytes(SegmentCommitInfo.java:219)
>>>>>>    [junit4]   1>        at 
>>>>>> org.apache.lucene.index.CheckIndex.checkIndex(CheckIndex.java:562)
>>>>>>    [junit4]   1>        at 
>>>>>> org.apache.lucene.util.TestUtil.checkIndex(TestUtil.java:207)
>>>>>>    [junit4]   1>        at 
>>>>>> org.apache.lucene.util.TestUtil.checkIndex(TestUtil.java:196)
>>>>>>    [junit4]   1>        at 
>>>>>> org.apache.lucene.util.TestUtil.checkIndex(TestUtil.java:192)
>>>>>>    [junit4]   1>        at 
>>>>>> org.apache.lucene.replicator.IndexAndTaxonomyReplicationClientTest$4.handleUpdateException(IndexAndTaxonomyReplicationClientTest.java:407)
>>>>>>    [junit4]   1>        at 
>>>>>> org.apache.lucene.replicator.ReplicationClient$ReplicationThread.run(ReplicationClient.java:78)
>>>>>>    [junit4]   1>
>>>>>>    [junit4]   1> WARNING: 1 broken segments (containing 1 documents) 
>>>>>> detected
>>>>>>    [junit4]   1>
>>>>>>    [junit4]   2> sep 03, 2014 6:53:29 AM 
>>>>>> com.carrotsearch.randomizedtesting.RandomizedRunner$QueueUncaughtExceptionsHandler
>>>>>>  uncaughtException
>>>>>>    [junit4]   2> WARNING: Uncaught exception in thread: 
>>>>>> Thread[ReplicationThread-indexAndTaxo,5,TGRP-IndexAndTaxonomyReplicationClientTest]
>>>>>>    [junit4]   2> java.lang.RuntimeException: CheckIndex failed
>>>>>>    [junit4]   2>        at 
>>>>>> __randomizedtesting.SeedInfo.seed([F78E514819F85101]:0)
>>>>>>    [junit4]   2>        at 
>>>>>> org.apache.lucene.util.TestUtil.checkIndex(TestUtil.java:211)
>>>>>>    [junit4]   2>        at 
>>>>>> org.apache.lucene.util.TestUtil.checkIndex(TestUtil.java:196)
>>>>>>    [junit4]   2>        at 
>>>>>> org.apache.lucene.util.TestUtil.checkIndex(TestUtil.java:192)
>>>>>>    [junit4]   2>        at 
>>>>>> org.apache.lucene.replicator.IndexAndTaxonomyReplicationClientTest$4.handleUpdateException(IndexAndTaxonomyReplicationClientTest.java:407)
>>>>>>    [junit4]   2>        at 
>>>>>> org.apache.lucene.replicator.ReplicationClient$ReplicationThread.run(ReplicationClient.java:78)
>>>>>>    [junit4]   2>
>>>>>>    [junit4]   2> NOTE: reproduce with: ant test  
>>>>>> -Dtestcase=IndexAndTaxonomyReplicationClientTest 
>>>>>> -Dtests.method=testConsistencyOnExceptions -Dtests.seed=F78E514819F85101 
>>>>>> -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=sl_SI 
>>>>>> -Dtests.timezone=Asia/Bangkok -Dtests.file.encoding=US-ASCII
>>>>>>    [junit4] ERROR   3.48s J1 | 
>>>>>> IndexAndTaxonomyReplicationClientTest.testConsistencyOnExceptions <<<
>>>>>>    [junit4]    > Throwable #1: 
>>>>>> com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an 
>>>>>> uncaught exception in thread: Thread[id=20, 
>>>>>> name=ReplicationThread-indexAndTaxo, state=RUNNABLE, 
>>>>>> group=TGRP-IndexAndTaxonomyReplicationClientTest]
>>>>>>    [junit4]    >        at 
>>>>>> __randomizedtesting.SeedInfo.seed([F78E514819F85101:7800B6E80B94A2FE]:0)
>>>>>>    [junit4]    > Caused by: java.lang.RuntimeException: CheckIndex failed
>>>>>>    [junit4]    >        at 
>>>>>> __randomizedtesting.SeedInfo.seed([F78E514819F85101]:0)
>>>>>>    [junit4]    >        at 
>>>>>> org.apache.lucene.util.TestUtil.checkIndex(TestUtil.java:211)
>>>>>>    [junit4]    >        at 
>>>>>> org.apache.lucene.util.TestUtil.checkIndex(TestUtil.java:196)
>>>>>>    [junit4]    >        at 
>>>>>> org.apache.lucene.util.TestUtil.checkIndex(TestUtil.java:192)
>>>>>>    [junit4]    >        at 
>>>>>> org.apache.lucene.replicator.IndexAndTaxonomyReplicationClientTest$4.handleUpdateException(IndexAndTaxonomyReplicationClientTest.java:407)
>>>>>>    [junit4]    >        at 
>>>>>> org.apache.lucene.replicator.ReplicationClient$ReplicationThread.run(ReplicationClient.java:78)
>>>>>>    [junit4]   2> NOTE: test params are: 
>>>>>> codec=FastCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=FAST,
>>>>>>  chunkSize=222), 
>>>>>> termVectorsFormat=CompressingTermVectorsFormat(compressionMode=FAST, 
>>>>>> chunkSize=222)), sim=RandomSimilarityProvider(queryNorm=false,coord=no): 
>>>>>> {}, locale=sl_SI, timezone=Asia/Bangkok
>>>>>>    [junit4]   2> NOTE: Linux 3.13.0-35-generic i386/Oracle Corporation 
>>>>>> 1.7.0_67 (32-bit)/cpus=8,threads=1,free=46127368,total=108265472
>>>>>>    [junit4]   2> NOTE: All tests run in this JVM: [IndexRevisionTest, 
>>>>>> LocalReplicatorTest, IndexAndTaxonomyReplicationClientTest]
>>>>>>    [junit4]   2> NOTE: reproduce with: ant test  
>>>>>> -Dtestcase=IndexAndTaxonomyReplicationClientTest 
>>>>>> -Dtests.seed=F78E514819F85101 -Dtests.multiplier=3 -Dtests.slow=true 
>>>>>> -Dtests.locale=sl_SI -Dtests.timezone=Asia/Bangkok 
>>>>>> -Dtests.file.encoding=US-ASCII
>>>>>>    [junit4] ERROR   0.00s J1 | IndexAndTaxonomyReplicationClientTest 
>>>>>> (suite) <<<
>>>>>>    [junit4]    > Throwable #1: java.lang.AssertionError: The test or 
>>>>>> suite printed 20384 bytes to stdout and stderr, even though the limit 
>>>>>> was set to 8192 bytes. Increase the limit with @Limit, ignore it 
>>>>>> completely with @SuppressSysoutChecks or run with -Dtests.verbose=true
>>>>>>    [junit4]    >        at 
>>>>>> __randomizedtesting.SeedInfo.seed([F78E514819F85101]:0)
>>>>>>    [junit4]    >        at java.lang.Thread.run(Thread.java:745)
>>>>>>    [junit4] Completed on J1 in 4.87s, 5 tests, 1 failure, 1 error <<< 
>>>>>> FAILURES!
>>>>>>
>>>>>> [...truncated 23 lines...]
>>>>>> BUILD FAILED
>>>>>> /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:491: The 
>>>>>> following error occurred while executing this line:
>>>>>> /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:471: The 
>>>>>> following error occurred while executing this line:
>>>>>> /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:60: The 
>>>>>> following error occurred while executing this line:
>>>>>> /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/extra-targets.xml:39: 
>>>>>> The following error occurred while executing this line:
>>>>>> /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build.xml:462: 
>>>>>> The following error occurred while executing this line:
>>>>>> /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:2083:
>>>>>>  The following error occurred while executing this line:
>>>>>> /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/module-build.xml:60:
>>>>>>  The following error occurred while executing this line:
>>>>>> /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:1337:
>>>>>>  The following error occurred while executing this line:
>>>>>> /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:952:
>>>>>>  There were test failures: 7 suites, 31 tests, 1 suite-level error, 1 
>>>>>> error
>>>>>>
>>>>>> Total time: 44 minutes 9 seconds
>>>>>> Build step 'Invoke Ant' marked build as failure
>>>>>> [description-setter] Description set: Java: 32bit/jdk1.7.0_67 -server 
>>>>>> -XX:+UseParallelGC
>>>>>> Archiving artifacts
>>>>>> Recording test results
>>>>>> Email was triggered for: Failure - Any
>>>>>> Sending email for trigger: Failure - Any
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> ---------------------------------------------------------------------
>>>>>> To unsubscribe, e-mail: [email protected]
>>>>>> For additional commands, e-mail: [email protected]
>>>>>
>>>>> ---------------------------------------------------------------------
>>>>> To unsubscribe, e-mail: [email protected]
>>>>> For additional commands, e-mail: [email protected]
>>>>>
>>>>
>>>> ---------------------------------------------------------------------
>>>> To unsubscribe, e-mail: [email protected]
>>>> For additional commands, e-mail: [email protected]
>>>>
>>>
>>> ---------------------------------------------------------------------
>>> To unsubscribe, e-mail: [email protected]
>>> For additional commands, e-mail: [email protected]
>>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: [email protected]
>> For additional commands, e-mail: [email protected]
>>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: [email protected]
> For additional commands, e-mail: [email protected]
>

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to