I believe I've got to the root cause of these OOMs: SegmentInfoPerCommit continues to list the updates files that are no longer is use, causing the files to not be deleted from the Directory. With those seeds, the directory in use in RAMDirectory, and with the large number of threads, documents and updates, it causes too many updates files (DV and FieldInfos), which are being accumulated by RAMDir and consume heap space.
I'll open an issue to fix SIPC (the fix isn't trivial). Also, I think the test is overwhelming and I'd like to make the following changes: 1) Limit the number of update threads to 3-6. It currently uses atLeast(3) which, depends on the seed, multiplier and nightly parameters may reach a very high number. This is unrealistic as usually apps don't index with so many threads. 2) Currently each update thread randomly calls commit. What happens after a while (and maybe it's because the heap space fills up, I'm not sure), I see the threads process their updates almost serially. In the profiler it looks like they wait in commit(). Again, this is not very realistic so I'd like to extract the commit logic to a separate thread. Shai On Sun, Sep 29, 2013 at 12:29 PM, Apache Jenkins Server < [email protected]> wrote: > Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/395/ > > 1 tests failed. > REGRESSION: > org.apache.lucene.index.TestNumericDocValuesUpdates.testStressMultiThreading > > Error Message: > Captured an uncaught exception in thread: Thread[id=3772, > name=UpdateThread-4, state=RUNNABLE, group=TGRP-TestNumericDocValuesUpdates] > > Stack Trace: > com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an > uncaught exception in thread: Thread[id=3772, name=UpdateThread-4, > state=RUNNABLE, group=TGRP-TestNumericDocValuesUpdates] > Caused by: java.lang.OutOfMemoryError: Java heap space > at __randomizedtesting.SeedInfo.seed([DC72E2EC374719A5]:0) > at java.util.Arrays.copyOfRange(Arrays.java:2694) > at java.lang.String.<init>(String.java:203) > at java.lang.StringBuilder.toString(StringBuilder.java:405) > at > java.util.AbstractCollection.toString(AbstractCollection.java:452) > at java.lang.String.valueOf(String.java:2854) > at java.lang.StringBuilder.append(StringBuilder.java:128) > at > org.apache.lucene.index.IndexWriter.startCommit(IndexWriter.java:4213) > at > org.apache.lucene.index.IndexWriter.prepareCommitInternal(IndexWriter.java:2808) > at > org.apache.lucene.index.IndexWriter.commitInternal(IndexWriter.java:2896) > at > org.apache.lucene.index.IndexWriter.commit(IndexWriter.java:2871) > at > org.apache.lucene.index.TestNumericDocValuesUpdates$2.run(TestNumericDocValuesUpdates.java:972) > > > > > Build Log: > [...truncated 1539 lines...] > [junit4] Suite: org.apache.lucene.index.TestNumericDocValuesUpdates > [junit4] 2> NOTE: download the large Jenkins line-docs file by > running 'ant get-jenkins-line-docs' in the lucene directory. > [junit4] 2> NOTE: reproduce with: ant test > -Dtestcase=TestNumericDocValuesUpdates > -Dtests.method=testStressMultiThreading -Dtests.seed=DC72E2EC374719A5 > -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true > -Dtests.linedocsfile=/home/hudson/lucene-data/enwiki.random.lines.txt > -Dtests.locale=el -Dtests.timezone=Europe/Vatican > -Dtests.file.encoding=US-ASCII > [junit4] ERROR 1050s J0 | > TestNumericDocValuesUpdates.testStressMultiThreading <<< > [junit4] > Throwable #1: java.lang.AssertionError: > expected:<-3606872460> but was:<1515048958> > [junit4] > at > org.apache.lucene.index.TestNumericDocValuesUpdates.testStressMultiThreading(TestNumericDocValuesUpdates.java:1001) > [junit4] > at java.lang.Thread.run(Thread.java:724)Throwable > #2: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an > uncaught exception in thread: Thread[id=3772, name=UpdateThread-4, > state=RUNNABLE, group=TGRP-TestNumericDocValuesUpdates] > [junit4] > Caused by: java.lang.OutOfMemoryError: Java heap space > [junit4] > at > __randomizedtesting.SeedInfo.seed([DC72E2EC374719A5]:0) > [junit4] > at java.util.Arrays.copyOfRange(Arrays.java:2694) > [junit4] > at java.lang.String.<init>(String.java:203) > [junit4] > at > java.lang.StringBuilder.toString(StringBuilder.java:405) > [junit4] > at > java.util.AbstractCollection.toString(AbstractCollection.java:452) > [junit4] > at java.lang.String.valueOf(String.java:2854) > [junit4] > at > java.lang.StringBuilder.append(StringBuilder.java:128) > [junit4] > at > org.apache.lucene.index.IndexWriter.startCommit(IndexWriter.java:4213) > [junit4] > at > org.apache.lucene.index.IndexWriter.prepareCommitInternal(IndexWriter.java:2808) > [junit4] > at > org.apache.lucene.index.IndexWriter.commitInternal(IndexWriter.java:2896) > [junit4] > at > org.apache.lucene.index.IndexWriter.commit(IndexWriter.java:2871) > [junit4] > at > org.apache.lucene.index.TestNumericDocValuesUpdates$2.run(TestNumericDocValuesUpdates.java:972)Throwable > #3: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an > uncaught exception in thread: Thread[id=3778, name=UpdateThread-10, > state=RUNNABLE, group=TGRP-TestNumericDocValuesUpdates] > [junit4] > Caused by: java.lang.IllegalStateException: this writer > hit an OutOfMemoryError; cannot commit > [junit4] > at > __randomizedtesting.SeedInfo.seed([DC72E2EC374719A5]:0) > [junit4] > at > org.apache.lucene.index.IndexWriter.prepareCommitInternal(IndexWriter.java:2724) > [junit4] > at > org.apache.lucene.index.IndexWriter.commitInternal(IndexWriter.java:2896) > [junit4] > at > org.apache.lucene.index.IndexWriter.commit(IndexWriter.java:2871) > [junit4] > at > org.apache.lucene.index.TestNumericDocValuesUpdates$2.run(TestNumericDocValuesUpdates.java:972)Throwable > #4: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an > uncaught exception in thread: Thread[id=3774, name=UpdateThread-6, > state=RUNNABLE, group=TGRP-TestNumericDocValuesUpdates] > [junit4] > Caused by: java.lang.IllegalStateException: this writer > hit an OutOfMemoryError; cannot commit > [junit4] > at > __randomizedtesting.SeedInfo.seed([DC72E2EC374719A5]:0) > [junit4] > at > org.apache.lucene.index.IndexWriter.prepareCommitInternal(IndexWriter.java:2724) > [junit4] > at > org.apache.lucene.index.IndexWriter.commitInternal(IndexWriter.java:2896) > [junit4] > at > org.apache.lucene.index.IndexWriter.commit(IndexWriter.java:2871) > [junit4] > at > org.apache.lucene.index.TestNumericDocValuesUpdates$2.run(TestNumericDocValuesUpdates.java:972)Throwable > #5: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an > uncaught exception in thread: Thread[id=3776, name=UpdateThread-8, > state=RUNNABLE, group=TGRP-TestNumericDocValuesUpdates] > [junit4] > Caused by: java.lang.IllegalStateException: this writer > hit an OutOfMemoryError; cannot commit > [junit4] > at > __randomizedtesting.SeedInfo.seed([DC72E2EC374719A5]:0) > [junit4] > at > org.apache.lucene.index.IndexWriter.prepareCommitInternal(IndexWriter.java:2724) > [junit4] > at > org.apache.lucene.index.IndexWriter.commitInternal(IndexWriter.java:2896) > [junit4] > at > org.apache.lucene.index.IndexWriter.commit(IndexWriter.java:2871) > [junit4] > at > org.apache.lucene.index.TestNumericDocValuesUpdates$2.run(TestNumericDocValuesUpdates.java:972)Throwable > #6: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an > uncaught exception in thread: Thread[id=3780, name=UpdateThread-12, > state=RUNNABLE, group=TGRP-TestNumericDocValuesUpdates] > [junit4] > Caused by: java.lang.IllegalStateException: this writer > hit an OutOfMemoryError; cannot commit > [junit4] > at > __randomizedtesting.SeedInfo.seed([DC72E2EC374719A5]:0) > [junit4] > at > org.apache.lucene.index.IndexWriter.prepareCommitInternal(IndexWriter.java:2724) > [junit4] > at > org.apache.lucene.index.IndexWriter.commitInternal(IndexWriter.java:2896) > [junit4] > at > org.apache.lucene.index.IndexWriter.commit(IndexWriter.java:2871) > [junit4] > at > org.apache.lucene.index.TestNumericDocValuesUpdates$2.run(TestNumericDocValuesUpdates.java:972)Throwable > #7: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an > uncaught exception in thread: Thread[id=3773, name=UpdateThread-5, > state=RUNNABLE, group=TGRP-TestNumericDocValuesUpdates] > [junit4] > Caused by: java.lang.IllegalStateException: this writer > hit an OutOfMemoryError; cannot commit > [junit4] > at > __randomizedtesting.SeedInfo.seed([DC72E2EC374719A5]:0) > [junit4] > at > org.apache.lucene.index.IndexWriter.prepareCommitInternal(IndexWriter.java:2724) > [junit4] > at > org.apache.lucene.index.IndexWriter.commitInternal(IndexWriter.java:2896) > [junit4] > at > org.apache.lucene.index.IndexWriter.commit(IndexWriter.java:2871) > [junit4] > at > org.apache.lucene.index.TestNumericDocValuesUpdates$2.run(TestNumericDocValuesUpdates.java:972)Throwable > #8: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an > uncaught exception in thread: Thread[id=3777, name=UpdateThread-9, > state=RUNNABLE, group=TGRP-TestNumericDocValuesUpdates] > [junit4] > Caused by: java.lang.IllegalStateException: this writer > hit an OutOfMemoryError; cannot commit > [junit4] > at > __randomizedtesting.SeedInfo.seed([DC72E2EC374719A5]:0) > [junit4] > at > org.apache.lucene.index.IndexWriter.prepareCommitInternal(IndexWriter.java:2724) > [junit4] > at > org.apache.lucene.index.IndexWriter.commitInternal(IndexWriter.java:2896) > [junit4] > at > org.apache.lucene.index.IndexWriter.commit(IndexWriter.java:2871) > [junit4] > at > org.apache.lucene.index.TestNumericDocValuesUpdates$2.run(TestNumericDocValuesUpdates.java:972)Throwable > #9: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an > uncaught exception in thread: Thread[id=3769, name=UpdateThread-1, > state=RUNNABLE, group=TGRP-TestNumericDocValuesUpdates] > [junit4] > Caused by: java.lang.IllegalStateException: this writer > hit an OutOfMemoryError; cannot commit > [junit4] > at > __randomizedtesting.SeedInfo.seed([DC72E2EC374719A5]:0) > [junit4] > at > org.apache.lucene.index.IndexWriter.prepareCommitInternal(IndexWriter.java:2724) > [junit4] > at > org.apache.lucene.index.IndexWriter.commitInternal(IndexWriter.java:2896) > [junit4] > at > org.apache.lucene.index.IndexWriter.commit(IndexWriter.java:2871) > [junit4] > at > org.apache.lucene.index.TestNumericDocValuesUpdates$2.run(TestNumericDocValuesUpdates.java:972)Throwable > #10: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an > uncaught exception in thread: Thread[id=3775, name=UpdateThread-7, > state=RUNNABLE, group=TGRP-TestNumericDocValuesUpdates] > [junit4] > Caused by: java.lang.IllegalStateException: this writer > hit an OutOfMemoryError; cannot commit > [junit4] > at > __randomizedtesting.SeedInfo.seed([DC72E2EC374719A5]:0) > [junit4] > at > org.apache.lucene.index.IndexWriter.prepareCommitInternal(IndexWriter.java:2724) > [junit4] > at > org.apache.lucene.index.IndexWriter.commitInternal(IndexWriter.java:2896) > [junit4] > at > org.apache.lucene.index.IndexWriter.commit(IndexWriter.java:2871) > [junit4] > at > org.apache.lucene.index.TestNumericDocValuesUpdates$2.run(TestNumericDocValuesUpdates.java:972)Throwable > #11: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an > uncaught exception in thread: Thread[id=3771, name=UpdateThread-3, > state=RUNNABLE, group=TGRP-TestNumericDocValuesUpdates] > [junit4] > Caused by: java.lang.IllegalStateException: this writer > hit an OutOfMemoryError; cannot commit > [junit4] > at > __randomizedtesting.SeedInfo.seed([DC72E2EC374719A5]:0) > [junit4] > at > org.apache.lucene.index.IndexWriter.prepareCommitInternal(IndexWriter.java:2724) > [junit4] > at > org.apache.lucene.index.IndexWriter.commitInternal(IndexWriter.java:2896) > [junit4] > at > org.apache.lucene.index.IndexWriter.commit(IndexWriter.java:2871) > [junit4] > at > org.apache.lucene.index.TestNumericDocValuesUpdates$2.run(TestNumericDocValuesUpdates.java:972)Throwable > #12: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an > uncaught exception in thread: Thread[id=3779, name=UpdateThread-11, > state=RUNNABLE, group=TGRP-TestNumericDocValuesUpdates] > [junit4] > Caused by: java.lang.IllegalStateException: this writer > hit an OutOfMemoryError; cannot commit > [junit4] > at > __randomizedtesting.SeedInfo.seed([DC72E2EC374719A5]:0) > [junit4] > at > org.apache.lucene.index.IndexWriter.prepareCommitInternal(IndexWriter.java:2724) > [junit4] > at > org.apache.lucene.index.IndexWriter.commitInternal(IndexWriter.java:2896) > [junit4] > at > org.apache.lucene.index.IndexWriter.commit(IndexWriter.java:2871) > [junit4] > at > org.apache.lucene.index.TestNumericDocValuesUpdates$2.run(TestNumericDocValuesUpdates.java:972)Throwable > #13: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an > uncaught exception in thread: Thread[id=3768, name=UpdateThread-0, > state=RUNNABLE, group=TGRP-TestNumericDocValuesUpdates] > [junit4] > Caused by: java.lang.IllegalStateException: this writer > hit an OutOfMemoryError; cannot commit > [junit4] > at > __randomizedtesting.SeedInfo.seed([DC72E2EC374719A5]:0) > [junit4] > at > org.apache.lucene.index.IndexWriter.prepareCommitInternal(IndexWriter.java:2724) > [junit4] > at > org.apache.lucene.index.IndexWriter.commitInternal(IndexWriter.java:2896) > [junit4] > at > org.apache.lucene.index.IndexWriter.commit(IndexWriter.java:2871) > [junit4] > at > org.apache.lucene.index.TestNumericDocValuesUpdates$2.run(TestNumericDocValuesUpdates.java:972) > [junit4] 2> NOTE: test params are: codec=Lucene46: > {ndv=PostingsFormat(name=TestBloomFilteredLucene41Postings), f=FST41, > id=MockVariableIntBlock(baseBlockSize=35), > dvUpdateKey=PostingsFormat(name=TestBloomFilteredLucene41Postings), > foo=FST41, updKey=FST41, k1=FST41, > key=MockVariableIntBlock(baseBlockSize=35), > k2=MockVariableIntBlock(baseBlockSize=35)}, > docValues:{val=DocValuesFormat(name=Asserting), > f6=DocValuesFormat(name=Memory), f7=DocValuesFormat(name=Asserting), > f8=DocValuesFormat(name=SimpleText), f9=DocValuesFormat(name=Disk), > f12=DocValuesFormat(name=Disk), f11=DocValuesFormat(name=SimpleText), > f10=DocValuesFormat(name=Asserting), ssdv=DocValuesFormat(name=SimpleText), > ndv=DocValuesFormat(name=Memory), cf12=DocValuesFormat(name=Memory), > cf10=DocValuesFormat(name=SimpleText), cf11=DocValuesFormat(name=Disk), > ndv1=DocValuesFormat(name=Asserting), f1=DocValuesFormat(name=Disk), > ndv2=DocValuesFormat(name=SimpleText), f0=DocValuesFormat(name=SimpleText), > f3=DocValuesFormat(name=Asserting), bdv=DocValuesFormat(name=Memory), > f2=DocValuesFormat(name=Memory), f5=DocValuesFormat(name=Disk), > f4=DocValuesFormat(name=SimpleText), f=DocValuesFormat(name=SimpleText), > control=DocValuesFormat(name=Asserting), > sdv=DocValuesFormat(name=Asserting), cf5=DocValuesFormat(name=SimpleText), > cf6=DocValuesFormat(name=Disk), cf3=DocValuesFormat(name=Memory), > cf4=DocValuesFormat(name=Asserting), cf9=DocValuesFormat(name=SimpleText), > cf7=DocValuesFormat(name=Memory), cf8=DocValuesFormat(name=Asserting), > cf2=DocValuesFormat(name=Disk), cf1=DocValuesFormat(name=SimpleText), > cf0=DocValuesFormat(name=Asserting), cf=DocValuesFormat(name=Disk)}, > sim=DefaultSimilarity, locale=el, timezone=Europe/Vatican > [junit4] 2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation > 1.7.0_25 (64-bit)/cpus=16,threads=1,free=272290832,total=514392064 > [junit4] 2> NOTE: All tests run in this JVM: [TestPayloads, > TestPostingsFormat, TestRegexpRandom, TestCompressingTermVectorsFormat, > TestSegmentReader, TestComplexExplanations, TestExplanations, TestSort, > TestFieldCacheRangeFilter, TestMultiPhraseQuery, TestRollingUpdates, > ThrowInUncaught, Nested3, Nested1, Nested2, TestSearchAfter, > TestPostingsOffsets, TestSegmentTermEnum, TestDateTools, Nested1, > TestSearchForDuplicates, TestReuseDocsEnum, TestDocTermOrdsRewriteMethod, > TestNoMergeScheduler, TestPayloadsOnVectors, TestFlushByRamOrCountsPolicy, > InBeforeClass, InAfterClass, InTestMethod, NonStringProperties, > TestNumericRangeQuery64, TestIndexableField, TestDeterminism, > TestTryDelete, TestLucene40PostingsReader, TestPrefixRandom, > TestConcurrentMergeScheduler, TestTransactionRollback, > TestPhrasePrefixQuery, TestSpansAdvanced2, TestLucene41StoredFieldsFormat, > TestFieldCacheSanityChecker, TestMockCharFilter, TestLockFactory, > TestMultiTermQueryRewrites, TestSearcherManager, TestUniqueTermCount, > FuzzyTermOnShortTermsTest, TestMergeSchedulerExternal, > TestIndexWriterConfig, TestFieldCacheRewriteMethod, > TestParallelAtomicReader, TestSpanFirstQuery, > TestComplexExplanationsOfNonMatches, TestTopScoreDocCollector, Test2BTerms, > TestAutomatonQueryUnicode, TestSimilarity, TestFixedBitSet, > TestDocValuesWithThreads, TestTermVectorsWriter, TestCharTermAttributeImpl, > TestParallelTermEnum, TestSubScorerFreqs, TestBagOfPositions, > TestFastDecompressionMode, TestBooleanMinShouldMatch, TestVirtualMethod, > Nested1, TestPrefixFilter, TestLucene45DocValuesFormat, TestTopDocsMerge, > TestIndexWriterCommit, TestMaxTermFrequency, TestFieldsReader, > TestWildcardRandom, TestShardSearching, TestFilteredSearch, > TestIndexCommit, TestEliasFanoDocIdSet, Nested, Nested, TestWAH8DocIdSet, > TestIndexWriterLockRelease, TestFieldCacheTermsFilter, > TestBlockPostingsFormat3, TestUTF32ToUTF8, TestSegmentTermDocs, > TestIndexWriterReader, TestPagedBytes, TestBytesStore, TestPriorityQueue, > TestRecyclingByteBlockAllocator, TestRegexpQuery, TestCustomSearcherSort, > TestIndexWriterMerging, TestPersistentSnapshotDeletionPolicy, > TestDisjunctionMaxQuery, TestPackedInts, TestLucene42DocValuesFormat, > TestDeletionPolicy, TestLucene40DocValuesFormat, TestDuelingCodecs, > TestBoolean2, TestStressAdvance, TestNorms, TestDirectoryReaderReopen, > TestTimeLimitingCollector, TestHighCompressionMode, TestOpenBitSet, > TestDocumentsWriterStallControl, TestNeverDelete, TestCompoundFile, > TestStressIndexing, TestMinimize, TestSnapshotDeletionPolicy, > TestNRTReaderWithThreads, TestIndexWriterForceMerge, TestArrayUtil, > TestByteSlices, TestBufferedIndexInput, TestTermsEnum, TestWeakIdentityMap, > TestSimpleExplanations, TestDirectoryReader, TestDocTermOrdsRangeFilter, > TestPhraseQuery, TestCollectionUtil, TestDoubleBarrelLRUCache, > TestMockAnalyzer, TestNRTCachingDirectory, TestParallelCompositeReader, > TestCrash, TestSimpleSearchEquivalence, TestPayloadTermQuery, > TestHugeRamFile, TestTermsEnum2, TestDeterminizeLexicon, Test2BDocs, > TestIndexWriterOnDiskFull, TestFieldCache, TestSpans, TestCustomNorms, > TestMixedCodecs, TestPayloadSpans, TestLucene40PostingsFormat, TestFlex, > TestSortDocValues, TestDocTermOrds, TestFastCompressionMode, > TestStressIndexing2, TestRamUsageEstimatorOnWildAnimals, TestCodecs, > TestOmitPositions, TestBytesRefHash, TestThreadedForceMerge, TestStressNRT, > TestIndexInput, TestFilteredQuery, TestSpecialOperations, > TestForceMergeForever, TestQueryWrapperFilter, TestTermRangeQuery, > TestDocumentsWriterDeleteQueue, TestDocumentWriter, > TestCrashCausesCorruptIndex, TestScorerPerf, TestCachingCollector, > TestBinaryDocument, NestedSetupChain, NestedTeardownChain, > TestBooleanScorer, TestLock, TestRamUsageEstimator, Nested1, Nested, > TestIsCurrent, TestBytesRef, TestDemo, TestRollback, TestFieldInfos, > TestTwoPhaseCommitTool, TestNot, TestCloseableThreadLocal, > TestVersionComparator, TestIndexWriterOnJRECrash, TestVersion, Nested1, > TestCodecHoldsOpenFiles, TestReaderClosed, TestDocBoost, > TestNGramPhraseQuery, TestScoreCachingWrappingScorer, TestIntsRef, > TestSimpleAttributeImpl, TestTermdocPerf, Test2BPositions, > Test2BPostingsBytes, TestIOUtils, TestNewestSegment, > TestReusableStringReader, TestNumericDocValuesUpdates] > [junit4] Completed on J0 in 1058.07s, 25 tests, 1 error <<< FAILURES! > > [...truncated 42 lines...] > BUILD FAILED > /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:428: > The following error occurred while executing this line: > /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:401: > The following error occurred while executing this line: > /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:39: > The following error occurred while executing this line: > /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/build.xml:49: > The following error occurred while executing this line: > /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1230: > The following error occurred while executing this line: > /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:873: > There were test failures: 368 suites, 2614 tests, 1 error, 82 ignored (69 > assumptions) > > Total time: 46 minutes 10 seconds > Build step 'Invoke Ant' marked build as failure > Archiving artifacts > Recording test results > Email was triggered for: Failure > Sending email for trigger: Failure > > > > > --------------------------------------------------------------------- > To unsubscribe, e-mail: [email protected] > For additional commands, e-mail: [email protected] >
