Sounds reasonable Once we get Lucene.NET 4.8 out the door I will get back to trying to integrate carrotsearch's approach of re-running tests with their psuedo-random tests framework, that should help moving forward..
-- Itamar Syn-Hershko http://code972.com | @synhershko <https://twitter.com/synhershko> Freelance Developer & Consultant Author of RavenDB in Action <http://manning.com/synhershko/> On Wed, Dec 31, 2014 at 5:02 PM, Laimonas Simutis <[email protected]> wrote: > Itamar, > > I doubt that the latest changes is what did it. I just ran a full test > suite locally on existing master and got the results that match what we > would expect: 2206 pass, 481 fail. > > It is very much likely a case of random tests triggering a certain > condition that sets default codec to 3x and then when test data is created > in Test Setup step these exceptions are being triggered. Again, it is a > guess, but based on what I have observed. Also, keep in mind that I was > seeing "System.NotSupportedException : this codec can only be used for > reading" almost from the first full suite runs locally. I just chose to not > deal with them at that time as it is very inconsistent in how it can be > reproduced. > > My approach right now is to run the full test over and over again with > some modified logging to see if I can track down how Lucene3x codec ends up > being used for the tests that are writing data. > > > Laimonas > > > On Wed Dec 31 2014 at 8:45:13 AM Itamar Syn-Hershko <[email protected]> > wrote: > >> IIRC this is due to some confuguration in the tests env not being picked >> up >> correctly. Since this only happened since your last change I'd revert it >> and work from there. >> >> -- >> >> Itamar Syn-Hershko >> http://code972.com | @synhershko <https://twitter.com/synhershko> >> Freelance Developer & Consultant >> Author of RavenDB in Action <http://manning.com/synhershko/> >> >> On Wed, Dec 31, 2014 at 1:36 PM, Laimonas Simutis <[email protected]> >> wrote: >> >> > Looks much worse :) >> > >> > The tests are filled with "System.NotSupportedException : this codec can >> > only be used for reading" failures. I actually ran into this locally >> almost >> > all the time whenever I did a full Lucene.Net.Tests solution test run. I >> > used to wonder why TC tests did not fail in such way. So it could be >> that >> > you need to hit the right set of circumstances to make it happen. >> > >> > If after encountering these failures I run the tests by fixture or only >> > certain area (e.g. Lucene.Net.Store), they all pass (the ones that don't >> > have other issues). My guess is that it is an issue with cleanup >> somewhere >> > that is not happening properly cascading to the rest of test cases. >> > >> > I will investigate. Please share if anybody else have any clues as to >> what >> > is going on. >> > >> > >> > Laimonas >> > >> > >> > On Wed Dec 31 2014 at 4:15:42 AM Itamar Syn-Hershko <[email protected] >> > >> > wrote: >> > >> > > Ok that doesn't look any better... >> > > >> > > -- >> > > >> > > Itamar Syn-Hershko >> > > http://code972.com | @synhershko <https://twitter.com/synhershko> >> > > Freelance Developer & Consultant >> > > Author of RavenDB in Action <http://manning.com/synhershko/> >> > > >> > > On Wed, Dec 31, 2014 at 11:10 AM, <[email protected]> wrote: >> > > >> > > > Build Lucene.NET :: Lucene.NET Core #57 failed (Tests failed: 874 >> (466 >> > > > new), passed: 1396, ignored: 524). >> > > > Agent: JetBrains-dotnet-agent02 >> > > > Build results: >> > > > http://teamcity.codebetter.com/viewLog.html?buildId=177083&; >> > > buildTypeId=LuceneNet_Core >> > > > >> > > > Failed Tests Summary: >> > > > Newly failed tests (466 tests, alphabetically ordered, only first >> 100 >> > > > shown) >> > > > ================================================================== >> > > > Lucene.Net.Tests.dll: >> > > > Lucene.Net.Codecs.Compressing.TestCompressingStoredFieldsFormat. >> > > BaseStoredFieldsFormatTestCase.TestBinaryFieldOffsetLength >> > > > Lucene.Net.Tests.dll: >> > > > Lucene.Net.Codecs.Compressing.TestCompressingTermVectorsForm >> > > at.TestNoOrds >> > > > Lucene.Net.Tests.dll: >> > > > Lucene.Net.Codecs.Lucene40.TestLucene40DocValuesFormat.BaseD >> > > ocValuesFormatTestCase.TestBytesTwoDocumentsMerged >> > > > Lucene.Net.Tests.dll: >> > > > Lucene.Net.Codecs.Lucene40.TestLucene40DocValuesFormat.BaseD >> > > ocValuesFormatTestCase.TestHugeBinaryValueLimit >> > > > Lucene.Net.Tests.dll: >> > > > Lucene.Net.Codecs.Lucene40.TestLucene40DocValuesFormat.BaseD >> > > ocValuesFormatTestCase.TestSortedBytesTwoDocumentsMerged >> > > > Lucene.Net.Tests.dll: >> > > > Lucene.Net.Codecs.Lucene40.TestLucene40PostingsFormat.BasePo >> > > stingsFormatTestCase.TestDocsAndFreqs >> > > > Lucene.Net.Tests.dll: >> > > > Lucene.Net.Codecs.Lucene40.TestLucene40PostingsFormat.BasePo >> > > stingsFormatTestCase.TestDocsAndFreqsAndPositionsAn >> dOffsetsAndPayloads >> > > > Lucene.Net.Tests.dll: >> > > > Lucene.Net.Codecs.Lucene40.TestLucene40TermVectorsFormat.Bas >> > > eTermVectorsFormatTestCase.TestMixedOptions >> > > > Lucene.Net.Tests.dll: >> > > > Lucene.Net.Codecs.Lucene40.TestLucene40TermVectorsFormat.Bas >> > > eTermVectorsFormatTestCase.TestRandom >> > > > Lucene.Net.Tests.dll: >> > > > Lucene.Net.Codecs.Lucene42.TestLucene42DocValuesFormat.BaseD >> > > ocValuesFormatTestCase.TestBooleanNumericsVsStoredFields >> > > > Lucene.Net.Tests.dll: >> > > > Lucene.Net.Codecs.Lucene42.TestLucene42DocValuesFormat.BaseD >> > > ocValuesFormatTestCase.TestLongNumericsVsStoredFields >> > > > Lucene.Net.Tests.dll: >> > > > Lucene.Net.Codecs.Lucene45.TestLucene45DocValuesFormat.BaseD >> > > ocValuesFormatTestCase.TestBytesTwoDocumentsMerged >> > > > Lucene.Net.Tests.dll: >> > > > Lucene.Net.Codecs.Perfield.TestPerFieldDocValuesFormat.BaseD >> > > ocValuesFormatTestCase.TestHugeBinaryValueLimit >> > > > Lucene.Net.Tests.dll: >> > > > Lucene.Net.Codecs.Perfield.TestPerFieldDocValuesFormat.BaseD >> > > ocValuesFormatTestCase.TestTwoDocumentsMerged >> > > > Lucene.Net.Tests.dll: >> > > > Lucene.Net.Codecs.Perfield.TestPerFieldDocValuesFormat.BaseI >> > > ndexFileFormatTestCase.TestMergeStability >> > > > Lucene.Net.Tests.dll: >> > > > Lucene.Net.Codecs.Perfield.TestPerFieldPostingsFormat.BasePo >> > > stingsFormatTestCase.TestDocsAndFreqs >> > > > Lucene.Net.Tests.dll: >> > > > Lucene.Net.Index.TestAddIndexes.TestAddIndexesWithThreads >> > > > Lucene.Net.Tests.dll: >> > > > Lucene.Net.Index.TestBinaryDocValuesUpdates.TestUpdateFewSegments >> > > > Lucene.Net.Tests.dll: >> > > > Lucene.Net.Index.TestConsistentFieldNumbers.TestSameFieldNum >> > > bersAcrossSegments >> > > > Lucene.Net.Tests.dll: >> > > > Lucene.Net.Index.TestDocValuesFormat.BaseDocValuesFormatTestCase. >> > > TestBytesTwoDocumentsMerged >> > > > Lucene.Net.Tests.dll: >> > > > Lucene.Net.Index.TestDocValuesFormat.BaseDocValuesFormatTestCase. >> > > TestSortedSetTwoDocumentsLastMissingMerge >> > > > Lucene.Net.Tests.dll: >> > > > Lucene.Net.Index.TestIndexWriterConfig.TestLiveChangeToCFS >> > > > Lucene.Net.Tests.dll: >> > > > Lucene.Net.Index.TestIndexWriterForceMerge.TestBackgroundForceMerge >> > > > Lucene.Net.Tests.dll: >> > > > Lucene.Net.Index.TestIndexWriterMergePolicy. >> TestMaxBufferedDocsChange >> > > > Lucene.Net.Tests.dll: >> > > > Lucene.Net.Index.TestIndexWriterReader.TestMergeWarmer >> > > > Lucene.Net.Tests.dll: >> > > > Lucene.Net.Index.TestIndexWriterReader.TestReopenAfterNoRealChange >> > > > Lucene.Net.Tests.dll: >> > > > Lucene.Net.Index.TestIndexWriterWithThreads.TestIOExceptionD >> > > uringWriteSegmentWithThreadsOnlyOnce >> > > > Lucene.Net.Tests.dll: >> > > > Lucene.Net.Index.TestIndexableField.TestArbitraryFields >> > > > Lucene.Net.Tests.dll: Lucene.Net.Index. >> TestMultiDocValues.TestBinary >> > > > Lucene.Net.Tests.dll: Lucene.Net.Index.TestMultiDocValues. >> TestNumerics >> > > > Lucene.Net.Tests.dll: >> > > > Lucene.Net.Index.TestNumericDocValuesUpdates.TestSegmentMerges >> > > > Lucene.Net.Tests.dll: Lucene.Net.Index.TestOmitNorms.TestOmitNorms_ >> Mem >> > > > Lucene.Net.Tests.dll: Lucene.Net.Index.TestOmitTf.TestNoPrxFile >> > > > Lucene.Net.Tests.dll: >> > > > Lucene.Net.Index.TestPostingsFormat.BasePostingsFormatTestCase. >> > > TestDocsAndFreqsAndPositionsAndOffsetsAndPayloads >> > > > Lucene.Net.Tests.dll: >> > > > Lucene.Net.Index.TestPostingsFormat.BasePostingsFormatTestCase. >> > > TestDocsOnly >> > > > Lucene.Net.Tests.dll: >> > > > Lucene.Net.Index.TestRollingUpdates.TestRollingUpdates_Mem >> > > > Lucene.Net.Tests.dll: Lucene.Net.Index. >> TestSameTokenSamePosition.Test >> > > > Lucene.Net.Tests.dll: >> > > > Lucene.Net.Index.TestSameTokenSamePosition.TestMoreDocs >> > > > Lucene.Net.Tests.dll: Lucene.Net.Index.TestSegmentMerger.Test >> > > > Lucene.Net.Tests.dll: >> > Lucene.Net.Index.TestSegmentMerger.TestBuildDocMap >> > > > Lucene.Net.Tests.dll: Lucene.Net.Index.TestSegmentReader.Test >> > > > Lucene.Net.Tests.dll: >> > > > Lucene.Net.Index.TestSegmentReader.TestGetFieldNameVariations >> > > > Lucene.Net.Tests.dll: Lucene.Net.Index.TestSegmentReader.TestNorms >> > > > Lucene.Net.Tests.dll: >> > > > Lucene.Net.Index.TestSegmentReader.TestOutOfBoundsAccess >> > > > Lucene.Net.Tests.dll: >> > Lucene.Net.Index.TestSegmentReader.TestTermVectors >> > > > Lucene.Net.Tests.dll: Lucene.Net.Index.TestSegmentReader.TestTerms >> > > > Lucene.Net.Tests.dll: Lucene.Net.Index.TestSegmentTermDocs.Test >> > > > Lucene.Net.Tests.dll: Lucene.Net.Index.TestSegmentTermDocs. >> TestBadSeek >> > > > Lucene.Net.Tests.dll: Lucene.Net.Index. >> TestSegmentTermDocs.TestSkipTo >> > > > Lucene.Net.Tests.dll: Lucene.Net.Index.TestSegmentTermEnum. >> TestTermEnum >> > > > Lucene.Net.Tests.dll: >> > > > Lucene.Net.Index.TestSizeBoundedForceMerge.TestSingleMergeab >> > > leTooLargeSegment >> > > > Lucene.Net.Tests.dll: >> > > > >> > Lucene.Net.Index.TestSizeBoundedForceMerge. >> TestSingleNonMergeableSegment >> > > > Lucene.Net.Tests.dll: >> > > > Lucene.Net.Index.TestStoredFieldsFormat. >> BaseStoredFieldsFormatTestCase. >> > > TestBulkMergeWithDeletes >> > > > Lucene.Net.Tests.dll: >> > > > Lucene.Net.Index.TestStoredFieldsFormat. >> BaseStoredFieldsFormatTestCase >> > > .TestConcurrentReads >> > > > Lucene.Net.Tests.dll: >> > > > Lucene.Net.Index.TestStoredFieldsFormat. >> BaseStoredFieldsFormatTestCase >> > > .TestIndexedBit >> > > > Lucene.Net.Tests.dll: >> > > > Lucene.Net.Index.TestStoredFieldsFormat. >> BaseStoredFieldsFormatTestCase >> > > .TestReadSkip >> > > > Lucene.Net.Tests.dll: >> > > > Lucene.Net.Index.TestStoredFieldsFormat.TestWriteReadMerge >> > > > Lucene.Net.Tests.dll: Lucene.Net.Index.TestStressIndexing2. >> > > TestMultiConfig >> > > > Lucene.Net.Tests.dll: >> > Lucene.Net.Index.TestSumDocFreq.TestSumDocFreq_Mem >> > > > Lucene.Net.Tests.dll: Lucene.Net.Index.TestTermVectorsReader.Test >> > > > Lucene.Net.Tests.dll: Lucene.Net.Index.TestTermVectorsReader. >> > > TestDocsEnum >> > > > Lucene.Net.Tests.dll: >> > > > Lucene.Net.Index.TestTermVectorsReader.TestIllegalIndexableField >> > > > Lucene.Net.Tests.dll: >> > > > Lucene.Net.Index.TestTermVectorsReader.TestOffsetReader >> > > > Lucene.Net.Tests.dll: >> > > > Lucene.Net.Index.TestTermVectorsReader.TestPositionReader >> > > > Lucene.Net.Tests.dll: Lucene.Net.Index.TestTermVectorsReader. >> TestReader >> > > > Lucene.Net.Tests.dll: >> > > > Lucene.Net.Index.TestTermVectorsWriter.TestDoubleOffsetCounting >> > > > Lucene.Net.Tests.dll: >> > > > Lucene.Net.Index.TestTermVectorsWriter.TestDoubleOffsetCounting2 >> > > > Lucene.Net.Tests.dll: >> > > > >> > Lucene.Net.Index.TestTermVectorsWriter.TestEndOffsetPositionCharAnaly >> zer >> > > > Lucene.Net.Tests.dll: >> > > > Lucene.Net.Index.TestTermVectorsWriter. >> TestEndOffsetPositionStandard >> > > > Lucene.Net.Tests.dll: >> > > > Lucene.Net.Index.TestTermVectorsWriter. >> TestEndOffsetPositionStandardE >> > > mptyField >> > > > Lucene.Net.Tests.dll: >> > > > Lucene.Net.Index.TestTermVectorsWriter. >> TestEndOffsetPositionStandardE >> > > mptyField2 >> > > > Lucene.Net.Tests.dll: >> > > > Lucene.Net.Index.TestTermVectorsWriter. >> TestEndOffsetPositionStopFilter >> > > > Lucene.Net.Tests.dll: >> > > > Lucene.Net.Index.TestTermVectorsWriter. >> TestEndOffsetPositionWithCachi >> > > ngTokenFilter >> > > > Lucene.Net.Tests.dll: >> > > > Lucene.Net.Index.TestTermVectorsWriter. >> TestNoTermVectorAfterTermVector >> > > > Lucene.Net.Tests.dll: >> > > > Lucene.Net.Index.TestTermVectorsWriter. >> TestNoTermVectorAfterTermVecto >> > > rMerge >> > > > Lucene.Net.Tests.dll: >> > > > Lucene.Net.Index.TestTermVectorsWriter.TestTermVectorCorruption >> > > > Lucene.Net.Tests.dll: >> > > > Lucene.Net.Index.TestTermVectorsWriter.TestTermVectorCorruption2 >> > > > Lucene.Net.Tests.dll: >> > > > Lucene.Net.Index.TestTermVectorsWriter.TestTermVectorCorruption3 >> > > > Lucene.Net.Tests.dll: Lucene.Net.Index.TestTermsEnum.Test >> > > > Lucene.Net.Tests.dll: Lucene.Net.Index.TestTermsEnum.TestEasy >> > > > Lucene.Net.Tests.dll: Lucene.Net.Index.TestTermsEnum. >> TestIntersectBasic >> > > > Lucene.Net.Tests.dll: >> > > > Lucene.Net.Index.TestTermsEnum.TestIntersectEmptyString >> > > > Lucene.Net.Tests.dll: >> > Lucene.Net.Index.TestTermsEnum.TestIntersectRandom >> > > > Lucene.Net.Tests.dll: Lucene.Net.Index.TestTermsEnum. >> > > TestIntersectStartTerm >> > > > Lucene.Net.Tests.dll: Lucene.Net.Index.TestTermsEnum.TestZeroTerms >> > > > Lucene.Net.Tests.dll: >> > > > Lucene.Net.Index.TestTermsEnum2.TestFiniteVersusInfinite >> > > > Lucene.Net.Tests.dll: Lucene.Net.Index.TestTermsEnum2.TestIntersect >> > > > Lucene.Net.Tests.dll: Lucene.Net.Index.TestTermsEnum2.TestSeeking >> > > > Lucene.Net.Tests.dll: Lucene.Net.Index.TestTermsEnum2. >> > > TestSeekingAndNexting >> > > > Lucene.Net.Tests.dll: >> > > > Lucene.Net.Index.TestTieredMergePolicy.TestForceMergeDeletes >> > > > Lucene.Net.Tests.dll: >> > > > Lucene.Net.Index.TestTieredMergePolicy. >> TestForceMergeDeletesMaxSegSize >> > > > Lucene.Net.Tests.dll: >> > > > Lucene.Net.Index.TestTieredMergePolicy.TestIndexWriterDirtSimple >> > > > Lucene.Net.Tests.dll: >> > > > Lucene.Net.Index.TestTieredMergePolicy.TestPartialMerge >> > > > Lucene.Net.Tests.dll: >> > > > Lucene.Net.Index.TestTransactionRollback.TestRepeatedRollBacks >> > > > Lucene.Net.Tests.dll: >> > > > Lucene.Net.Index.TestTransactionRollback.TestRollbackDeletionPolicy >> > > > Lucene.Net.Tests.dll: >> > Lucene.Net.Index.TestTryDelete.TestDeleteDocuments >> > > > Lucene.Net.Tests.dll: Lucene.Net.Index.TestTryDelete. >> > > TestTryDeleteDocument >> > > > Lucene.Net.Tests.dll: >> > > > Lucene.Net.Index.TestTryDelete.TestTryDeleteDocumentCloseAndReopen >> > > > Lucene.Net.Tests.dll: Lucene.Net.Search.BaseTestRangeFilter >> > > > Lucene.Net.Tests.dll: Lucene.Net.Search. >> FuzzyTermOnShortTermsTest.Test >> > > > >> > > > Other failed tests (408 tests, alphabetically ordered, only first >> 100 >> > > > shown) >> > > > ================================================================== >> > > > Changes included (5 changes) >> > > > ==================================================== >> > > > Change 971b6a3201bf21732ba2c1e56e9e368212e72787 by itamar (0 file): >> > > > Merge remote-tracking branch 'laimis/unicode_issues' >> > > > >> > > > >> > > > Change 645b21d198523f984c71da307beab445285dd879 by laimis (2 >> files): >> > > > fixes for handling surrogate chars properly >> > > > >> > > > >> > > > Change 644f10169185efe27b49c11b0a4bbff303005380 by itamar (0 file): >> > > > Merge remote-tracking branch 'laimis/dictionary_fixes' >> > > > >> > > > >> > > > Change 80e1f9226bcd026abd747de702f85721173cc36d by laimis (1 file): >> > > > make sure to use offset / length when comparing uft8 buffer >> > > > >> > > > >> > > > Change 0a03242e5f104c55e11a632ea8307e47d05bd0d4 by laimis (2 >> files): >> > > > use GetTryValue for dictionary lookups >> > > > >> > > > >> > > > see more information about changed files: >> > > > >> > http://teamcity.codebetter.com/viewLog.html?tab= >> buildChangesDiv&buildId= >> > > 177083&buildTypeId=LuceneNet_Core >> > > > >> > > > >> > > > ============================================================ >> > > ================ >> > > > Configure email notifications: >> > > > >> > http://teamcity.codebetter.com/profile.html?init=1&tab= >> userNotifications >> > > > >> > > >> > >> >
