I committed a fix. Maybe I should just scrub these mega-long terms out of the big test line docs file ... but I sort of like that it's there.
Mike McCandless http://blog.mikemccandless.com On Fri, Mar 7, 2014 at 11:07 PM, Apache Jenkins Server <[email protected]> wrote: > Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-4.x/532/ > > 1 tests failed. > REGRESSION: org.apache.lucene.index.TestRollingUpdates.testRollingUpdates > > Error Message: > Document contains at least one immense term in field="body" (whose UTF8 > encoding is longer than the max length 32766), all of which were skipped. > Please correct the analyzer to not produce such terms. The prefix of the > first immense term is: '[7d 7d 7b 7b 7b 7b 7b 73 75 62 73 74 63 7c 7d 7d 7d > 7b 7b 7b 31 7d 7d 7d 7c 7b 7b 7b 70 31]...' > > Stack Trace: > java.lang.IllegalArgumentException: Document contains at least one immense > term in field="body" (whose UTF8 encoding is longer than the max length > 32766), all of which were skipped. Please correct the analyzer to not > produce such terms. The prefix of the first immense term is: '[7d 7d 7b 7b > 7b 7b 7b 73 75 62 73 74 63 7c 7d 7d 7d 7b 7b 7b 31 7d 7d 7d 7c 7b 7b 7b 70 > 31]...' > at > __randomizedtesting.SeedInfo.seed([A791C0FD6450F4AB:296AC184D7CE5160]:0) > at > org.apache.lucene.index.DocInverterPerField.processFields(DocInverterPerField.java:198) > at > org.apache.lucene.index.DocFieldProcessor.processDocument(DocFieldProcessor.java:248) > at > org.apache.lucene.index.DocumentsWriterPerThread.updateDocument(DocumentsWriterPerThread.java:253) > at > org.apache.lucene.index.DocumentsWriter.updateDocument(DocumentsWriter.java:453) > at > org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1530) > at > org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1200) > at > org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1181) > at > org.apache.lucene.index.TestRollingUpdates.testRollingUpdates(TestRollingUpdates.java:99) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:616) > at > com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559) > at > com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79) > at > com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737) > at > com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773) > at > com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787) > at > org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50) > at > org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51) > at > org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46) > at > com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55) > at > org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49) > at > org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70) > at > org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48) > at > com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) > at > com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358) > at > com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782) > at > com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442) > at > com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746) > at > com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648) > at > com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682) > at > com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693) > at > org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46) > at > org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42) > at > com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55) > at > com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39) > at > com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39) > at > com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) > at > org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43) > at > org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48) > at > org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70) > at > org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55) > at > com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) > at > com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358) > at java.lang.Thread.run(Thread.java:679) > > > > > Build Log: > [...truncated 1242 lines...] > [junit4] Suite: org.apache.lucene.index.TestRollingUpdates > [junit4] 2> NOTE: download the large Jenkins line-docs file by running > 'ant get-jenkins-line-docs' in the lucene directory. > [junit4] 2> NOTE: reproduce with: ant test > -Dtestcase=TestRollingUpdates -Dtests.method=testRollingUpdates > -Dtests.seed=A791C0FD6450F4AB -Dtests.multiplier=2 -Dtests.nightly=true > -Dtests.slow=true > -Dtests.linedocsfile=/home/hudson/lucene-data/enwiki.random.lines.txt > -Dtests.locale=et_EE -Dtests.timezone=America/Shiprock > -Dtests.file.encoding=UTF-8 > [junit4] ERROR 0.82s J1 | TestRollingUpdates.testRollingUpdates <<< > [junit4] > Throwable #1: java.lang.IllegalArgumentException: Document > contains at least one immense term in field="body" (whose UTF8 encoding is > longer than the max length 32766), all of which were skipped. Please correct > the analyzer to not produce such terms. The prefix of the first immense term > is: '[7d 7d 7b 7b 7b 7b 7b 73 75 62 73 74 63 7c 7d 7d 7d 7b 7b 7b 31 7d 7d 7d > 7c 7b 7b 7b 70 31]...' > [junit4] > at > __randomizedtesting.SeedInfo.seed([A791C0FD6450F4AB:296AC184D7CE5160]:0) > [junit4] > at > org.apache.lucene.index.DocInverterPerField.processFields(DocInverterPerField.java:198) > [junit4] > at > org.apache.lucene.index.DocFieldProcessor.processDocument(DocFieldProcessor.java:248) > [junit4] > at > org.apache.lucene.index.DocumentsWriterPerThread.updateDocument(DocumentsWriterPerThread.java:253) > [junit4] > at > org.apache.lucene.index.DocumentsWriter.updateDocument(DocumentsWriter.java:453) > [junit4] > at > org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1530) > [junit4] > at > org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1200) > [junit4] > at > org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1181) > [junit4] > at > org.apache.lucene.index.TestRollingUpdates.testRollingUpdates(TestRollingUpdates.java:99) > [junit4] > at java.lang.Thread.run(Thread.java:679) > [junit4] 2> NOTE: test params are: codec=Lucene46: > {id=PostingsFormat(name=MockRandom)}, docValues:{}, > sim=RandomSimilarityProvider(queryNorm=true,coord=no): {docid=DFR GZ(0.3), > body=DFR I(F)B1, titleTokenized=DFR G3(800.0)}, locale=et_EE, > timezone=America/Shiprock > [junit4] 2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Sun Microsystems Inc. > 1.6.0_32 (64-bit)/cpus=16,threads=1,free=134931024,total=482869248 > [junit4] 2> NOTE: All tests run in this JVM: [TestTerm, > TestElevationComparator, TestCodecHoldsOpenFiles, > TestParallelCompositeReader, TestBagOfPostings, TestBlockPostingsFormat2, > TestMinimize, TestBlockPostingsFormat, TestTermVectorsFormat, > TestWeakIdentityMap, TestSpans, TestOmitNorms, Before3, Before3, > TestFilterDirectory, TestSmallFloat, TestMultiDocValues, TestSimilarityBase, > TestLongBitSet, TestPayloadNearQuery, Test4GBStoredFields, > TestNamedSPILoader, TestIndexWriterMergePolicy, TestMultiThreadTermVectors, > Nested, TestThreadedForceMerge, TestTotalHitCountCollector, > TestTermRangeFilter, TestIOUtils, TestEliasFanoDocIdSet, > TestBooleanQueryVisitSubscorers, TestDoubleBarrelLRUCache, TestMathUtil, > TestFSTs, TestTieredMergePolicy, TestBinaryTerms, TestBinaryDocument, > TestWindowsMMap, TestMockDirectoryWrapper, TestSpanSearchEquivalence, > TestNGramPhraseQuery, TestHugeRamFile, TestPayloadExplanations, > TestLucene45DocValuesFormat, TestRamUsageEstimatorOnWildAnimals, Test2BDocs, > TestMatchAllDocsQuery, TestDateFilter, TestIdentityHashSet, > TestDocValuesIndexing, MultiCollectorTest, TestDuelingCodecs, > TestVersionComparator, TestTermRangeQuery, TestSpanExplanations, TestBasics, > TestPrefixQuery, TestSizeBoundedForceMerge, TestBackwardsCompatibility, > TestVersion, Nested1, TestAutomatonQuery, TestEliasFanoSequence, Nested, > TestConsistentFieldNumbers, TestMinShouldMatch2, TestPositionIncrement, > TestCachingTokenFilter, TestSimpleSearchEquivalence, Nested, > TestFileSwitchDirectory, TestMergedIterator, TestCodecs, TestIntBlockPool, > TestAddIndexes, TestPerFieldPostingsFormat2, TestDoc, TestNot, > TestFieldValueFilter, TestAttributeSource, TestFlex, TestTermdocPerf, > TestBooleanQuery, TestTermVectorsReader, TestPrefixCodedTerms, TestToken, > TestIndexableBinaryStringTools, TestIndexWriterExceptions, > TestFilterAtomicReader, TestPayloadSpans, TestPerFieldPostingsFormat, > TestBooleanOr, TestUnicodeUtil, TestConjunctions, TestAtomicUpdate, > TestQueryWrapperFilter, TestLazyProxSkipping, TestPerFieldDocValuesFormat, > TestDocValuesFormat, TestCompressingTermVectorsFormat, > TestLucene40TermVectorsFormat, TestBytesStore, TestPackedInts, > TestIndexWriterWithThreads, TestNumericRangeQuery32, TestGraphTokenizers, > TestMultiMMap, TestDeletionPolicy, TestFlushByRamOrCountsPolicy, > TestSloppyPhraseQuery, TestIndexWriterDelete, TestBoolean2, > TestStressAdvance, TestNorms, TestIndexWriterCommit, TestHighCompressionMode, > TestOpenBitSet, TestDocumentsWriterStallControl, TestNeverDelete, > TestCompoundFile, TestLongPostings, TestRollingUpdates] > [junit4] Completed on J1 in 4.32s, 2 tests, 1 error <<< FAILURES! > > [...truncated 555 lines...] > BUILD FAILED > /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/build.xml:478: > The following error occurred while executing this line: > /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/build.xml:451: > The following error occurred while executing this line: > /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/build.xml:39: > The following error occurred while executing this line: > /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/extra-targets.xml:37: > The following error occurred while executing this line: > /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/lucene/build.xml:49: > The following error occurred while executing this line: > /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/lucene/common-build.xml:1278: > The following error occurred while executing this line: > /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/lucene/common-build.xml:911: > There were test failures: 386 suites, 2794 tests, 1 error, 86 ignored (73 > assumptions) > > Total time: 77 minutes 34 seconds > Build step 'Invoke Ant' marked build as failure > Archiving artifacts > Recording test results > Email was triggered for: Failure > Sending email for trigger: Failure > > > > > --------------------------------------------------------------------- > To unsubscribe, e-mail: [email protected] > For additional commands, e-mail: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
