Not annotating, but here are the failures in each of the last 4 weeks: Failures in the last 4 reports.. Report Pct runs fails test 0123 0.3 1427 8 AutoScalingHandlerTest.testReadApi 0123 6.2 1495 66 BasicDistributedZkTest.test 0123 0.3 1446 8 HttpPartitionTest.test 0123 0.5 1444 11 HttpPartitionWithTlogReplicasTest.test 0123 0.8 1469 13 LeaderFailoverAfterPartitionTest.test 0123 0.6 1438 15 LegacyCloudClusterPropTest.testCreateCollectionSwitchLegacyCloud 0123 0.8 1442 10 RollingRestartTest.test 0123 0.3 1451 5 ShardSplitTest.testSplitMixedReplicaTypesLink 0123 1.6 1440 10 SyncSliceTest.test 0123 1.7 1454 18 SystemCollectionCompatTest.testBackCompat 0123 12.5 112 21 Test2BPostings.test // Java bug, don’t annotate 0123 0.3 1208 4 TestDelegationWithHadoopAuth.testDelegationTokenRenew 0123 0.3 1491 5 TestLucene80DocValuesFormat.testSparseDocValuesVsStoredFields 0123 0.3 1435 7 TestQueryingOnDownCollection.testQueryToDownCollectionShouldFailFast 0123 1.6 1495 26 TestStressLiveNodes.testStress
Full report attached.
DO NOT ENABLE LIST: MoveReplicaHDFSTest.testFailedMove MoveReplicaHDFSTest.testNormalFailedMove TestControlledRealTimeReopenThread.testCRTReopen TestICUNormalizer2CharFilter.testRandomStrings TestICUTokenizerCJK TestImpersonationWithHadoopAuth.testForwarding TestLTRReRankingPipeline.testDifferentTopN TestRandomChains DO NOT ANNOTATE LIST CdcrBidirectionalTest.testBiDir IndexSizeTriggerTest.testMergeIntegration IndexSizeTriggerTest.testMixedBounds IndexSizeTriggerTest.testSplitIntegration IndexSizeTriggerTest.testTrigger InfixSuggestersTest.testShutdownDuringBuild ShardSplitTest.test ShardSplitTest.testSplitMixedReplicaTypes ShardSplitTest.testSplitWithChaosMonkey Test2BPostings.test TestLatLonShapeQueries.testRandomBig TestPackedInts.testPackedLongValues TestRandomChains.testRandomChainsWithLargeStrings TestTriggerIntegration.testSearchRate Processing file (History bit 3): HOSS-2020-01-27.csv Processing file (History bit 2): HOSS-2020-01-20.csv Processing file (History bit 1): HOSS-2020-01-13.csv Processing file (History bit 0): HOSS-2020-01-06.csv Number of AwaitsFix: 41 Number of BadApples: 6 Raw fail count by week totals, most recent week first (corresponds to bits): Week: 0 had 125 failures Week: 1 had 191 failures Week: 2 had 118 failures Week: 3 had 298 failures **Annotated tests that didn't fail in the last 4 weeks. **Tests removed from the next two lists because they were specified in 'doNotEnable' in the properties file MoveReplicaHDFSTest.testNormalFailedMove **Annotations will be removed from the following tests because they haven't failed in the last 4 rollups. **Methods: 2 MultiThreadedOCPTest.test SolrZkClientTest.testSimpleUpdateACLs ********Failures in Hoss' reports for the last 4 rollups. There were 576 unannotated tests that failed in Hoss' rollups. Ordered by the date I downloaded the rollup file, newest->oldest. See above for the dates the files were collected These tests were NOT BadApple'd or AwaitsFix'd All tests that failed 4 weeks running will be BadApple'd unless there are objections Failures in the last 4 reports.. Report Pct runs fails test 0123 0.3 1427 8 AutoScalingHandlerTest.testReadApi 0123 6.2 1495 66 BasicDistributedZkTest.test 0123 0.3 1446 8 HttpPartitionTest.test 0123 0.5 1444 11 HttpPartitionWithTlogReplicasTest.test 0123 0.8 1469 13 LeaderFailoverAfterPartitionTest.test 0123 0.6 1438 15 LegacyCloudClusterPropTest.testCreateCollectionSwitchLegacyCloud 0123 0.8 1442 10 RollingRestartTest.test 0123 0.3 1451 5 ShardSplitTest.testSplitMixedReplicaTypesLink 0123 1.6 1440 10 SyncSliceTest.test 0123 1.7 1454 18 SystemCollectionCompatTest.testBackCompat 0123 12.5 112 21 Test2BPostings.test 0123 0.3 1208 4 TestDelegationWithHadoopAuth.testDelegationTokenRenew 0123 0.3 1491 5 TestLucene80DocValuesFormat.testSparseDocValuesVsStoredFields 0123 0.3 1435 7 TestQueryingOnDownCollection.testQueryToDownCollectionShouldFailFast 0123 1.6 1495 26 TestStressLiveNodes.testStress ************ Will BadApple all tests above this line except ones listed at the top************** 012 20.6 93 18 HdfsSyncSliceTest.test 012 0.3 1114 4 TestCryptoKeys.test 01 3 3.7 77 4 TestDuelingCodecsAtNight.testBigEquals 01 3 1.4 1086 9 TestPackages.testPluginLoading 01 3 22.6 116 43 TestXYMultiPolygonShapeQueries.testRandomBig 01 0.3 728 2 CloudSolrClientTest.testRetryUpdatesWhenClusterStateIsStale 01 0.3 758 2 ExecutePlanActionTest.testTaskTimeout 01 5.0 40 2 HdfsWriteToMultipleCollectionsTest.test 01 0.3 752 2 SearchRateTriggerTest.testWaitForElapsed 01 4.0 45 2 ShardSplitTest.testSplitWithChaosMonkey 01 0.6 748 3 TestInPlaceUpdatesDistrib.test 01 0.8 788 5 TestOfflineSorter.testThreadSafety 01 0.3 749 2 TestSolrCLIRunExample.testInteractiveSolrCloudExampleWithAutoScalingPolicy 01 0.3 752 2 TriggerCooldownIntegrationTest.testCooldown 0 23 0.3 1033 5 AutoScalingHandlerTest.testSuggestionsWithPayload 0 2 19.4 61 10 HdfsBasicDistributedZkTest.test 0 2 3.7 51 2 TestDuelingCodecsAtNight.testEquals 0 2 1.0 465 2 TestLucene80DocValuesFormat.testSparseSortedNumericBlocksOfVariousBitsPerValue 0 2 0.3 708 2 TestPullReplicaErrorHandling.testPullReplicaDisconnectsFromZooKeeper 0 2 1.1 713 5 TestRandomDVFaceting.testRandomFaceting 0 3 0.5 685 3 BasicDistributedZk2Test.test 0 3 0.3 680 2 CollectionsAPISolrJTest.testColStatus 0 3 1.0 435 2 TestLucene80DocValuesFormat.testTermsEnumLongSharedPrefixes 0 3 0.3 676 2 TestRecovery.testExistOldBufferLog 0 0.3 346 1 CloudHttp2SolrClientTest.testRetryUpdatesWhenClusterStateIsStale 0 0.3 350 1 CloudSolrClientTest.testParallelUpdateQTime 0 0.3 362 1 ConnectionManagerTest.testLikelyExpired 0 0.8 362 3 ConnectionManagerTest.testReconnectWhenZkDisappeared 0 0.3 360 1 DeleteReplicaTest.deleteReplicaAndVerifyDirectoryCleanup 0 0.4 272 1 DistributedUpdateProcessorTest.testVersionDelete 0 0.3 347 1 MathExpressionTest.testGeometricDistribution 0 0.3 357 1 MetricTriggerIntegrationTest.testMetricTrigger 0 0.3 362 1 NodeLostTriggerIntegrationTest.testNodeLostTrigger 0 0.3 362 1 NodeMarkersRegistrationTest.testNodeMarkersRegistration 0 0.4 268 1 OverseerTest.testReplay 0 0.8 361 3 PeerSyncReplicationTest.test 0 0.3 358 1 PeerSyncWithLeaderTest.test 0 0.3 358 1 ReplaceNodeTest.test 0 0.8 378 3 ShardSplitTest.testSplitShardWithRuleLink 0 0.3 316 1 SoftAutoCommitTest.testSoftCommitWithinAndHardCommitMaxTimeMixedAdds 0 1.1 360 4 SolrCmdDistributorTest.test 0 0.3 359 1 SplitByPrefixTest.doTest 0 38.9 576 224 TestBulkSchemaConcurrent.test 0 0.3 359 1 TestCloudRecovery.leaderRecoverFromLogOnStartupTest 0 0.3 361 1 TestCloudRecovery2.test 0 0.6 360 2 TestCloudSearcherWarming.testPeersyncFailureReplicationSuccess 0 0.3 362 1 TestCollectionsAPIViaSolrCloudCluster.testStopAllStartAll 0 0.3 347 1 TestContentStreamDataSource.testCommitWithin 0 0.5 364 2 TestInPlaceUpdateWithRouteField.testUpdatingDocValuesWithRouteField 0 0.8 244 2 TestIndexWriterDelete.testUpdatesOnDiskFull 0 0.0 2141 1 TestJsonFacets.testBigger 0 1.6 367 6 TestLucene60PointsFormat.testEstimatePointCount 0 3.6 28 1 TestLucene80DocValuesFormat.testSortedSetVariableLengthManyVsStoredFields 0 0.3 367 1 TestLucene80DocValuesFormat.testSparseSortedVariableLengthVsStoredFields 0 0.3 361 1 TestPagedBytes.testDataInputOutput 0 1.1 361 4 TestPointFields.testFloatPointStats 0 1.7 361 6 TestPointFields.testIntPointFieldMultiValuedRangeFacet 0 0.3 364 1 TestPointVectorStrategy.testCitiesIntersectsBBox 0 0.3 359 1 TestRebalanceLeaders.testRebalanceLeaders 0 0.6 360 2 TestReplicationHandler.doTestReplicateAfterCoreReload 0 0.3 362 1 TestTopDocsCollector.testRealisticConcurrentMinimumScore 0 56.2 733 412 TestZkChroot.testChrootBootstrap 0 56.0 730 409 TestZkChroot.testInitPathExists 0 56.0 730 409 TestZkChroot.testWithUploadDir 0 0.6 363 2 UnloadDistributedZkTest.test 0 58.1 597 347 ZkControllerTest.testPublishAndWaitForDownStates 123 0.3 1073 3 ChaosMonkeyNothingIsSafeTest.test 123 5.0 72 7 HdfsTlogReplayBufferedWhileIndexingTest.test 123 0.3 1083 6 LeaderElectionIntegrationTest.testSimpleSliceLeaderElection 123 0.5 1076 6 LeaderVoteWaitTimeoutTest.basicTest 123 0.9 1127 6 TestBagOfPositions.test 123 0.9 1134 10 TestBagOfPostings.test 123 8.3 736 40 TestFuzzyQuery.testErrorMessage 123 0.2 1132 3 TestSearcherManager.testConcurrentIndexCloseSearchAndRefresh 12 0.3 753 2 CollectionsAPISolrJTest.testCreateCollWithDefaultClusterPropertiesOldFormat 12 12.5 27 2 DimensionalRoutedAliasUpdateProcessorTest.testCatTime 12 12.5 27 2 DimensionalRoutedAliasUpdateProcessorTest.testTimeCat 12 0.3 750 2 IndexSizeTriggerMixedBoundsTest.testMixedBounds 12 0.5 758 3 MetricsHistoryWithAuthIntegrationTest.testValuesAreCollected 12 0.5 748 3 ShardSplitTest.testSplitShardWithRule 12 0.8 744 4 TestCloudSchemaless.test 12 0.3 688 2 TestMiniSolrCloudClusterSSL.testSslAndClientAuth 12 0.2 762 2 TestSimpleTextTermVectorsFormat.testRamBytesUsed 12 3.2 772 19 TestXYMultiPolygonShapeQueries.testRandomMedium 1 3 0.3 710 2 CustomHighlightComponentTest.test 1 3 0.2 730 3 OverseerRolesTest.testOverseerRole 1 3 0.3 716 2 TestDistributedSearch.test 1 3 0.3 713 2 TestLockTree.testLocks 1 3 0.3 713 2 TestMiniSolrCloudClusterSSL.testNoSsl 1 3 0.3 712 2 TestNamedUpdateProcessors.test 1 3 0.3 716 2 TestReplicaProperties.test 1 3 0.3 711 2 TestSegmentSorting.testAtomicUpdateOfSegmentSortField 1 3 0.4 442 2 TestSolrCachePerf.testGetPutCompute 1 3 0.3 723 3 TestSolrCloudWithDelegationTokens.testDelegationTokenRenew 1 0.3 394 1 ActionThrottleTest.testAZeroNanoTimeReturnInWait 1 0.3 394 1 AutoScalingHandlerTest.testConcurrentUpdates 1 0.3 392 1 ChaosMonkeySafeLeaderWithPullReplicasTest.test 1 0.3 391 1 CollectionsAPIAsyncDistributedZkTest.testAsyncRequests 1 0.3 398 1 CollectionsAPISolrJTest.testCreateWithDefaultConfigSet 1 0.3 394 1 ComputePlanActionTest.testNodeAdded 1 0.3 393 1 DeleteNodeTest.test 1 27.2 290 79 FuzzySearchTest.testTooComplex 1 4.8 21 1 HdfsChaosMonkeyNothingIsSafeTest.test 1 0.3 398 1 LeaderElectionTest.testCancelElection 1 0.3 380 1 MathExpressionTest.testZipFDistribution 1 0.3 392 1 MetricsHistoryIntegrationTest.testGet 1 0.3 398 1 MigrateRouteKeyTest.multipleShardMigrateTest 1 0.3 392 1 MissingSegmentRecoveryTest.testLeaderRecovery 1 0.3 394 1 MoveReplicaTest.test 1 0.3 398 1 OverseerModifyCollectionTest.testModifyColl 1 0.3 395 1 ScheduledTriggerIntegrationTest.testScheduledTrigger 1 0.3 380 1 StreamDecoratorTest.testExecutorStream 1 0.2 427 1 TermInSetQueryTest.testDuel 1 0.2 431 1 TestAddIndexes.testFakeAllDeleted 1 0.2 431 1 TestAddIndexes.testNoMergeAfterCopy 1 0.5 431 2 TestAddIndexes.testWithPendingDeletes 1 0.2 427 1 TestAtomicUpdate.testAtomicUpdates 1 0.3 391 1 TestCloudNestedDocsSort.test 1 0.3 391 1 TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete 1 0.2 429 1 TestConcurrentMergeScheduler.testFlushExceptions 1 0.2 425 1 TestCrashCausesCorruptIndex.testCrashCorruptsIndexing 1 1.4 433 6 TestDemo.testDemo 1 0.7 432 3 TestDirectoryReader.testFilesOpenClose 1 0.5 393 2 TestDistributedGrouping.test 1 0.2 429 1 TestDocValuesQueries.testDuelPointRangeMultivaluedSortedSetRangeQuery 1 0.7 429 3 TestDocValuesQueries.testDuelPointRangeSortedRangeQuery 1 0.2 423 1 TestDuelingCodecs.testCrazyReaderEquals 1 0.2 423 1 TestDuelingCodecs.testEquals 1 0.2 428 1 TestField.testIndexedBinaryField 1 0.2 429 1 TestFieldValueQuery.testApproximation 1 0.2 429 1 TestFieldValueQuery.testScore 1 0.7 431 3 TestGraphTokenizers.testMockGraphTokenFilterBeforeHolesRandom 1 0.2 427 1 TestIndexFileDeleter.testVirusScannerDoesntCorruptIndex 1 0.2 428 1 TestIndexManyDocuments.test 1 0.2 422 1 TestIndexSorting.testRandom3 1 0.2 426 1 TestIndexWriterDelete.testDeleteAllNRT 1 0.2 425 1 TestIndexWriterExceptions.testRandomExceptionDuringRollback 1 0.2 430 1 TestIndexWriterWithThreads.testIOExceptionDuringWriteSegmentWithThreadsOnlyOnce 1 0.3 400 1 TestInputIterator.testTerms 1 0.3 395 1 TestLazyCores.testLazyLoad 1 0.2 426 1 TestLucene50StoredFieldsFormat.testMultiClose 1 0.2 426 1 TestLucene60PointsFormat.testMultiClose 1 0.2 426 1 TestLucene60PointsFormat.testWithExceptions 1 0.6 181 1 TestLucene70DocValuesFormat.testTermsEnumVariableWidth 1 0.2 428 1 TestLucene70SegmentInfoFormat.testRandom 1 0.2 424 1 TestLucene80DocValuesFormat.testRandomAdvanceNumeric 1 0.2 424 1 TestLucene80NormsFormatMergeInstance.testUndeadNorms 1 0.5 405 2 TestLucene84PostingsFormat.testDisableFSTOffHeap 1 0.2 427 1 TestLucene84PostingsFormat.testDocsAndFreqs 1 0.2 427 1 TestLucene84PostingsFormat.testDocsAndFreqsAndPositionsAndOffsets 1 0.2 427 1 TestLucene84PostingsFormat.testDocsAndFreqsAndPositionsAndOffsetsAndPayloads 1 0.5 427 2 TestLucene84PostingsFormat.testDocsAndFreqsAndPositionsAndPayloads 1 0.5 427 2 TestLucene84PostingsFormat.testDocsOnly 1 0.5 405 2 TestLucene84PostingsFormat.testFstOffHeap 1 0.2 427 1 TestLucene84PostingsFormat.testPostingsEnumReuse 1 0.5 427 2 TestLucene84PostingsFormat.testRandom 1 0.2 425 1 TestNRTThreads.testNRTThreads 1 0.2 429 1 TestNeverDelete.testIndexing 1 0.2 427 1 TestOmitNorms.testOmitNormsCombos 1 0.2 425 1 TestPerFieldDocValuesFormat.testMultiClose 1 0.2 425 1 TestPerFieldDocValuesFormat.testRandomSortedBytes 1 0.5 425 2 TestPerFieldDocValuesFormat.testSortedFixedLengthVsStoredFields 1 0.2 425 1 TestPerFieldDocValuesFormat.testSortedSetFixedLengthFewUniqueSetsVsStoredFields 1 0.2 425 1 TestPerFieldDocValuesFormat.testSortedSetFixedLengthManyValuesPerDocVsStoredFields 1 0.2 425 1 TestPerFieldDocValuesFormat.testSortedSetFixedLengthSingleValuedVsStoredFields 1 0.2 425 1 TestPerFieldDocValuesFormat.testSortedSetFixedLengthVsStoredFields 1 0.5 425 2 TestPerFieldDocValuesFormat.testSortedSetVariableLengthManyValuesPerDocVsStoredFields 1 0.2 425 1 TestPerFieldDocValuesFormat.testSortedSetVariableLengthSingleValuedVsStoredFields 1 0.5 425 2 TestPerFieldDocValuesFormat.testSortedVariableLengthVsStoredFields 1 0.2 425 1 TestPerFieldDocValuesFormat.testSparseSortedFixedLengthVsStoredFields 1 0.2 421 1 TestPerFieldPostingsFormat.testDocsAndFreqsAndPositionsAndOffsetsAndPayloads 1 0.2 421 1 TestPerFieldPostingsFormat.testDocsOnly 1 0.2 421 1 TestPerFieldPostingsFormat.testMultiClose 1 0.2 421 1 TestPerFieldPostingsFormat.testRandom 1 2.7 406 11 TestPointFields.testDoublePointStats 1 1.9 428 8 TestReadOnlyIndex.testReadOnlyIndex 1 0.5 428 2 TestShardSearching.testSimple 1 0.3 398 1 TestSimScenario.testAutoAddReplicas 1 0.3 398 1 TestSimScenario.testSuggestions 1 0.3 393 1 TestSkipOverseerOperations.testSkipDownOperations 1 0.8 393 3 TestSolrConfigHandlerCloud.test 1 0.2 428 1 TestStressIndexing.testStressIndexAndSearching 1 0.3 396 1 TestTlogReplica.testRemoveLeader 1 0.3 394 1 TestWithCollection.testAddReplicaSimple 1 0.3 395 1 TriggerSetPropertiesIntegrationTest.testSetProperties 23 0.6 677 4 CollectionsAPISolrJTest.testCreateCollWithDefaultClusterPropertiesNewFormat 23 0.3 671 2 CreateRoutedAliasTest.testV2 23 32.4 63 12 HdfsBasicDistributedZk2Test.test 23 0.3 603 2 OverseerTest.testShardLeaderChange 23 0.3 672 2 PingRequestHandlerTest.testPingInClusterWithNoHealthCheck 23 0.3 671 2 SchemaApiFailureTest.testAddTheSameFieldTwice 23 7.4 58 8 StressHdfsTest.test 23 0.3 669 2 TestDynamicFieldNamesIndexCorrectly.test 23 0.3 702 2 TestLucene80DocValuesFormat.testSortedNumericBlocksOfVariousBitsPerValue 23 0.6 676 3 TestRestoreCore.testFailedRestore 2 0.3 351 1 CloudMLTQParserTest.testMLTQParser 2 0.3 352 1 ComputePlanActionTest.testNodeLostTriggerWithDeleteNodePreferredOp 2 0.3 351 1 CreateRoutedAliasTest.testCollectionNamesMustBeAbsent 2 0.3 351 1 CreateRoutedAliasTest.testTimeStampWithMsFails 2 0.3 351 1 CreateRoutedAliasTest.testTimezoneAbsoluteDate 2 0.3 351 1 CustomCollectionTest.testCustomCollectionsAPI 2 0.3 351 1 CustomCollectionTest.testRouteFieldForHashRouter 2 0.3 351 1 CustomCollectionTest.testRouteFieldForImplicitRouter 2 0.3 352 1 DeleteShardTest.test 2 1.1 351 4 DocValuesTest.testFloatAndDoubleRangeQueryRandom 2 15.0 419 63 EmbeddedSolrNoSerializeTest.testAssertTagStreamingWithSolrTaggerRequest 2 15.0 419 63 EmbeddedSolrNoSerializeTest.testSearch 2 15.0 419 63 EmbeddedSolrNoSerializeTest.testTag 2 0.3 335 1 FullSolrCloudDistribCmdsTest.testBasicUpdates 2 0.3 335 1 FullSolrCloudDistribCmdsTest.testConcurrentIndexing 2 0.3 335 1 FullSolrCloudDistribCmdsTest.testIndexQueryDeleteHierarchical 2 0.3 335 1 FullSolrCloudDistribCmdsTest.testIndexingBatchPerRequestWithHttpSolrClient 2 0.3 335 1 FullSolrCloudDistribCmdsTest.testIndexingOneDocPerRequestWithHttpSolrClient 2 15.4 4173 643 RandomizedTaggerTest.test 2 0.3 356 1 ReindexCollectionTest.testFailure 2 0.3 356 1 ReindexCollectionTest.testSameTargetReindexing 2 0.3 350 1 SearchHandlerTest.testRequireZkConnected 2 0.3 350 1 ShardRoutingTest.test 2 0.3 350 1 ShardSplitTest.testSplitMixedReplicaTypes 2 0.3 350 1 ShardSplitTest.testSplitStaticIndexReplicationLink 2 0.9 352 3 SolrCloudExampleTest.testLoadDocsIntoGettingStartedCollection 2 16.1 416 67 Tagger2Test.testLongestDominantRight 2 15.9 415 66 Tagger2Test.testMultibyteChar 2 16.1 416 67 Tagger2Test.testWDF 2 16.4 420 69 TaggerTest.testFormat 2 16.4 420 69 TaggerTest.testFormatMatchText 2 16.4 420 69 TaggerTest.testMultipleFilterQueries 2 16.4 420 69 TaggerTest.testSubTags 2 16.4 420 69 TaggerTest.testWholeMatching 2 14.9 410 61 TaggingAttributeTest.testTaggingAttribute 2 0.3 352 1 TestConfigReload.test 2 3.0 363 11 TestDistributedStatsComponentCardinality.test 2 0.4 231 1 TestExactStatsCacheCloud.testBasicStats 2 0.9 351 3 TestJaegerConfigurator.testInjected 2 0.3 347 1 TestLBHttpSolrClient.testSimple 2 0.3 370 1 TestLucene50TermVectorsFormat.testRamBytesUsed 2 0.3 367 1 TestLucene80DocValuesFormat.testNumericFieldJumpTables 2 0.3 367 1 TestLucene80DocValuesFormat.testSparseBinaryFixedLengthVsStoredFields 2 3.0 368 11 TestPhraseWildcardQuery.testExplain 2 0.3 353 1 TestRecovery.stressLogReplay 2 0.3 353 1 TestRequestForwarding.testMultiCollectionQuery 2 15.8 419 66 XmlInterpolationTest.test 2 7.9 419 33 XmlInterpolationTest.testInvalidXml 3 0.3 320 1 AddReplicaTest.testAddMultipleReplicas 3 0.6 327 2 AnalysisImplTest.testGetPresetAnalyzerTypes 3 0.3 323 1 AssignBackwardCompatibilityTest.test 3 0.3 321 1 AutoscalingHistoryHandlerTest.testHistory 3 3.6 329 12 BasicAuthIntegrationTest.testBasicAuth 3 0.3 318 1 CollectionsAPIDistributedZkTest.testCreateNodeSet 3 0.3 298 1 CommitsImplTest.testGetCommit 3 0.3 298 1 CommitsImplTest.testGetCommit_generation_notfound 3 0.3 298 1 CommitsImplTest.testGetFiles 3 0.3 298 1 CommitsImplTest.testGetFiles_generation_notfound 3 0.3 298 1 CommitsImplTest.testGetSegmentAttributes 3 0.3 298 1 CommitsImplTest.testGetSegmentAttributes_generation_notfound 3 0.3 298 1 CommitsImplTest.testGetSegmentAttributes_invalid_name 3 0.3 298 1 CommitsImplTest.testGetSegmentDiagnostics 3 0.3 298 1 CommitsImplTest.testGetSegmentDiagnostics_generation_notfound 3 0.3 298 1 CommitsImplTest.testGetSegmentDiagnostics_invalid_name 3 0.3 298 1 CommitsImplTest.testGetSegments 3 0.3 298 1 CommitsImplTest.testGetSegments_generation_notfound 3 0.3 298 1 CommitsImplTest.testListCommits 3 0.3 298 1 CommitsImplTest.testSegmentCodec 3 0.3 298 1 CommitsImplTest.testSegmentCodec_generation_notfound 3 0.3 298 1 CommitsImplTest.testSegmentCodec_invalid_name 3 0.3 334 1 ConfusionMatrixGeneratorTest.testGetConfusionMatrixWithCNB 3 0.3 334 1 ConfusionMatrixGeneratorTest.testGetConfusionMatrixWithSNB 3 0.3 321 1 DistributedIntervalFacetingTest.test 3 0.3 318 1 DistributedSpellCheckComponentTest.test 3 0.6 327 2 DocValuesAdapterTest.testGetDocValues_binary 3 0.6 327 2 DocValuesAdapterTest.testGetDocValues_notAvailable 3 0.6 327 2 DocValuesAdapterTest.testGetDocValues_numeric 3 0.6 327 2 DocValuesAdapterTest.testGetDocValues_sorted 3 0.6 327 2 DocValuesAdapterTest.testGetDocValues_sorted_numeric 3 0.6 327 2 DocValuesAdapterTest.testGetDocValues_sorted_set 3 0.7 303 2 DocumentsImplTest.testClose 3 0.7 303 2 DocumentsImplTest.testFirstTerm 3 0.7 303 2 DocumentsImplTest.testFirstTermDoc 3 0.7 303 2 DocumentsImplTest.testFirstTermDoc_unPositioned 3 0.7 303 2 DocumentsImplTest.testFirstTerm_notAvailable 3 0.7 303 2 DocumentsImplTest.testGetDocumentFields 3 0.7 303 2 DocumentsImplTest.testGetMaxDoc 3 0.7 303 2 DocumentsImplTest.testIsLive 3 0.7 303 2 DocumentsImplTest.testNextTerm 3 0.7 303 2 DocumentsImplTest.testNextTermDoc 3 0.7 303 2 DocumentsImplTest.testNextTermDoc_unPositioned 3 0.7 303 2 DocumentsImplTest.testNextTerm_unPositioned 3 0.7 303 2 DocumentsImplTest.testSeekTerm 3 0.7 303 2 DocumentsImplTest.testSeekTerm_unPositioned 3 0.7 303 2 DocumentsImplTest.testTermPositions 3 0.7 303 2 DocumentsImplTest.testTermPositions_noPositions 3 0.7 303 2 DocumentsImplTest.testTermPositions_unPositioned 3 3.6 28 1 HdfsRestartWhileUpdatingTest.test 3 0.3 320 1 HttpPartitionOnCommitTest.test 3 0.3 322 1 IndexSizeTriggerTest.testMergeIntegration 3 0.3 326 1 LeaderVoteWaitTimeoutTest.testMostInSyncReplicasCanWinElection 3 0.3 313 1 MergeIndexesEmbeddedTest.testMergeIndexesByCoreName 3 0.3 313 1 MergeIndexesEmbeddedTest.testMergeIndexesByDirName 3 0.3 313 1 MergeIndexesEmbeddedTest.testMergeMultipleRequest 3 0.6 327 2 OverviewImplTest.testClose 3 0.6 327 2 OverviewImplTest.testGetCommitDescription 3 0.6 327 2 OverviewImplTest.testGetCommitUserData 3 0.6 327 2 OverviewImplTest.testGetDirImpl 3 0.6 327 2 OverviewImplTest.testGetFieldNames 3 0.6 327 2 OverviewImplTest.testGetIndexFormat 3 0.6 327 2 OverviewImplTest.testGetIndexPath 3 0.6 327 2 OverviewImplTest.testGetIndexVersion 3 0.6 327 2 OverviewImplTest.testGetNumDeletedDocs 3 0.6 327 2 OverviewImplTest.testGetNumDocuments 3 0.6 327 2 OverviewImplTest.testGetNumFields 3 0.6 327 2 OverviewImplTest.testGetNumTerms 3 0.6 327 2 OverviewImplTest.testGetSortedTermCounts 3 0.6 327 2 OverviewImplTest.testGetTopTerms 3 0.6 327 2 OverviewImplTest.testGetTopTerms_illegal_numterms 3 0.6 327 2 OverviewImplTest.testHasDeletions 3 0.6 327 2 OverviewImplTest.testIsOptimized 3 0.3 323 1 PeerSyncTest.test 3 0.3 313 1 SchemaTest.addDynamicFieldShouldntBeCalledTwiceWithTheSameName 3 0.3 313 1 SchemaTest.addFieldShouldntBeCalledTwiceWithTheSameName 3 0.3 313 1 SchemaTest.addFieldTypeShouldntBeCalledTwiceWithTheSameName 3 0.3 313 1 SchemaTest.addFieldTypeWithAnalyzerClassAccuracy 3 0.3 313 1 SchemaTest.addFieldTypeWithSimilarityAccuracy 3 0.3 313 1 SchemaTest.copyFieldsShouldFailWhenOneOfTheFieldsDoesntExistInTheSchema 3 0.3 313 1 SchemaTest.deleteCopyFieldShouldFailWhenOneOfTheFieldsDoesntExistInTheSchema 3 0.3 313 1 SchemaTest.deletingADynamicFieldThatDoesntExistInTheSchemaShouldFail 3 0.3 313 1 SchemaTest.deletingAFieldThatDoesntExistInTheSchemaShouldFail 3 0.3 313 1 SchemaTest.deletingAFieldTypeThatDoesntExistInTheSchemaShouldFail 3 0.3 313 1 SchemaTest.testAddDynamicFieldAccuracy 3 0.3 313 1 SchemaTest.testAddFieldAccuracy 3 0.3 313 1 SchemaTest.testAddFieldTypeAccuracy 3 0.3 313 1 SchemaTest.testCopyFieldAccuracy 3 0.3 313 1 SchemaTest.testCopyFieldWithMaxCharsAccuracy 3 0.3 313 1 SchemaTest.testDeleteCopyFieldAccuracy 3 0.3 313 1 SchemaTest.testDeleteDynamicFieldAccuracy 3 0.3 313 1 SchemaTest.testDeleteFieldAccuracy 3 0.3 313 1 SchemaTest.testDeleteFieldTypeAccuracy 3 0.3 313 1 SchemaTest.testGetCopyFieldsAccuracy 3 0.3 313 1 SchemaTest.testGetDynamicFieldAccuracy 3 0.3 313 1 SchemaTest.testGetDynamicFieldsAccuracy 3 0.3 313 1 SchemaTest.testGetFieldAccuracy 3 0.3 313 1 SchemaTest.testGetFieldTypeAccuracy 3 0.3 313 1 SchemaTest.testGetFieldTypesAccuracy 3 0.3 313 1 SchemaTest.testGetFieldsAccuracy 3 0.3 313 1 SchemaTest.testGetGlobalSimilarityAccuracy 3 0.3 313 1 SchemaTest.testGetUniqueKeyAccuracy 3 0.3 313 1 SchemaTest.testMultipleUpdateRequestAccuracy 3 0.3 313 1 SchemaTest.testReplaceDynamicFieldAccuracy 3 0.3 313 1 SchemaTest.testReplaceFieldAccuracy 3 0.3 313 1 SchemaTest.testReplaceFieldTypeAccuracy 3 0.3 313 1 SchemaTest.testSchemaNameRequestAccuracy 3 0.3 313 1 SchemaTest.testSchemaRequestAccuracy 3 0.3 313 1 SchemaTest.testSchemaVersionRequestAccuracy 3 0.6 327 2 SearchImplTest.testGetRangeSearchableFieldNames 3 0.6 327 2 SearchImplTest.testGetSearchableFieldNames 3 0.6 327 2 SearchImplTest.testGetSortType 3 0.6 327 2 SearchImplTest.testGetSortTypeNoSuchField 3 0.6 327 2 SearchImplTest.testGetSortableFieldNames 3 0.6 327 2 SearchImplTest.testGuessSortTypes 3 0.6 327 2 SearchImplTest.testGuessSortTypesNoSuchField 3 0.6 327 2 SearchImplTest.testNextPage 3 0.6 327 2 SearchImplTest.testNextPageNoMoreResults 3 0.6 327 2 SearchImplTest.testNextPageSearchNotStarted 3 0.6 327 2 SearchImplTest.testParseClassic 3 0.6 327 2 SearchImplTest.testParsePointRange 3 0.6 327 2 SearchImplTest.testPrevPage 3 0.6 327 2 SearchImplTest.testPrevPageNoMoreResults 3 0.6 327 2 SearchImplTest.testPrevPageSearchNotStarted 3 0.6 327 2 SearchImplTest.testSearch 3 0.6 327 2 SearchImplTest.testSearchWithSort 3 0.6 327 2 TermCountsTest.testNumTerms 3 0.6 327 2 TermCountsTest.testSortedTermCounts_count_asc 3 0.6 327 2 TermCountsTest.testSortedTermCounts_count_desc 3 0.6 327 2 TermCountsTest.testSortedTermCounts_name_asc 3 0.6 327 2 TermCountsTest.testSortedTermCounts_name_desc 3 0.6 327 2 TermVectorsAdapterTest.testGetTermVector 3 0.6 327 2 TermVectorsAdapterTest.testGetTermVector_with_positions 3 0.6 327 2 TermVectorsAdapterTest.testGetTermVector_with_positions_offsets 3 0.6 327 2 TermVectorsAdapterTest.testGetTermVectors_notAvailable 3 0.3 313 1 TermsFacetMapTest.testRejectInvalidMinCount 3 0.3 313 1 TermsFacetMapTest.testRejectInvalidOverRefineBuckets 3 0.3 313 1 TermsFacetMapTest.testRejectInvalidOverRequestBuckets 3 0.3 313 1 TermsFacetMapTest.testRejectInvalidTermPrefix 3 0.3 313 1 TermsFacetMapTest.testRejectsInvalidMethod 3 0.3 313 1 TermsFacetMapTest.testRejectsInvalidSortString 3 0.3 313 1 TermsFacetMapTest.testRejectsNegativeBucketOffset 3 0.3 313 1 TermsFacetMapTest.testSetsFacetTypeToTerm 3 0.3 313 1 TermsFacetMapTest.testStoresAllBucketsFlagWithCorrectKey 3 0.3 313 1 TermsFacetMapTest.testStoresBucketLimitWithCorrectKey 3 0.3 313 1 TermsFacetMapTest.testStoresBucketOffsetWithCorrectKey 3 0.3 313 1 TermsFacetMapTest.testStoresFieldWithCorrectKey 3 0.3 313 1 TermsFacetMapTest.testStoresMethodWithCorrectKey 3 0.3 313 1 TermsFacetMapTest.testStoresMinCountWithCorrectKey 3 0.3 313 1 TermsFacetMapTest.testStoresNumBucketsFlagWithCorrectKey 3 0.3 313 1 TermsFacetMapTest.testStoresOverRefineBucketsWithCorrectKey 3 0.3 313 1 TermsFacetMapTest.testStoresOverRequestBucketsWithCorrectKey 3 0.3 313 1 TermsFacetMapTest.testStoresRefinementFlagWithCorrectKey 3 0.3 313 1 TermsFacetMapTest.testStoresSortWithCorrectKey 3 0.3 313 1 TermsFacetMapTest.testStoresTermPrefixWithCorrectKey 3 0.3 331 1 TestCachePurging.testBackgroundPurges 3 0.6 155 1 TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader 3 0.3 319 1 TestCloudRecovery.corruptedLogTest 3 0.3 323 1 TestCloudSearcherWarming.testRepFactor1LeaderStartup 3 0.3 313 1 TestConfigSetAdminRequest.testCreate 3 0.3 313 1 TestConfigSetAdminRequest.testDelete 3 0.3 313 1 TestConfigSetAdminRequest.testNoAction 3 0.3 317 1 TestDistribIDF.testSimpleQuery 3 0.3 320 1 TestDistributedMissingSort.test 3 0.3 319 1 TestDynamicLoading.testDynamicLoading 3 0.3 323 1 TestHighlightDedupGrouping.test 3 0.6 340 2 TestIndexWriterReader.testDuringAddDelete 3 0.3 338 1 TestIndexingSequenceNumbers.testStressConcurrentCommit 3 6.7 30 2 TestInetAddressRangeQueries.testRandomBig 3 7.7 26 2 TestLucene80DocValuesFormat.testTermsEnumRandomMany 3 0.3 320 1 TestMiniSolrCloudClusterSSL.testSslWithCheckPeerName 3 1.3 315 4 TestModelManagerPersistence.testFilePersistence 3 1.6 316 5 TestModelManagerPersistence.testWrapperModelPersistence 3 0.3 342 1 TestPackedInts.testPackedLongValues 3 3.2 342 11 TestRandomChains.testRandomChainsWithLargeStrings 3 0.3 318 1 TestRandomFlRTGCloud.testRandomizedUpdatesAndRTGs 3 0.3 319 1 TestSegmentSorting.testSegmentTerminateEarly 3 0.3 324 1 TestSkipOverseerOperations.testSkipLeaderOperations 3 0.3 319 1 TestSolrCLIRunExample.testSchemalessExample 3 0.6 314 2 TestSolrJsonWriter.test 3 0.3 313 1 TestSolrProperties.testProperties 3 0.3 319 1 TestTlogReplica.testAddDocs 3 0.3 319 1 TestTlogReplica.testBasicLeaderElection 3 0.3 638 2 TestTlogReplica.testCreateDelete 3 0.3 319 1 TestTlogReplica.testKillLeader 3 0.3 319 1 TestTlogReplica.testOutOfOrderDBQWithInPlaceUpdates 3 0.3 319 1 TestTlogReplica.testRealTimeGet 3 0.3 319 1 TestTlogReplica.testRecovery 3 0.3 313 1 TestZkConfigManager.testConstants 3 0.3 313 1 TestZkConfigManager.testUploadConfig 3 0.3 313 1 TestZkConfigManager.testUploadWithACL 3 0.3 322 1 ZkCLITest.testPutFile ***********************Annotations report Number of AwaitsFix: 41 Number of BadApples: 6 *****************AwaitsFix Annotations: ************Lucene AwaitsFix TestControlledRealTimeReopenThread.testCRTReopen @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-5737") TestICUNormalizer2CharFilter.testRandomStrings @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-5595") TestICUTokenizerCJK.TestICUTokenizerCJK suite @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/LUCENE-8222") TestMoreLikeThis.testMultiFieldShouldReturnPerFieldBooleanQuery @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-7161") ************Solr AwaitsFix AutoAddReplicasIntegrationTest.testRapidStopStartStopWithPropChange @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13811") CdcrBidirectionalTest.testBiDir @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-12524") CdcrBootstrapTest.testBootstrapWithContinousIndexingOnSourceCluster @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-12028") CollectionsAPISolrJTest.testCreateAndDeleteShard @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-13021") ComputePlanActionTest.testNodeLost @LuceneTestCase.AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028") ConcurrentCreateRoutedAliasTest.ConcurrentCreateRoutedAliasTest suite @LuceneTestCase.AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-12386") // "Can't find resource" LeaderTragicEventTest.LeaderTragicEventTest suite @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13237") MoveReplicaHDFSTest.MoveReplicaHDFSTest suite @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13924") MoveReplicaHDFSTest.testFailedMove @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12080") // added 03-Oct-2018 ReplaceNodeNoTargetTest.ReplaceNodeNoTargetTest suite @LuceneTestCase.AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-11067") ReplaceNodeNoTargetTest.test @LuceneTestCase.AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-11067") RoutedAliasUpdateProcessorTest.alias, @org.apache.lucene.util.LuceneTestCase.AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13696") SSLMigrationTest.SSLMigrationTest suite @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028") // 17-Mar-2018 SaslZkACLProviderTest.testSaslZkACLProvider @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-13075") ScheduledMaintenanceTriggerTest.testInactiveShardCleanup @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028") // 17-Mar-2018 ScheduledTriggerTest.testTrigger @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028") // added 20-Sep-2018 SearchRateTriggerIntegrationTest.testDeleteNode @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13163") SearchRateTriggerTest.testTrigger @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028") SolrExporterIntegrationTest.SolrExporterIntegrationTest suite @org.apache.lucene.util.LuceneTestCase.AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13786") Tagger2Test.testStopWords @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-8344") TestHierarchicalDocBuilder.testThreeLevelHierarchy @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-12801") // this test fails easily under beasting TestImpersonationWithHadoopAuth.testForwarding @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/HADOOP-9893") TestJsonFacetRefinement.testProcessEmptyRefinement @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12556") TestJsonFacetRefinement.testSortedSubFacetRefinementWhenParentOnlyReturnedByOneShardProcessEmpty @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12556") TestLTRReRankingPipeline.testDifferentTopN @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-11134") TestMinMaxOnMultiValuedField.testDoubleFieldCache @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-6709") TestMinMaxOnMultiValuedField.testFloatFieldCache @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-6709") TestMinMaxOnMultiValuedField.testIntFieldCache @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-6709") TestMinMaxOnMultiValuedField.testLongFieldCache @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-6709") TestPullReplica.TestPullReplica suite @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028") TestSimComputePlanAction.testNodeLost @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-12028") // if you beast this, eventually you will see TestSimExtremeIndexing.TestSimExtremeIndexing suite @org.apache.lucene.util.LuceneTestCase.AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12923") TestSimLargeCluster.testBasic @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028") // this test hits a timeout easily TestStressRecovery.TestStressRecovery suite @LuceneTestCase.AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028") // 6-Sep-2018 TestTlogReplayVsRecovery.TestTlogReplayVsRecovery suite @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13486;https://issues.apache.org/jira/browse/SOLR-14183") TimeRoutedAliasUpdateProcessorTest.testDateMathInStart @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13943") TriLevelCompositeIdRoutingTest.test @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13369") *****************BadApple Annotations: ************Lucene BadApple ************Solr BadApple MoveReplicaHDFSTest.testNormalFailedMove @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028") // 14-Oct-2018 MultiThreadedOCPTest.test @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028") // annotated on: 24-Dec-2018 SharedFSAutoReplicaFailoverTest.SharedFSAutoReplicaFailoverTest suite @LuceneTestCase.BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028") // added 20-Jul-2018 SolrZkClientTest.testSimpleUpdateACLs @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028") // annotated on: 24-Dec-2018 TimeRoutedAliasUpdateProcessorTest.TimeRoutedAliasUpdateProcessorTest suite @LuceneTestCase.BadApple(bugUrl = "https://issues.apache.org/jira/browse/SOLR-13059")
--------------------------------------------------------------------- To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org