Not annotating, but here are the failures in each of the last 4 weeks:
Failures in the last 4 reports..
Report Pct runs fails test
0123 0.3 1427 8 AutoScalingHandlerTest.testReadApi
0123 6.2 1495 66 BasicDistributedZkTest.test
0123 0.3 1446 8 HttpPartitionTest.test
0123 0.5 1444 11 HttpPartitionWithTlogReplicasTest.test
0123 0.8 1469 13 LeaderFailoverAfterPartitionTest.test
0123 0.6 1438 15
LegacyCloudClusterPropTest.testCreateCollectionSwitchLegacyCloud
0123 0.8 1442 10 RollingRestartTest.test
0123 0.3 1451 5
ShardSplitTest.testSplitMixedReplicaTypesLink
0123 1.6 1440 10 SyncSliceTest.test
0123 1.7 1454 18 SystemCollectionCompatTest.testBackCompat
0123 12.5 112 21 Test2BPostings.test // Java bug, don’t
annotate
0123 0.3 1208 4
TestDelegationWithHadoopAuth.testDelegationTokenRenew
0123 0.3 1491 5
TestLucene80DocValuesFormat.testSparseDocValuesVsStoredFields
0123 0.3 1435 7
TestQueryingOnDownCollection.testQueryToDownCollectionShouldFailFast
0123 1.6 1495 26 TestStressLiveNodes.testStress
Full report attached.
DO NOT ENABLE LIST:
MoveReplicaHDFSTest.testFailedMove
MoveReplicaHDFSTest.testNormalFailedMove
TestControlledRealTimeReopenThread.testCRTReopen
TestICUNormalizer2CharFilter.testRandomStrings
TestICUTokenizerCJK
TestImpersonationWithHadoopAuth.testForwarding
TestLTRReRankingPipeline.testDifferentTopN
TestRandomChains
DO NOT ANNOTATE LIST
CdcrBidirectionalTest.testBiDir
IndexSizeTriggerTest.testMergeIntegration
IndexSizeTriggerTest.testMixedBounds
IndexSizeTriggerTest.testSplitIntegration
IndexSizeTriggerTest.testTrigger
InfixSuggestersTest.testShutdownDuringBuild
ShardSplitTest.test
ShardSplitTest.testSplitMixedReplicaTypes
ShardSplitTest.testSplitWithChaosMonkey
Test2BPostings.test
TestLatLonShapeQueries.testRandomBig
TestPackedInts.testPackedLongValues
TestRandomChains.testRandomChainsWithLargeStrings
TestTriggerIntegration.testSearchRate
Processing file (History bit 3): HOSS-2020-01-27.csv
Processing file (History bit 2): HOSS-2020-01-20.csv
Processing file (History bit 1): HOSS-2020-01-13.csv
Processing file (History bit 0): HOSS-2020-01-06.csv
Number of AwaitsFix: 41 Number of BadApples: 6
Raw fail count by week totals, most recent week first (corresponds to bits):
Week: 0 had 125 failures
Week: 1 had 191 failures
Week: 2 had 118 failures
Week: 3 had 298 failures
**Annotated tests that didn't fail in the last 4 weeks.
**Tests removed from the next two lists because they were specified in
'doNotEnable' in the properties file
MoveReplicaHDFSTest.testNormalFailedMove
**Annotations will be removed from the following tests because they haven't
failed in the last 4 rollups.
**Methods: 2
MultiThreadedOCPTest.test
SolrZkClientTest.testSimpleUpdateACLs
********Failures in Hoss' reports for the last 4 rollups.
There were 576 unannotated tests that failed in Hoss' rollups. Ordered by the
date I downloaded the rollup file, newest->oldest. See above for the dates the
files were collected
These tests were NOT BadApple'd or AwaitsFix'd
All tests that failed 4 weeks running will be BadApple'd unless there are
objections
Failures in the last 4 reports..
Report Pct runs fails test
0123 0.3 1427 8 AutoScalingHandlerTest.testReadApi
0123 6.2 1495 66 BasicDistributedZkTest.test
0123 0.3 1446 8 HttpPartitionTest.test
0123 0.5 1444 11 HttpPartitionWithTlogReplicasTest.test
0123 0.8 1469 13 LeaderFailoverAfterPartitionTest.test
0123 0.6 1438 15
LegacyCloudClusterPropTest.testCreateCollectionSwitchLegacyCloud
0123 0.8 1442 10 RollingRestartTest.test
0123 0.3 1451 5
ShardSplitTest.testSplitMixedReplicaTypesLink
0123 1.6 1440 10 SyncSliceTest.test
0123 1.7 1454 18 SystemCollectionCompatTest.testBackCompat
0123 12.5 112 21 Test2BPostings.test
0123 0.3 1208 4
TestDelegationWithHadoopAuth.testDelegationTokenRenew
0123 0.3 1491 5
TestLucene80DocValuesFormat.testSparseDocValuesVsStoredFields
0123 0.3 1435 7
TestQueryingOnDownCollection.testQueryToDownCollectionShouldFailFast
0123 1.6 1495 26 TestStressLiveNodes.testStress
************ Will BadApple all tests above this line except ones listed at the
top**************
012 20.6 93 18 HdfsSyncSliceTest.test
012 0.3 1114 4 TestCryptoKeys.test
01 3 3.7 77 4 TestDuelingCodecsAtNight.testBigEquals
01 3 1.4 1086 9 TestPackages.testPluginLoading
01 3 22.6 116 43
TestXYMultiPolygonShapeQueries.testRandomBig
01 0.3 728 2
CloudSolrClientTest.testRetryUpdatesWhenClusterStateIsStale
01 0.3 758 2 ExecutePlanActionTest.testTaskTimeout
01 5.0 40 2 HdfsWriteToMultipleCollectionsTest.test
01 0.3 752 2 SearchRateTriggerTest.testWaitForElapsed
01 4.0 45 2 ShardSplitTest.testSplitWithChaosMonkey
01 0.6 748 3 TestInPlaceUpdatesDistrib.test
01 0.8 788 5 TestOfflineSorter.testThreadSafety
01 0.3 749 2
TestSolrCLIRunExample.testInteractiveSolrCloudExampleWithAutoScalingPolicy
01 0.3 752 2 TriggerCooldownIntegrationTest.testCooldown
0 23 0.3 1033 5
AutoScalingHandlerTest.testSuggestionsWithPayload
0 2 19.4 61 10 HdfsBasicDistributedZkTest.test
0 2 3.7 51 2 TestDuelingCodecsAtNight.testEquals
0 2 1.0 465 2
TestLucene80DocValuesFormat.testSparseSortedNumericBlocksOfVariousBitsPerValue
0 2 0.3 708 2
TestPullReplicaErrorHandling.testPullReplicaDisconnectsFromZooKeeper
0 2 1.1 713 5 TestRandomDVFaceting.testRandomFaceting
0 3 0.5 685 3 BasicDistributedZk2Test.test
0 3 0.3 680 2 CollectionsAPISolrJTest.testColStatus
0 3 1.0 435 2
TestLucene80DocValuesFormat.testTermsEnumLongSharedPrefixes
0 3 0.3 676 2 TestRecovery.testExistOldBufferLog
0 0.3 346 1
CloudHttp2SolrClientTest.testRetryUpdatesWhenClusterStateIsStale
0 0.3 350 1 CloudSolrClientTest.testParallelUpdateQTime
0 0.3 362 1 ConnectionManagerTest.testLikelyExpired
0 0.8 362 3
ConnectionManagerTest.testReconnectWhenZkDisappeared
0 0.3 360 1
DeleteReplicaTest.deleteReplicaAndVerifyDirectoryCleanup
0 0.4 272 1
DistributedUpdateProcessorTest.testVersionDelete
0 0.3 347 1
MathExpressionTest.testGeometricDistribution
0 0.3 357 1
MetricTriggerIntegrationTest.testMetricTrigger
0 0.3 362 1
NodeLostTriggerIntegrationTest.testNodeLostTrigger
0 0.3 362 1
NodeMarkersRegistrationTest.testNodeMarkersRegistration
0 0.4 268 1 OverseerTest.testReplay
0 0.8 361 3 PeerSyncReplicationTest.test
0 0.3 358 1 PeerSyncWithLeaderTest.test
0 0.3 358 1 ReplaceNodeTest.test
0 0.8 378 3 ShardSplitTest.testSplitShardWithRuleLink
0 0.3 316 1
SoftAutoCommitTest.testSoftCommitWithinAndHardCommitMaxTimeMixedAdds
0 1.1 360 4 SolrCmdDistributorTest.test
0 0.3 359 1 SplitByPrefixTest.doTest
0 38.9 576 224 TestBulkSchemaConcurrent.test
0 0.3 359 1
TestCloudRecovery.leaderRecoverFromLogOnStartupTest
0 0.3 361 1 TestCloudRecovery2.test
0 0.6 360 2
TestCloudSearcherWarming.testPeersyncFailureReplicationSuccess
0 0.3 362 1
TestCollectionsAPIViaSolrCloudCluster.testStopAllStartAll
0 0.3 347 1
TestContentStreamDataSource.testCommitWithin
0 0.5 364 2
TestInPlaceUpdateWithRouteField.testUpdatingDocValuesWithRouteField
0 0.8 244 2 TestIndexWriterDelete.testUpdatesOnDiskFull
0 0.0 2141 1 TestJsonFacets.testBigger
0 1.6 367 6
TestLucene60PointsFormat.testEstimatePointCount
0 3.6 28 1
TestLucene80DocValuesFormat.testSortedSetVariableLengthManyVsStoredFields
0 0.3 367 1
TestLucene80DocValuesFormat.testSparseSortedVariableLengthVsStoredFields
0 0.3 361 1 TestPagedBytes.testDataInputOutput
0 1.1 361 4 TestPointFields.testFloatPointStats
0 1.7 361 6
TestPointFields.testIntPointFieldMultiValuedRangeFacet
0 0.3 364 1
TestPointVectorStrategy.testCitiesIntersectsBBox
0 0.3 359 1 TestRebalanceLeaders.testRebalanceLeaders
0 0.6 360 2
TestReplicationHandler.doTestReplicateAfterCoreReload
0 0.3 362 1
TestTopDocsCollector.testRealisticConcurrentMinimumScore
0 56.2 733 412 TestZkChroot.testChrootBootstrap
0 56.0 730 409 TestZkChroot.testInitPathExists
0 56.0 730 409 TestZkChroot.testWithUploadDir
0 0.6 363 2 UnloadDistributedZkTest.test
0 58.1 597 347
ZkControllerTest.testPublishAndWaitForDownStates
123 0.3 1073 3 ChaosMonkeyNothingIsSafeTest.test
123 5.0 72 7
HdfsTlogReplayBufferedWhileIndexingTest.test
123 0.3 1083 6
LeaderElectionIntegrationTest.testSimpleSliceLeaderElection
123 0.5 1076 6 LeaderVoteWaitTimeoutTest.basicTest
123 0.9 1127 6 TestBagOfPositions.test
123 0.9 1134 10 TestBagOfPostings.test
123 8.3 736 40 TestFuzzyQuery.testErrorMessage
123 0.2 1132 3
TestSearcherManager.testConcurrentIndexCloseSearchAndRefresh
12 0.3 753 2
CollectionsAPISolrJTest.testCreateCollWithDefaultClusterPropertiesOldFormat
12 12.5 27 2
DimensionalRoutedAliasUpdateProcessorTest.testCatTime
12 12.5 27 2
DimensionalRoutedAliasUpdateProcessorTest.testTimeCat
12 0.3 750 2
IndexSizeTriggerMixedBoundsTest.testMixedBounds
12 0.5 758 3
MetricsHistoryWithAuthIntegrationTest.testValuesAreCollected
12 0.5 748 3 ShardSplitTest.testSplitShardWithRule
12 0.8 744 4 TestCloudSchemaless.test
12 0.3 688 2
TestMiniSolrCloudClusterSSL.testSslAndClientAuth
12 0.2 762 2
TestSimpleTextTermVectorsFormat.testRamBytesUsed
12 3.2 772 19
TestXYMultiPolygonShapeQueries.testRandomMedium
1 3 0.3 710 2 CustomHighlightComponentTest.test
1 3 0.2 730 3 OverseerRolesTest.testOverseerRole
1 3 0.3 716 2 TestDistributedSearch.test
1 3 0.3 713 2 TestLockTree.testLocks
1 3 0.3 713 2 TestMiniSolrCloudClusterSSL.testNoSsl
1 3 0.3 712 2 TestNamedUpdateProcessors.test
1 3 0.3 716 2 TestReplicaProperties.test
1 3 0.3 711 2
TestSegmentSorting.testAtomicUpdateOfSegmentSortField
1 3 0.4 442 2 TestSolrCachePerf.testGetPutCompute
1 3 0.3 723 3
TestSolrCloudWithDelegationTokens.testDelegationTokenRenew
1 0.3 394 1
ActionThrottleTest.testAZeroNanoTimeReturnInWait
1 0.3 394 1
AutoScalingHandlerTest.testConcurrentUpdates
1 0.3 392 1
ChaosMonkeySafeLeaderWithPullReplicasTest.test
1 0.3 391 1
CollectionsAPIAsyncDistributedZkTest.testAsyncRequests
1 0.3 398 1
CollectionsAPISolrJTest.testCreateWithDefaultConfigSet
1 0.3 394 1 ComputePlanActionTest.testNodeAdded
1 0.3 393 1 DeleteNodeTest.test
1 27.2 290 79 FuzzySearchTest.testTooComplex
1 4.8 21 1 HdfsChaosMonkeyNothingIsSafeTest.test
1 0.3 398 1 LeaderElectionTest.testCancelElection
1 0.3 380 1 MathExpressionTest.testZipFDistribution
1 0.3 392 1 MetricsHistoryIntegrationTest.testGet
1 0.3 398 1
MigrateRouteKeyTest.multipleShardMigrateTest
1 0.3 392 1
MissingSegmentRecoveryTest.testLeaderRecovery
1 0.3 394 1 MoveReplicaTest.test
1 0.3 398 1 OverseerModifyCollectionTest.testModifyColl
1 0.3 395 1
ScheduledTriggerIntegrationTest.testScheduledTrigger
1 0.3 380 1 StreamDecoratorTest.testExecutorStream
1 0.2 427 1 TermInSetQueryTest.testDuel
1 0.2 431 1 TestAddIndexes.testFakeAllDeleted
1 0.2 431 1 TestAddIndexes.testNoMergeAfterCopy
1 0.5 431 2 TestAddIndexes.testWithPendingDeletes
1 0.2 427 1 TestAtomicUpdate.testAtomicUpdates
1 0.3 391 1 TestCloudNestedDocsSort.test
1 0.3 391 1
TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete
1 0.2 429 1
TestConcurrentMergeScheduler.testFlushExceptions
1 0.2 425 1
TestCrashCausesCorruptIndex.testCrashCorruptsIndexing
1 1.4 433 6 TestDemo.testDemo
1 0.7 432 3 TestDirectoryReader.testFilesOpenClose
1 0.5 393 2 TestDistributedGrouping.test
1 0.2 429 1
TestDocValuesQueries.testDuelPointRangeMultivaluedSortedSetRangeQuery
1 0.7 429 3
TestDocValuesQueries.testDuelPointRangeSortedRangeQuery
1 0.2 423 1 TestDuelingCodecs.testCrazyReaderEquals
1 0.2 423 1 TestDuelingCodecs.testEquals
1 0.2 428 1 TestField.testIndexedBinaryField
1 0.2 429 1 TestFieldValueQuery.testApproximation
1 0.2 429 1 TestFieldValueQuery.testScore
1 0.7 431 3
TestGraphTokenizers.testMockGraphTokenFilterBeforeHolesRandom
1 0.2 427 1
TestIndexFileDeleter.testVirusScannerDoesntCorruptIndex
1 0.2 428 1 TestIndexManyDocuments.test
1 0.2 422 1 TestIndexSorting.testRandom3
1 0.2 426 1 TestIndexWriterDelete.testDeleteAllNRT
1 0.2 425 1
TestIndexWriterExceptions.testRandomExceptionDuringRollback
1 0.2 430 1
TestIndexWriterWithThreads.testIOExceptionDuringWriteSegmentWithThreadsOnlyOnce
1 0.3 400 1 TestInputIterator.testTerms
1 0.3 395 1 TestLazyCores.testLazyLoad
1 0.2 426 1
TestLucene50StoredFieldsFormat.testMultiClose
1 0.2 426 1 TestLucene60PointsFormat.testMultiClose
1 0.2 426 1 TestLucene60PointsFormat.testWithExceptions
1 0.6 181 1
TestLucene70DocValuesFormat.testTermsEnumVariableWidth
1 0.2 428 1 TestLucene70SegmentInfoFormat.testRandom
1 0.2 424 1
TestLucene80DocValuesFormat.testRandomAdvanceNumeric
1 0.2 424 1
TestLucene80NormsFormatMergeInstance.testUndeadNorms
1 0.5 405 2
TestLucene84PostingsFormat.testDisableFSTOffHeap
1 0.2 427 1 TestLucene84PostingsFormat.testDocsAndFreqs
1 0.2 427 1
TestLucene84PostingsFormat.testDocsAndFreqsAndPositionsAndOffsets
1 0.2 427 1
TestLucene84PostingsFormat.testDocsAndFreqsAndPositionsAndOffsetsAndPayloads
1 0.5 427 2
TestLucene84PostingsFormat.testDocsAndFreqsAndPositionsAndPayloads
1 0.5 427 2 TestLucene84PostingsFormat.testDocsOnly
1 0.5 405 2 TestLucene84PostingsFormat.testFstOffHeap
1 0.2 427 1
TestLucene84PostingsFormat.testPostingsEnumReuse
1 0.5 427 2 TestLucene84PostingsFormat.testRandom
1 0.2 425 1 TestNRTThreads.testNRTThreads
1 0.2 429 1 TestNeverDelete.testIndexing
1 0.2 427 1 TestOmitNorms.testOmitNormsCombos
1 0.2 425 1 TestPerFieldDocValuesFormat.testMultiClose
1 0.2 425 1
TestPerFieldDocValuesFormat.testRandomSortedBytes
1 0.5 425 2
TestPerFieldDocValuesFormat.testSortedFixedLengthVsStoredFields
1 0.2 425 1
TestPerFieldDocValuesFormat.testSortedSetFixedLengthFewUniqueSetsVsStoredFields
1 0.2 425 1
TestPerFieldDocValuesFormat.testSortedSetFixedLengthManyValuesPerDocVsStoredFields
1 0.2 425 1
TestPerFieldDocValuesFormat.testSortedSetFixedLengthSingleValuedVsStoredFields
1 0.2 425 1
TestPerFieldDocValuesFormat.testSortedSetFixedLengthVsStoredFields
1 0.5 425 2
TestPerFieldDocValuesFormat.testSortedSetVariableLengthManyValuesPerDocVsStoredFields
1 0.2 425 1
TestPerFieldDocValuesFormat.testSortedSetVariableLengthSingleValuedVsStoredFields
1 0.5 425 2
TestPerFieldDocValuesFormat.testSortedVariableLengthVsStoredFields
1 0.2 425 1
TestPerFieldDocValuesFormat.testSparseSortedFixedLengthVsStoredFields
1 0.2 421 1
TestPerFieldPostingsFormat.testDocsAndFreqsAndPositionsAndOffsetsAndPayloads
1 0.2 421 1 TestPerFieldPostingsFormat.testDocsOnly
1 0.2 421 1 TestPerFieldPostingsFormat.testMultiClose
1 0.2 421 1 TestPerFieldPostingsFormat.testRandom
1 2.7 406 11 TestPointFields.testDoublePointStats
1 1.9 428 8 TestReadOnlyIndex.testReadOnlyIndex
1 0.5 428 2 TestShardSearching.testSimple
1 0.3 398 1 TestSimScenario.testAutoAddReplicas
1 0.3 398 1 TestSimScenario.testSuggestions
1 0.3 393 1
TestSkipOverseerOperations.testSkipDownOperations
1 0.8 393 3 TestSolrConfigHandlerCloud.test
1 0.2 428 1
TestStressIndexing.testStressIndexAndSearching
1 0.3 396 1 TestTlogReplica.testRemoveLeader
1 0.3 394 1 TestWithCollection.testAddReplicaSimple
1 0.3 395 1
TriggerSetPropertiesIntegrationTest.testSetProperties
23 0.6 677 4
CollectionsAPISolrJTest.testCreateCollWithDefaultClusterPropertiesNewFormat
23 0.3 671 2 CreateRoutedAliasTest.testV2
23 32.4 63 12 HdfsBasicDistributedZk2Test.test
23 0.3 603 2 OverseerTest.testShardLeaderChange
23 0.3 672 2
PingRequestHandlerTest.testPingInClusterWithNoHealthCheck
23 0.3 671 2
SchemaApiFailureTest.testAddTheSameFieldTwice
23 7.4 58 8 StressHdfsTest.test
23 0.3 669 2 TestDynamicFieldNamesIndexCorrectly.test
23 0.3 702 2
TestLucene80DocValuesFormat.testSortedNumericBlocksOfVariousBitsPerValue
23 0.6 676 3 TestRestoreCore.testFailedRestore
2 0.3 351 1 CloudMLTQParserTest.testMLTQParser
2 0.3 352 1
ComputePlanActionTest.testNodeLostTriggerWithDeleteNodePreferredOp
2 0.3 351 1
CreateRoutedAliasTest.testCollectionNamesMustBeAbsent
2 0.3 351 1
CreateRoutedAliasTest.testTimeStampWithMsFails
2 0.3 351 1
CreateRoutedAliasTest.testTimezoneAbsoluteDate
2 0.3 351 1
CustomCollectionTest.testCustomCollectionsAPI
2 0.3 351 1
CustomCollectionTest.testRouteFieldForHashRouter
2 0.3 351 1
CustomCollectionTest.testRouteFieldForImplicitRouter
2 0.3 352 1 DeleteShardTest.test
2 1.1 351 4
DocValuesTest.testFloatAndDoubleRangeQueryRandom
2 15.0 419 63
EmbeddedSolrNoSerializeTest.testAssertTagStreamingWithSolrTaggerRequest
2 15.0 419 63 EmbeddedSolrNoSerializeTest.testSearch
2 15.0 419 63 EmbeddedSolrNoSerializeTest.testTag
2 0.3 335 1
FullSolrCloudDistribCmdsTest.testBasicUpdates
2 0.3 335 1
FullSolrCloudDistribCmdsTest.testConcurrentIndexing
2 0.3 335 1
FullSolrCloudDistribCmdsTest.testIndexQueryDeleteHierarchical
2 0.3 335 1
FullSolrCloudDistribCmdsTest.testIndexingBatchPerRequestWithHttpSolrClient
2 0.3 335 1
FullSolrCloudDistribCmdsTest.testIndexingOneDocPerRequestWithHttpSolrClient
2 15.4 4173 643 RandomizedTaggerTest.test
2 0.3 356 1 ReindexCollectionTest.testFailure
2 0.3 356 1
ReindexCollectionTest.testSameTargetReindexing
2 0.3 350 1 SearchHandlerTest.testRequireZkConnected
2 0.3 350 1 ShardRoutingTest.test
2 0.3 350 1 ShardSplitTest.testSplitMixedReplicaTypes
2 0.3 350 1
ShardSplitTest.testSplitStaticIndexReplicationLink
2 0.9 352 3
SolrCloudExampleTest.testLoadDocsIntoGettingStartedCollection
2 16.1 416 67 Tagger2Test.testLongestDominantRight
2 15.9 415 66 Tagger2Test.testMultibyteChar
2 16.1 416 67 Tagger2Test.testWDF
2 16.4 420 69 TaggerTest.testFormat
2 16.4 420 69 TaggerTest.testFormatMatchText
2 16.4 420 69 TaggerTest.testMultipleFilterQueries
2 16.4 420 69 TaggerTest.testSubTags
2 16.4 420 69 TaggerTest.testWholeMatching
2 14.9 410 61 TaggingAttributeTest.testTaggingAttribute
2 0.3 352 1 TestConfigReload.test
2 3.0 363 11
TestDistributedStatsComponentCardinality.test
2 0.4 231 1 TestExactStatsCacheCloud.testBasicStats
2 0.9 351 3 TestJaegerConfigurator.testInjected
2 0.3 347 1 TestLBHttpSolrClient.testSimple
2 0.3 370 1
TestLucene50TermVectorsFormat.testRamBytesUsed
2 0.3 367 1
TestLucene80DocValuesFormat.testNumericFieldJumpTables
2 0.3 367 1
TestLucene80DocValuesFormat.testSparseBinaryFixedLengthVsStoredFields
2 3.0 368 11 TestPhraseWildcardQuery.testExplain
2 0.3 353 1 TestRecovery.stressLogReplay
2 0.3 353 1
TestRequestForwarding.testMultiCollectionQuery
2 15.8 419 66 XmlInterpolationTest.test
2 7.9 419 33 XmlInterpolationTest.testInvalidXml
3 0.3 320 1 AddReplicaTest.testAddMultipleReplicas
3 0.6 327 2 AnalysisImplTest.testGetPresetAnalyzerTypes
3 0.3 323 1 AssignBackwardCompatibilityTest.test
3 0.3 321 1 AutoscalingHistoryHandlerTest.testHistory
3 3.6 329 12 BasicAuthIntegrationTest.testBasicAuth
3 0.3 318 1
CollectionsAPIDistributedZkTest.testCreateNodeSet
3 0.3 298 1 CommitsImplTest.testGetCommit
3 0.3 298 1
CommitsImplTest.testGetCommit_generation_notfound
3 0.3 298 1 CommitsImplTest.testGetFiles
3 0.3 298 1
CommitsImplTest.testGetFiles_generation_notfound
3 0.3 298 1 CommitsImplTest.testGetSegmentAttributes
3 0.3 298 1
CommitsImplTest.testGetSegmentAttributes_generation_notfound
3 0.3 298 1
CommitsImplTest.testGetSegmentAttributes_invalid_name
3 0.3 298 1 CommitsImplTest.testGetSegmentDiagnostics
3 0.3 298 1
CommitsImplTest.testGetSegmentDiagnostics_generation_notfound
3 0.3 298 1
CommitsImplTest.testGetSegmentDiagnostics_invalid_name
3 0.3 298 1 CommitsImplTest.testGetSegments
3 0.3 298 1
CommitsImplTest.testGetSegments_generation_notfound
3 0.3 298 1 CommitsImplTest.testListCommits
3 0.3 298 1 CommitsImplTest.testSegmentCodec
3 0.3 298 1
CommitsImplTest.testSegmentCodec_generation_notfound
3 0.3 298 1
CommitsImplTest.testSegmentCodec_invalid_name
3 0.3 334 1
ConfusionMatrixGeneratorTest.testGetConfusionMatrixWithCNB
3 0.3 334 1
ConfusionMatrixGeneratorTest.testGetConfusionMatrixWithSNB
3 0.3 321 1 DistributedIntervalFacetingTest.test
3 0.3 318 1 DistributedSpellCheckComponentTest.test
3 0.6 327 2
DocValuesAdapterTest.testGetDocValues_binary
3 0.6 327 2
DocValuesAdapterTest.testGetDocValues_notAvailable
3 0.6 327 2
DocValuesAdapterTest.testGetDocValues_numeric
3 0.6 327 2
DocValuesAdapterTest.testGetDocValues_sorted
3 0.6 327 2
DocValuesAdapterTest.testGetDocValues_sorted_numeric
3 0.6 327 2
DocValuesAdapterTest.testGetDocValues_sorted_set
3 0.7 303 2 DocumentsImplTest.testClose
3 0.7 303 2 DocumentsImplTest.testFirstTerm
3 0.7 303 2 DocumentsImplTest.testFirstTermDoc
3 0.7 303 2
DocumentsImplTest.testFirstTermDoc_unPositioned
3 0.7 303 2
DocumentsImplTest.testFirstTerm_notAvailable
3 0.7 303 2 DocumentsImplTest.testGetDocumentFields
3 0.7 303 2 DocumentsImplTest.testGetMaxDoc
3 0.7 303 2 DocumentsImplTest.testIsLive
3 0.7 303 2 DocumentsImplTest.testNextTerm
3 0.7 303 2 DocumentsImplTest.testNextTermDoc
3 0.7 303 2
DocumentsImplTest.testNextTermDoc_unPositioned
3 0.7 303 2 DocumentsImplTest.testNextTerm_unPositioned
3 0.7 303 2 DocumentsImplTest.testSeekTerm
3 0.7 303 2 DocumentsImplTest.testSeekTerm_unPositioned
3 0.7 303 2 DocumentsImplTest.testTermPositions
3 0.7 303 2
DocumentsImplTest.testTermPositions_noPositions
3 0.7 303 2
DocumentsImplTest.testTermPositions_unPositioned
3 3.6 28 1 HdfsRestartWhileUpdatingTest.test
3 0.3 320 1 HttpPartitionOnCommitTest.test
3 0.3 322 1 IndexSizeTriggerTest.testMergeIntegration
3 0.3 326 1
LeaderVoteWaitTimeoutTest.testMostInSyncReplicasCanWinElection
3 0.3 313 1
MergeIndexesEmbeddedTest.testMergeIndexesByCoreName
3 0.3 313 1
MergeIndexesEmbeddedTest.testMergeIndexesByDirName
3 0.3 313 1
MergeIndexesEmbeddedTest.testMergeMultipleRequest
3 0.6 327 2 OverviewImplTest.testClose
3 0.6 327 2 OverviewImplTest.testGetCommitDescription
3 0.6 327 2 OverviewImplTest.testGetCommitUserData
3 0.6 327 2 OverviewImplTest.testGetDirImpl
3 0.6 327 2 OverviewImplTest.testGetFieldNames
3 0.6 327 2 OverviewImplTest.testGetIndexFormat
3 0.6 327 2 OverviewImplTest.testGetIndexPath
3 0.6 327 2 OverviewImplTest.testGetIndexVersion
3 0.6 327 2 OverviewImplTest.testGetNumDeletedDocs
3 0.6 327 2 OverviewImplTest.testGetNumDocuments
3 0.6 327 2 OverviewImplTest.testGetNumFields
3 0.6 327 2 OverviewImplTest.testGetNumTerms
3 0.6 327 2 OverviewImplTest.testGetSortedTermCounts
3 0.6 327 2 OverviewImplTest.testGetTopTerms
3 0.6 327 2
OverviewImplTest.testGetTopTerms_illegal_numterms
3 0.6 327 2 OverviewImplTest.testHasDeletions
3 0.6 327 2 OverviewImplTest.testIsOptimized
3 0.3 323 1 PeerSyncTest.test
3 0.3 313 1
SchemaTest.addDynamicFieldShouldntBeCalledTwiceWithTheSameName
3 0.3 313 1
SchemaTest.addFieldShouldntBeCalledTwiceWithTheSameName
3 0.3 313 1
SchemaTest.addFieldTypeShouldntBeCalledTwiceWithTheSameName
3 0.3 313 1
SchemaTest.addFieldTypeWithAnalyzerClassAccuracy
3 0.3 313 1
SchemaTest.addFieldTypeWithSimilarityAccuracy
3 0.3 313 1
SchemaTest.copyFieldsShouldFailWhenOneOfTheFieldsDoesntExistInTheSchema
3 0.3 313 1
SchemaTest.deleteCopyFieldShouldFailWhenOneOfTheFieldsDoesntExistInTheSchema
3 0.3 313 1
SchemaTest.deletingADynamicFieldThatDoesntExistInTheSchemaShouldFail
3 0.3 313 1
SchemaTest.deletingAFieldThatDoesntExistInTheSchemaShouldFail
3 0.3 313 1
SchemaTest.deletingAFieldTypeThatDoesntExistInTheSchemaShouldFail
3 0.3 313 1 SchemaTest.testAddDynamicFieldAccuracy
3 0.3 313 1 SchemaTest.testAddFieldAccuracy
3 0.3 313 1 SchemaTest.testAddFieldTypeAccuracy
3 0.3 313 1 SchemaTest.testCopyFieldAccuracy
3 0.3 313 1
SchemaTest.testCopyFieldWithMaxCharsAccuracy
3 0.3 313 1 SchemaTest.testDeleteCopyFieldAccuracy
3 0.3 313 1 SchemaTest.testDeleteDynamicFieldAccuracy
3 0.3 313 1 SchemaTest.testDeleteFieldAccuracy
3 0.3 313 1 SchemaTest.testDeleteFieldTypeAccuracy
3 0.3 313 1 SchemaTest.testGetCopyFieldsAccuracy
3 0.3 313 1 SchemaTest.testGetDynamicFieldAccuracy
3 0.3 313 1 SchemaTest.testGetDynamicFieldsAccuracy
3 0.3 313 1 SchemaTest.testGetFieldAccuracy
3 0.3 313 1 SchemaTest.testGetFieldTypeAccuracy
3 0.3 313 1 SchemaTest.testGetFieldTypesAccuracy
3 0.3 313 1 SchemaTest.testGetFieldsAccuracy
3 0.3 313 1 SchemaTest.testGetGlobalSimilarityAccuracy
3 0.3 313 1 SchemaTest.testGetUniqueKeyAccuracy
3 0.3 313 1
SchemaTest.testMultipleUpdateRequestAccuracy
3 0.3 313 1 SchemaTest.testReplaceDynamicFieldAccuracy
3 0.3 313 1 SchemaTest.testReplaceFieldAccuracy
3 0.3 313 1 SchemaTest.testReplaceFieldTypeAccuracy
3 0.3 313 1 SchemaTest.testSchemaNameRequestAccuracy
3 0.3 313 1 SchemaTest.testSchemaRequestAccuracy
3 0.3 313 1 SchemaTest.testSchemaVersionRequestAccuracy
3 0.6 327 2
SearchImplTest.testGetRangeSearchableFieldNames
3 0.6 327 2 SearchImplTest.testGetSearchableFieldNames
3 0.6 327 2 SearchImplTest.testGetSortType
3 0.6 327 2 SearchImplTest.testGetSortTypeNoSuchField
3 0.6 327 2 SearchImplTest.testGetSortableFieldNames
3 0.6 327 2 SearchImplTest.testGuessSortTypes
3 0.6 327 2
SearchImplTest.testGuessSortTypesNoSuchField
3 0.6 327 2 SearchImplTest.testNextPage
3 0.6 327 2 SearchImplTest.testNextPageNoMoreResults
3 0.6 327 2 SearchImplTest.testNextPageSearchNotStarted
3 0.6 327 2 SearchImplTest.testParseClassic
3 0.6 327 2 SearchImplTest.testParsePointRange
3 0.6 327 2 SearchImplTest.testPrevPage
3 0.6 327 2 SearchImplTest.testPrevPageNoMoreResults
3 0.6 327 2 SearchImplTest.testPrevPageSearchNotStarted
3 0.6 327 2 SearchImplTest.testSearch
3 0.6 327 2 SearchImplTest.testSearchWithSort
3 0.6 327 2 TermCountsTest.testNumTerms
3 0.6 327 2
TermCountsTest.testSortedTermCounts_count_asc
3 0.6 327 2
TermCountsTest.testSortedTermCounts_count_desc
3 0.6 327 2
TermCountsTest.testSortedTermCounts_name_asc
3 0.6 327 2
TermCountsTest.testSortedTermCounts_name_desc
3 0.6 327 2 TermVectorsAdapterTest.testGetTermVector
3 0.6 327 2
TermVectorsAdapterTest.testGetTermVector_with_positions
3 0.6 327 2
TermVectorsAdapterTest.testGetTermVector_with_positions_offsets
3 0.6 327 2
TermVectorsAdapterTest.testGetTermVectors_notAvailable
3 0.3 313 1 TermsFacetMapTest.testRejectInvalidMinCount
3 0.3 313 1
TermsFacetMapTest.testRejectInvalidOverRefineBuckets
3 0.3 313 1
TermsFacetMapTest.testRejectInvalidOverRequestBuckets
3 0.3 313 1
TermsFacetMapTest.testRejectInvalidTermPrefix
3 0.3 313 1 TermsFacetMapTest.testRejectsInvalidMethod
3 0.3 313 1
TermsFacetMapTest.testRejectsInvalidSortString
3 0.3 313 1
TermsFacetMapTest.testRejectsNegativeBucketOffset
3 0.3 313 1 TermsFacetMapTest.testSetsFacetTypeToTerm
3 0.3 313 1
TermsFacetMapTest.testStoresAllBucketsFlagWithCorrectKey
3 0.3 313 1
TermsFacetMapTest.testStoresBucketLimitWithCorrectKey
3 0.3 313 1
TermsFacetMapTest.testStoresBucketOffsetWithCorrectKey
3 0.3 313 1
TermsFacetMapTest.testStoresFieldWithCorrectKey
3 0.3 313 1
TermsFacetMapTest.testStoresMethodWithCorrectKey
3 0.3 313 1
TermsFacetMapTest.testStoresMinCountWithCorrectKey
3 0.3 313 1
TermsFacetMapTest.testStoresNumBucketsFlagWithCorrectKey
3 0.3 313 1
TermsFacetMapTest.testStoresOverRefineBucketsWithCorrectKey
3 0.3 313 1
TermsFacetMapTest.testStoresOverRequestBucketsWithCorrectKey
3 0.3 313 1
TermsFacetMapTest.testStoresRefinementFlagWithCorrectKey
3 0.3 313 1
TermsFacetMapTest.testStoresSortWithCorrectKey
3 0.3 313 1
TermsFacetMapTest.testStoresTermPrefixWithCorrectKey
3 0.3 331 1 TestCachePurging.testBackgroundPurges
3 0.6 155 1
TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader
3 0.3 319 1 TestCloudRecovery.corruptedLogTest
3 0.3 323 1
TestCloudSearcherWarming.testRepFactor1LeaderStartup
3 0.3 313 1 TestConfigSetAdminRequest.testCreate
3 0.3 313 1 TestConfigSetAdminRequest.testDelete
3 0.3 313 1 TestConfigSetAdminRequest.testNoAction
3 0.3 317 1 TestDistribIDF.testSimpleQuery
3 0.3 320 1 TestDistributedMissingSort.test
3 0.3 319 1 TestDynamicLoading.testDynamicLoading
3 0.3 323 1 TestHighlightDedupGrouping.test
3 0.6 340 2 TestIndexWriterReader.testDuringAddDelete
3 0.3 338 1
TestIndexingSequenceNumbers.testStressConcurrentCommit
3 6.7 30 2 TestInetAddressRangeQueries.testRandomBig
3 7.7 26 2
TestLucene80DocValuesFormat.testTermsEnumRandomMany
3 0.3 320 1
TestMiniSolrCloudClusterSSL.testSslWithCheckPeerName
3 1.3 315 4
TestModelManagerPersistence.testFilePersistence
3 1.6 316 5
TestModelManagerPersistence.testWrapperModelPersistence
3 0.3 342 1 TestPackedInts.testPackedLongValues
3 3.2 342 11
TestRandomChains.testRandomChainsWithLargeStrings
3 0.3 318 1
TestRandomFlRTGCloud.testRandomizedUpdatesAndRTGs
3 0.3 319 1
TestSegmentSorting.testSegmentTerminateEarly
3 0.3 324 1
TestSkipOverseerOperations.testSkipLeaderOperations
3 0.3 319 1 TestSolrCLIRunExample.testSchemalessExample
3 0.6 314 2 TestSolrJsonWriter.test
3 0.3 313 1 TestSolrProperties.testProperties
3 0.3 319 1 TestTlogReplica.testAddDocs
3 0.3 319 1 TestTlogReplica.testBasicLeaderElection
3 0.3 638 2 TestTlogReplica.testCreateDelete
3 0.3 319 1 TestTlogReplica.testKillLeader
3 0.3 319 1
TestTlogReplica.testOutOfOrderDBQWithInPlaceUpdates
3 0.3 319 1 TestTlogReplica.testRealTimeGet
3 0.3 319 1 TestTlogReplica.testRecovery
3 0.3 313 1 TestZkConfigManager.testConstants
3 0.3 313 1 TestZkConfigManager.testUploadConfig
3 0.3 313 1 TestZkConfigManager.testUploadWithACL
3 0.3 322 1 ZkCLITest.testPutFile
***********************Annotations report
Number of AwaitsFix: 41 Number of BadApples: 6
*****************AwaitsFix Annotations:
************Lucene AwaitsFix
TestControlledRealTimeReopenThread.testCRTReopen
@AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-5737";)
TestICUNormalizer2CharFilter.testRandomStrings
@AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-5595";)
TestICUTokenizerCJK.TestICUTokenizerCJK suite
@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/LUCENE-8222";)
TestMoreLikeThis.testMultiFieldShouldReturnPerFieldBooleanQuery
@AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-7161";)
************Solr AwaitsFix
AutoAddReplicasIntegrationTest.testRapidStopStartStopWithPropChange
@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13811";)
CdcrBidirectionalTest.testBiDir
@AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-12524";)
CdcrBootstrapTest.testBootstrapWithContinousIndexingOnSourceCluster
@AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-12028";)
CollectionsAPISolrJTest.testCreateAndDeleteShard
@AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-13021";)
ComputePlanActionTest.testNodeLost
@LuceneTestCase.AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)
ConcurrentCreateRoutedAliasTest.ConcurrentCreateRoutedAliasTest suite
@LuceneTestCase.AwaitsFix(bugUrl =
"https://issues.apache.org/jira/browse/SOLR-12386";) // "Can't find resource"
LeaderTragicEventTest.LeaderTragicEventTest suite
@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13237";)
MoveReplicaHDFSTest.MoveReplicaHDFSTest suite
@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13924";)
MoveReplicaHDFSTest.testFailedMove
@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12080";) //
added 03-Oct-2018
ReplaceNodeNoTargetTest.ReplaceNodeNoTargetTest suite
@LuceneTestCase.AwaitsFix(bugUrl =
"https://issues.apache.org/jira/browse/SOLR-11067";)
ReplaceNodeNoTargetTest.test
@LuceneTestCase.AwaitsFix(bugUrl =
"https://issues.apache.org/jira/browse/SOLR-11067";)
RoutedAliasUpdateProcessorTest.alias,
@org.apache.lucene.util.LuceneTestCase.AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13696";)
SSLMigrationTest.SSLMigrationTest suite
@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) //
17-Mar-2018
SaslZkACLProviderTest.testSaslZkACLProvider
@AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-13075";)
ScheduledMaintenanceTriggerTest.testInactiveShardCleanup
@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) //
17-Mar-2018
ScheduledTriggerTest.testTrigger
@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) //
added 20-Sep-2018
SearchRateTriggerIntegrationTest.testDeleteNode
@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13163";)
SearchRateTriggerTest.testTrigger
@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)
SolrExporterIntegrationTest.SolrExporterIntegrationTest suite
@org.apache.lucene.util.LuceneTestCase.AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13786";)
Tagger2Test.testStopWords
@AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-8344";)
TestHierarchicalDocBuilder.testThreeLevelHierarchy
@AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-12801";) //
this test fails easily under beasting
TestImpersonationWithHadoopAuth.testForwarding
@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/HADOOP-9893";)
TestJsonFacetRefinement.testProcessEmptyRefinement
@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12556";)
TestJsonFacetRefinement.testSortedSubFacetRefinementWhenParentOnlyReturnedByOneShardProcessEmpty
@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12556";)
TestLTRReRankingPipeline.testDifferentTopN
@AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-11134";)
TestMinMaxOnMultiValuedField.testDoubleFieldCache
@AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-6709";)
TestMinMaxOnMultiValuedField.testFloatFieldCache
@AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-6709";)
TestMinMaxOnMultiValuedField.testIntFieldCache
@AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-6709";)
TestMinMaxOnMultiValuedField.testLongFieldCache
@AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-6709";)
TestPullReplica.TestPullReplica suite
@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)
TestSimComputePlanAction.testNodeLost
@AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-12028";) //
if you beast this, eventually you will see
TestSimExtremeIndexing.TestSimExtremeIndexing suite
@org.apache.lucene.util.LuceneTestCase.AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12923";)
TestSimLargeCluster.testBasic
@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) //
this test hits a timeout easily
TestStressRecovery.TestStressRecovery suite
@LuceneTestCase.AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)
// 6-Sep-2018
TestTlogReplayVsRecovery.TestTlogReplayVsRecovery suite
@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13486;https://issues.apache.org/jira/browse/SOLR-14183";)
TimeRoutedAliasUpdateProcessorTest.testDateMathInStart
@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13943";)
TriLevelCompositeIdRoutingTest.test
@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13369";)
*****************BadApple Annotations:
************Lucene BadApple
************Solr BadApple
MoveReplicaHDFSTest.testNormalFailedMove
@BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) //
14-Oct-2018
MultiThreadedOCPTest.test
@BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) //
annotated on: 24-Dec-2018
SharedFSAutoReplicaFailoverTest.SharedFSAutoReplicaFailoverTest suite
@LuceneTestCase.BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)
// added 20-Jul-2018
SolrZkClientTest.testSimpleUpdateACLs
@BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) //
annotated on: 24-Dec-2018
TimeRoutedAliasUpdateProcessorTest.TimeRoutedAliasUpdateProcessorTest suite
@LuceneTestCase.BadApple(bugUrl =
"https://issues.apache.org/jira/browse/SOLR-13059";)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
