Failures in each of the last 4 reports..
   Report   Pct     runs    fails           test
     0123   0.3     1384     11      AutoScalingHandlerTest.testReadApi
     0123   0.3     1402      8      HttpPartitionTest.test
     0123   0.3     1393     11      HttpPartitionWithTlogReplicasTest.test
     0123   0.3     1395      7      
LeaderElectionIntegrationTest.testSimpleSliceLeaderElection
     0123   1.0     1417     12      LeaderFailoverAfterPartitionTest.test
     0123   0.5     1395      8      LeaderVoteWaitTimeoutTest.basicTest
     0123   1.0     1402     30      
LegacyCloudClusterPropTest.testCreateCollectionSwitchLegacyCloud
     0123   0.5     1395     14      RollingRestartTest.test
     0123   0.5     1394      7      SyncSliceTest.test
     0123   1.0     1422     19      SystemCollectionCompatTest.testBackCompat
     0123   0.9     1455      8      TestBagOfPositions.test
     0123   0.9     1464     12      TestBagOfPostings.test
     0123   8.3      938     57      TestFuzzyQuery.testErrorMessage
     0123   0.2     1456      5      
TestLucene80DocValuesFormat.testSparseDocValuesVsStoredFields
     0123   0.5     1396      8      
TestQueryingOnDownCollection.testQueryToDownCollectionShouldFailFast
     0123   0.2     1465      5      
TestSearcherManager.testConcurrentIndexCloseSearchAndRefresh
     0123   1.0     1456     28      TestStressLiveNodes.testStress

Not actively annotating at this point. Full list attached.


DO NOT ENABLE LIST:
    MoveReplicaHDFSTest.testFailedMove
    MoveReplicaHDFSTest.testNormalFailedMove
    TestControlledRealTimeReopenThread.testCRTReopen
    TestICUNormalizer2CharFilter.testRandomStrings
    TestICUTokenizerCJK
    TestImpersonationWithHadoopAuth.testForwarding
    TestLTRReRankingPipeline.testDifferentTopN
    TestRandomChains


DO NOT ANNOTATE LIST
    CdcrBidirectionalTest.testBiDir
    IndexSizeTriggerTest.testMergeIntegration
    IndexSizeTriggerTest.testMixedBounds
    IndexSizeTriggerTest.testSplitIntegration
    IndexSizeTriggerTest.testTrigger
    InfixSuggestersTest.testShutdownDuringBuild
    ShardSplitTest.test
    ShardSplitTest.testSplitMixedReplicaTypes
    ShardSplitTest.testSplitWithChaosMonkey
    Test2BPostings.test
    TestLatLonShapeQueries.testRandomBig
    TestPackedInts.testPackedLongValues
    TestRandomChains.testRandomChainsWithLargeStrings
    TestTriggerIntegration.testSearchRate

Processing file (History bit 3): HOSS-2020-01-20.csv
Processing file (History bit 2): HOSS-2020-01-13.csv
Processing file (History bit 1): HOSS-2020-01-06.csv
Processing file (History bit 0): HOSS-2019-12-30.csv


Number of AwaitsFix: 41 Number of BadApples: 6


Raw fail count by week totals, most recent week first (corresponds to bits):
Week: 0  had  191 failures
Week: 1  had  118 failures
Week: 2  had  298 failures
Week: 3  had  84 failures


**Annotated tests that didn't fail in the last 4 weeks.

  **Tests removed from the next two lists because they were specified in 
'doNotEnable' in the properties file
     MoveReplicaHDFSTest.testNormalFailedMove

  **Annotations will be removed from the following tests because they haven't 
failed in the last 4 rollups.

  **Methods: 2
   MultiThreadedOCPTest.test
   SolrZkClientTest.testSimpleUpdateACLs


********Failures in Hoss' reports for the last 4 rollups.

There were 533 unannotated tests that failed in Hoss' rollups. Ordered by the 
date I downloaded the rollup file, newest->oldest. See above for the dates the 
files were collected 
These tests were NOT BadApple'd or AwaitsFix'd
All tests that failed 4 weeks running will be BadApple'd unless there are 
objections

Failures in the last 4 reports..
   Report   Pct     runs    fails           test
     0123   0.3     1384     11      AutoScalingHandlerTest.testReadApi
     0123   0.3     1402      8      HttpPartitionTest.test
     0123   0.3     1393     11      HttpPartitionWithTlogReplicasTest.test
     0123   0.3     1395      7      
LeaderElectionIntegrationTest.testSimpleSliceLeaderElection
     0123   1.0     1417     12      LeaderFailoverAfterPartitionTest.test
     0123   0.5     1395      8      LeaderVoteWaitTimeoutTest.basicTest
     0123   1.0     1402     30      
LegacyCloudClusterPropTest.testCreateCollectionSwitchLegacyCloud
     0123   0.5     1395     14      RollingRestartTest.test
     0123   0.5     1394      7      SyncSliceTest.test
     0123   1.0     1422     19      SystemCollectionCompatTest.testBackCompat
     0123  16.0      118     25      Test2BPostings.test
     0123   0.9     1455      8      TestBagOfPositions.test
     0123   0.9     1464     12      TestBagOfPostings.test
     0123   8.3      938     57      TestFuzzyQuery.testErrorMessage
     0123   0.2     1456      5      
TestLucene80DocValuesFormat.testSparseDocValuesVsStoredFields
     0123   0.5     1396      8      
TestQueryingOnDownCollection.testQueryToDownCollectionShouldFailFast
     0123   0.2     1465      5      
TestSearcherManager.testConcurrentIndexCloseSearchAndRefresh
     0123   1.0     1456     28      TestStressLiveNodes.testStress
************ Will BadApple all tests above this line except ones listed at the 
top**************



     012    2.9     1106     42      BasicDistributedZkTest.test
     012    0.3     1073      3      ChaosMonkeyNothingIsSafeTest.test
     012    5.0       72      7      
HdfsTlogReplayBufferedWhileIndexingTest.test
     012    0.3     1073      4      
ShardSplitTest.testSplitMixedReplicaTypesLink
     012    0.3      915      3      
TestDelegationWithHadoopAuth.testDelegationTokenRenew
     01 3  12.5       80      4      
DimensionalRoutedAliasUpdateProcessorTest.testCatTime
     01 3  12.5       80      5      
DimensionalRoutedAliasUpdateProcessorTest.testTimeCat
     01 3   0.8     1062      5      TestCloudSchemaless.test
     01     0.3      753      2      
CollectionsAPISolrJTest.testCreateCollWithDefaultClusterPropertiesOldFormat
     01    20.0       59     11      HdfsSyncSliceTest.test
     01     0.3      750      2      
IndexSizeTriggerMixedBoundsTest.testMixedBounds
     01     0.5      758      3      
MetricsHistoryWithAuthIntegrationTest.testValuesAreCollected
     01     0.5      748      3      ShardSplitTest.testSplitShardWithRule
     01     0.5      754      3      TestCryptoKeys.test
     01     0.3      688      2      
TestMiniSolrCloudClusterSSL.testSslAndClientAuth
     01     0.2      762      2      
TestSimpleTextTermVectorsFormat.testRamBytesUsed
     01     3.2      772     19      
TestXYMultiPolygonShapeQueries.testRandomMedium
     0 23   0.2     1044      4      OverseerRolesTest.testOverseerRole
     0 23   0.5     1029      5      TestPackages.testPluginLoading
     0 23  10.0      126     49      
TestXYMultiPolygonShapeQueries.testRandomBig
     0 2    0.3      710      2      CustomHighlightComponentTest.test
     0 2    0.3      716      2      TestDistributedSearch.test
     0 2    8.7       50      3      TestDuelingCodecsAtNight.testBigEquals
     0 2    0.3      713      2      TestLockTree.testLocks
     0 2    0.3      713      2      TestMiniSolrCloudClusterSSL.testNoSsl
     0 2    0.3      712      2      TestNamedUpdateProcessors.test
     0 2    0.3      716      2      TestReplicaProperties.test
     0 2    0.3      711      2      
TestSegmentSorting.testAtomicUpdateOfSegmentSortField
     0 2    0.4      442      2      TestSolrCachePerf.testGetPutCompute
     0 2    0.3      723      3      
TestSolrCloudWithDelegationTokens.testDelegationTokenRenew
     0  3   0.3      706      2      
ChaosMonkeySafeLeaderWithPullReplicasTest.test
     0  3   0.3      706      2      
CollectionsAPIAsyncDistributedZkTest.testAsyncRequests
     0  3   4.8       60      2      HdfsChaosMonkeyNothingIsSafeTest.test
     0  3   5.0       44      3      HdfsWriteToMultipleCollectionsTest.test
     0  3   0.3      718      5      
MissingSegmentRecoveryTest.testLeaderRecovery
     0  3   5.0       54      2      ShardSplitTest.testSplitWithChaosMonkey
     0  3   0.2      756      2      
TestLucene80DocValuesFormat.testRandomAdvanceNumeric
     0      0.3      394      1      
ActionThrottleTest.testAZeroNanoTimeReturnInWait
     0      0.3      394      1      
AutoScalingHandlerTest.testConcurrentUpdates
     0      0.3      379      1      
CloudSolrClientTest.testRetryUpdatesWhenClusterStateIsStale
     0      0.3      398      1      
CollectionsAPISolrJTest.testCreateWithDefaultConfigSet
     0      0.3      394      1      ComputePlanActionTest.testNodeAdded
     0      0.3      393      1      DeleteNodeTest.test
     0      0.3      398      1      ExecutePlanActionTest.testTaskTimeout
     0     27.2      290     79      FuzzySearchTest.testTooComplex
     0      0.3      398      1      LeaderElectionTest.testCancelElection
     0      0.3      380      1      MathExpressionTest.testZipFDistribution
     0      0.3      392      1      MetricsHistoryIntegrationTest.testGet
     0      0.3      398      1      
MigrateRouteKeyTest.multipleShardMigrateTest
     0      0.3      394      1      MoveReplicaTest.test
     0      0.3      398      1      OverseerModifyCollectionTest.testModifyColl
     0      0.3      395      1      
ScheduledTriggerIntegrationTest.testScheduledTrigger
     0      0.3      395      1      SearchRateTriggerTest.testWaitForElapsed
     0      0.3      380      1      StreamDecoratorTest.testExecutorStream
     0      0.2      427      1      TermInSetQueryTest.testDuel
     0      0.2      431      1      TestAddIndexes.testFakeAllDeleted
     0      0.2      431      1      TestAddIndexes.testNoMergeAfterCopy
     0      0.5      431      2      TestAddIndexes.testWithPendingDeletes
     0      0.2      427      1      TestAtomicUpdate.testAtomicUpdates
     0      0.3      391      1      TestCloudNestedDocsSort.test
     0      0.3      391      1      
TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete
     0      0.2      429      1      
TestConcurrentMergeScheduler.testFlushExceptions
     0      0.2      425      1      
TestCrashCausesCorruptIndex.testCrashCorruptsIndexing
     0      1.4      433      6      TestDemo.testDemo
     0      0.7      432      3      TestDirectoryReader.testFilesOpenClose
     0      0.5      393      2      TestDistributedGrouping.test
     0      0.2      429      1      
TestDocValuesQueries.testDuelPointRangeMultivaluedSortedSetRangeQuery
     0      0.7      429      3      
TestDocValuesQueries.testDuelPointRangeSortedRangeQuery
     0      0.2      423      1      TestDuelingCodecs.testCrazyReaderEquals
     0      0.2      423      1      TestDuelingCodecs.testEquals
     0      0.2      428      1      TestField.testIndexedBinaryField
     0      0.2      429      1      TestFieldValueQuery.testApproximation
     0      0.2      429      1      TestFieldValueQuery.testScore
     0      0.7      431      3      
TestGraphTokenizers.testMockGraphTokenFilterBeforeHolesRandom
     0      0.3      391      1      TestInPlaceUpdatesDistrib.test
     0      0.2      427      1      
TestIndexFileDeleter.testVirusScannerDoesntCorruptIndex
     0      0.2      428      1      TestIndexManyDocuments.test
     0      0.2      422      1      TestIndexSorting.testRandom3
     0      0.2      426      1      TestIndexWriterDelete.testDeleteAllNRT
     0      0.2      425      1      
TestIndexWriterExceptions.testRandomExceptionDuringRollback
     0      0.2      430      1      
TestIndexWriterWithThreads.testIOExceptionDuringWriteSegmentWithThreadsOnlyOnce
     0      0.3      400      1      TestInputIterator.testTerms
     0      0.3      395      1      TestLazyCores.testLazyLoad
     0      0.2      426      1      
TestLucene50StoredFieldsFormat.testMultiClose
     0      0.2      426      1      TestLucene60PointsFormat.testMultiClose
     0      0.2      426      1      TestLucene60PointsFormat.testWithExceptions
     0      0.6      181      1      
TestLucene70DocValuesFormat.testTermsEnumVariableWidth
     0      0.2      428      1      TestLucene70SegmentInfoFormat.testRandom
     0      0.2      424      1      
TestLucene80NormsFormatMergeInstance.testUndeadNorms
     0      0.5      405      2      
TestLucene84PostingsFormat.testDisableFSTOffHeap
     0      0.2      427      1      TestLucene84PostingsFormat.testDocsAndFreqs
     0      0.2      427      1      
TestLucene84PostingsFormat.testDocsAndFreqsAndPositionsAndOffsets
     0      0.2      427      1      
TestLucene84PostingsFormat.testDocsAndFreqsAndPositionsAndOffsetsAndPayloads
     0      0.5      427      2      
TestLucene84PostingsFormat.testDocsAndFreqsAndPositionsAndPayloads
     0      0.5      427      2      TestLucene84PostingsFormat.testDocsOnly
     0      0.5      405      2      TestLucene84PostingsFormat.testFstOffHeap
     0      0.2      427      1      
TestLucene84PostingsFormat.testPostingsEnumReuse
     0      0.5      427      2      TestLucene84PostingsFormat.testRandom
     0      0.2      425      1      TestNRTThreads.testNRTThreads
     0      0.2      429      1      TestNeverDelete.testIndexing
     0      0.5      424      2      TestOfflineSorter.testThreadSafety
     0      0.2      427      1      TestOmitNorms.testOmitNormsCombos
     0      0.2      425      1      TestPerFieldDocValuesFormat.testMultiClose
     0      0.2      425      1      
TestPerFieldDocValuesFormat.testRandomSortedBytes
     0      0.5      425      2      
TestPerFieldDocValuesFormat.testSortedFixedLengthVsStoredFields
     0      0.2      425      1      
TestPerFieldDocValuesFormat.testSortedSetFixedLengthFewUniqueSetsVsStoredFields
     0      0.2      425      1      
TestPerFieldDocValuesFormat.testSortedSetFixedLengthManyValuesPerDocVsStoredFields
     0      0.2      425      1      
TestPerFieldDocValuesFormat.testSortedSetFixedLengthSingleValuedVsStoredFields
     0      0.2      425      1      
TestPerFieldDocValuesFormat.testSortedSetFixedLengthVsStoredFields
     0      0.5      425      2      
TestPerFieldDocValuesFormat.testSortedSetVariableLengthManyValuesPerDocVsStoredFields
     0      0.2      425      1      
TestPerFieldDocValuesFormat.testSortedSetVariableLengthSingleValuedVsStoredFields
     0      0.5      425      2      
TestPerFieldDocValuesFormat.testSortedVariableLengthVsStoredFields
     0      0.2      425      1      
TestPerFieldDocValuesFormat.testSparseSortedFixedLengthVsStoredFields
     0      0.2      421      1      
TestPerFieldPostingsFormat.testDocsAndFreqsAndPositionsAndOffsetsAndPayloads
     0      0.2      421      1      TestPerFieldPostingsFormat.testDocsOnly
     0      0.2      421      1      TestPerFieldPostingsFormat.testMultiClose
     0      0.2      421      1      TestPerFieldPostingsFormat.testRandom
     0      2.7      406     11      TestPointFields.testDoublePointStats
     0      1.9      428      8      TestReadOnlyIndex.testReadOnlyIndex
     0      0.5      428      2      TestShardSearching.testSimple
     0      0.3      398      1      TestSimScenario.testAutoAddReplicas
     0      0.3      398      1      TestSimScenario.testSuggestions
     0      0.3      393      1      
TestSkipOverseerOperations.testSkipDownOperations
     0      0.3      391      1      
TestSolrCLIRunExample.testInteractiveSolrCloudExampleWithAutoScalingPolicy
     0      0.8      393      3      TestSolrConfigHandlerCloud.test
     0      0.2      428      1      
TestStressIndexing.testStressIndexAndSearching
     0      0.3      396      1      TestTlogReplica.testRemoveLeader
     0      0.3      394      1      TestWithCollection.testAddReplicaSimple
     0      0.3      394      1      TriggerCooldownIntegrationTest.testCooldown
     0      0.3      395      1      
TriggerSetPropertiesIntegrationTest.testSetProperties
      123   0.6      990      5      
AutoScalingHandlerTest.testSuggestionsWithPayload
      123   0.6      991      5      
CollectionsAPISolrJTest.testCreateCollWithDefaultClusterPropertiesNewFormat
      123   0.6      989      4      TestRestoreCore.testFailedRestore
      12    0.3      671      2      CreateRoutedAliasTest.testV2
      12   32.4       63     12      HdfsBasicDistributedZk2Test.test
      12    0.3      603      2      OverseerTest.testShardLeaderChange
      12    0.3      672      2      
PingRequestHandlerTest.testPingInClusterWithNoHealthCheck
      12    0.3      671      2      
SchemaApiFailureTest.testAddTheSameFieldTwice
      12    7.4       58      8      StressHdfsTest.test
      12    0.3      669      2      TestDynamicFieldNamesIndexCorrectly.test
      12    0.3      702      2      
TestLucene80DocValuesFormat.testSortedNumericBlocksOfVariousBitsPerValue
      1 3  13.3       63      5      HdfsBasicDistributedZkTest.test
      1 3   0.9      664      7      TestJaegerConfigurator.testInjected
      1 3   0.3      699      2      
TestLucene80DocValuesFormat.testNumericFieldJumpTables
      1     0.3      351      1      CloudMLTQParserTest.testMLTQParser
      1     0.3      352      1      
ComputePlanActionTest.testNodeLostTriggerWithDeleteNodePreferredOp
      1     0.3      351      1      
CreateRoutedAliasTest.testCollectionNamesMustBeAbsent
      1     0.3      351      1      
CreateRoutedAliasTest.testTimeStampWithMsFails
      1     0.3      351      1      
CreateRoutedAliasTest.testTimezoneAbsoluteDate
      1     0.3      351      1      
CustomCollectionTest.testCustomCollectionsAPI
      1     0.3      351      1      
CustomCollectionTest.testRouteFieldForHashRouter
      1     0.3      351      1      
CustomCollectionTest.testRouteFieldForImplicitRouter
      1     0.3      352      1      DeleteShardTest.test
      1     1.1      351      4      
DocValuesTest.testFloatAndDoubleRangeQueryRandom
      1    15.0      419     63      
EmbeddedSolrNoSerializeTest.testAssertTagStreamingWithSolrTaggerRequest
      1    15.0      419     63      EmbeddedSolrNoSerializeTest.testSearch
      1    15.0      419     63      EmbeddedSolrNoSerializeTest.testTag
      1     0.3      335      1      
FullSolrCloudDistribCmdsTest.testBasicUpdates
      1     0.3      335      1      
FullSolrCloudDistribCmdsTest.testConcurrentIndexing
      1     0.3      335      1      
FullSolrCloudDistribCmdsTest.testIndexQueryDeleteHierarchical
      1     0.3      335      1      
FullSolrCloudDistribCmdsTest.testIndexingBatchPerRequestWithHttpSolrClient
      1     0.3      335      1      
FullSolrCloudDistribCmdsTest.testIndexingOneDocPerRequestWithHttpSolrClient
      1    15.4     4173    643      RandomizedTaggerTest.test
      1     0.3      356      1      ReindexCollectionTest.testFailure
      1     0.3      356      1      
ReindexCollectionTest.testSameTargetReindexing
      1     0.3      350      1      SearchHandlerTest.testRequireZkConnected
      1     0.3      350      1      ShardRoutingTest.test
      1     0.3      350      1      ShardSplitTest.testSplitMixedReplicaTypes
      1     0.3      350      1      
ShardSplitTest.testSplitStaticIndexReplicationLink
      1     0.9      352      3      
SolrCloudExampleTest.testLoadDocsIntoGettingStartedCollection
      1    16.1      416     67      Tagger2Test.testLongestDominantRight
      1    15.9      415     66      Tagger2Test.testMultibyteChar
      1    16.1      416     67      Tagger2Test.testWDF
      1    16.4      420     69      TaggerTest.testFormat
      1    16.4      420     69      TaggerTest.testFormatMatchText
      1    16.4      420     69      TaggerTest.testMultipleFilterQueries
      1    16.4      420     69      TaggerTest.testSubTags
      1    16.4      420     69      TaggerTest.testWholeMatching
      1    14.9      410     61      TaggingAttributeTest.testTaggingAttribute
      1     0.3      352      1      TestConfigReload.test
      1     3.0      363     11      
TestDistributedStatsComponentCardinality.test
      1     4.2       24      1      TestDuelingCodecsAtNight.testEquals
      1     0.4      231      1      TestExactStatsCacheCloud.testBasicStats
      1     0.3      347      1      TestLBHttpSolrClient.testSimple
      1     0.3      370      1      
TestLucene50TermVectorsFormat.testRamBytesUsed
      1     0.3      367      1      
TestLucene80DocValuesFormat.testSparseBinaryFixedLengthVsStoredFields
      1     0.3      365      1      
TestLucene80DocValuesFormat.testSparseSortedNumericBlocksOfVariousBitsPerValue
      1     3.0      368     11      TestPhraseWildcardQuery.testExplain
      1     0.3      353      1      
TestPullReplicaErrorHandling.testPullReplicaDisconnectsFromZooKeeper
      1     0.3      351      1      TestRandomDVFaceting.testRandomFaceting
      1     0.3      353      1      TestRecovery.stressLogReplay
      1     0.3      353      1      
TestRequestForwarding.testMultiCollectionQuery
      1    15.8      419     66      XmlInterpolationTest.test
      1     7.9      419     33      XmlInterpolationTest.testInvalidXml
       23   3.6      644     17      BasicAuthIntegrationTest.testBasicAuth
       23   3.6       56      2      HdfsRestartWhileUpdatingTest.test
       23   0.6      184      2      
TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader
       23   0.3      633      2      TestCloudRecovery.corruptedLogTest
       23   0.3      648     13      
TestCloudSearcherWarming.testRepFactor1LeaderStartup
       23   0.3      633      2      TestDynamicLoading.testDynamicLoading
       23   0.6      673      3      TestIndexWriterReader.testDuringAddDelete
       23   0.3      670      2      
TestIndexingSequenceNumbers.testStressConcurrentCommit
       23   1.3      639     23      
TestModelManagerPersistence.testFilePersistence
       23   1.6      638     22      
TestModelManagerPersistence.testWrapperModelPersistence
       23   0.3      669      2      TestPackedInts.testPackedLongValues
       23   0.3      640      3      
TestSkipOverseerOperations.testSkipLeaderOperations
       2    0.3      320      1      AddReplicaTest.testAddMultipleReplicas
       2    0.6      327      2      AnalysisImplTest.testGetPresetAnalyzerTypes
       2    0.3      323      1      AssignBackwardCompatibilityTest.test
       2    0.3      321      1      AutoscalingHistoryHandlerTest.testHistory
       2    0.3      321      1      BasicDistributedZk2Test.test
       2    0.3      318      1      
CollectionsAPIDistributedZkTest.testCreateNodeSet
       2    0.3      322      1      CollectionsAPISolrJTest.testColStatus
       2    0.3      298      1      CommitsImplTest.testGetCommit
       2    0.3      298      1      
CommitsImplTest.testGetCommit_generation_notfound
       2    0.3      298      1      CommitsImplTest.testGetFiles
       2    0.3      298      1      
CommitsImplTest.testGetFiles_generation_notfound
       2    0.3      298      1      CommitsImplTest.testGetSegmentAttributes
       2    0.3      298      1      
CommitsImplTest.testGetSegmentAttributes_generation_notfound
       2    0.3      298      1      
CommitsImplTest.testGetSegmentAttributes_invalid_name
       2    0.3      298      1      CommitsImplTest.testGetSegmentDiagnostics
       2    0.3      298      1      
CommitsImplTest.testGetSegmentDiagnostics_generation_notfound
       2    0.3      298      1      
CommitsImplTest.testGetSegmentDiagnostics_invalid_name
       2    0.3      298      1      CommitsImplTest.testGetSegments
       2    0.3      298      1      
CommitsImplTest.testGetSegments_generation_notfound
       2    0.3      298      1      CommitsImplTest.testListCommits
       2    0.3      298      1      CommitsImplTest.testSegmentCodec
       2    0.3      298      1      
CommitsImplTest.testSegmentCodec_generation_notfound
       2    0.3      298      1      
CommitsImplTest.testSegmentCodec_invalid_name
       2    0.3      334      1      
ConfusionMatrixGeneratorTest.testGetConfusionMatrixWithCNB
       2    0.3      334      1      
ConfusionMatrixGeneratorTest.testGetConfusionMatrixWithSNB
       2    0.3      321      1      DistributedIntervalFacetingTest.test
       2    0.3      318      1      DistributedSpellCheckComponentTest.test
       2    0.6      327      2      
DocValuesAdapterTest.testGetDocValues_binary
       2    0.6      327      2      
DocValuesAdapterTest.testGetDocValues_notAvailable
       2    0.6      327      2      
DocValuesAdapterTest.testGetDocValues_numeric
       2    0.6      327      2      
DocValuesAdapterTest.testGetDocValues_sorted
       2    0.6      327      2      
DocValuesAdapterTest.testGetDocValues_sorted_numeric
       2    0.6      327      2      
DocValuesAdapterTest.testGetDocValues_sorted_set
       2    0.7      303      2      DocumentsImplTest.testClose
       2    0.7      303      2      DocumentsImplTest.testFirstTerm
       2    0.7      303      2      DocumentsImplTest.testFirstTermDoc
       2    0.7      303      2      
DocumentsImplTest.testFirstTermDoc_unPositioned
       2    0.7      303      2      
DocumentsImplTest.testFirstTerm_notAvailable
       2    0.7      303      2      DocumentsImplTest.testGetDocumentFields
       2    0.7      303      2      DocumentsImplTest.testGetMaxDoc
       2    0.7      303      2      DocumentsImplTest.testIsLive
       2    0.7      303      2      DocumentsImplTest.testNextTerm
       2    0.7      303      2      DocumentsImplTest.testNextTermDoc
       2    0.7      303      2      
DocumentsImplTest.testNextTermDoc_unPositioned
       2    0.7      303      2      DocumentsImplTest.testNextTerm_unPositioned
       2    0.7      303      2      DocumentsImplTest.testSeekTerm
       2    0.7      303      2      DocumentsImplTest.testSeekTerm_unPositioned
       2    0.7      303      2      DocumentsImplTest.testTermPositions
       2    0.7      303      2      
DocumentsImplTest.testTermPositions_noPositions
       2    0.7      303      2      
DocumentsImplTest.testTermPositions_unPositioned
       2    0.3      320      1      HttpPartitionOnCommitTest.test
       2    0.3      322      1      IndexSizeTriggerTest.testMergeIntegration
       2    0.3      326      1      
LeaderVoteWaitTimeoutTest.testMostInSyncReplicasCanWinElection
       2    0.3      313      1      
MergeIndexesEmbeddedTest.testMergeIndexesByCoreName
       2    0.3      313      1      
MergeIndexesEmbeddedTest.testMergeIndexesByDirName
       2    0.3      313      1      
MergeIndexesEmbeddedTest.testMergeMultipleRequest
       2    0.6      327      2      OverviewImplTest.testClose
       2    0.6      327      2      OverviewImplTest.testGetCommitDescription
       2    0.6      327      2      OverviewImplTest.testGetCommitUserData
       2    0.6      327      2      OverviewImplTest.testGetDirImpl
       2    0.6      327      2      OverviewImplTest.testGetFieldNames
       2    0.6      327      2      OverviewImplTest.testGetIndexFormat
       2    0.6      327      2      OverviewImplTest.testGetIndexPath
       2    0.6      327      2      OverviewImplTest.testGetIndexVersion
       2    0.6      327      2      OverviewImplTest.testGetNumDeletedDocs
       2    0.6      327      2      OverviewImplTest.testGetNumDocuments
       2    0.6      327      2      OverviewImplTest.testGetNumFields
       2    0.6      327      2      OverviewImplTest.testGetNumTerms
       2    0.6      327      2      OverviewImplTest.testGetSortedTermCounts
       2    0.6      327      2      OverviewImplTest.testGetTopTerms
       2    0.6      327      2      
OverviewImplTest.testGetTopTerms_illegal_numterms
       2    0.6      327      2      OverviewImplTest.testHasDeletions
       2    0.6      327      2      OverviewImplTest.testIsOptimized
       2    0.3      323      1      PeerSyncTest.test
       2    0.3      313      1      
SchemaTest.addDynamicFieldShouldntBeCalledTwiceWithTheSameName
       2    0.3      313      1      
SchemaTest.addFieldShouldntBeCalledTwiceWithTheSameName
       2    0.3      313      1      
SchemaTest.addFieldTypeShouldntBeCalledTwiceWithTheSameName
       2    0.3      313      1      
SchemaTest.addFieldTypeWithAnalyzerClassAccuracy
       2    0.3      313      1      
SchemaTest.addFieldTypeWithSimilarityAccuracy
       2    0.3      313      1      
SchemaTest.copyFieldsShouldFailWhenOneOfTheFieldsDoesntExistInTheSchema
       2    0.3      313      1      
SchemaTest.deleteCopyFieldShouldFailWhenOneOfTheFieldsDoesntExistInTheSchema
       2    0.3      313      1      
SchemaTest.deletingADynamicFieldThatDoesntExistInTheSchemaShouldFail
       2    0.3      313      1      
SchemaTest.deletingAFieldThatDoesntExistInTheSchemaShouldFail
       2    0.3      313      1      
SchemaTest.deletingAFieldTypeThatDoesntExistInTheSchemaShouldFail
       2    0.3      313      1      SchemaTest.testAddDynamicFieldAccuracy
       2    0.3      313      1      SchemaTest.testAddFieldAccuracy
       2    0.3      313      1      SchemaTest.testAddFieldTypeAccuracy
       2    0.3      313      1      SchemaTest.testCopyFieldAccuracy
       2    0.3      313      1      
SchemaTest.testCopyFieldWithMaxCharsAccuracy
       2    0.3      313      1      SchemaTest.testDeleteCopyFieldAccuracy
       2    0.3      313      1      SchemaTest.testDeleteDynamicFieldAccuracy
       2    0.3      313      1      SchemaTest.testDeleteFieldAccuracy
       2    0.3      313      1      SchemaTest.testDeleteFieldTypeAccuracy
       2    0.3      313      1      SchemaTest.testGetCopyFieldsAccuracy
       2    0.3      313      1      SchemaTest.testGetDynamicFieldAccuracy
       2    0.3      313      1      SchemaTest.testGetDynamicFieldsAccuracy
       2    0.3      313      1      SchemaTest.testGetFieldAccuracy
       2    0.3      313      1      SchemaTest.testGetFieldTypeAccuracy
       2    0.3      313      1      SchemaTest.testGetFieldTypesAccuracy
       2    0.3      313      1      SchemaTest.testGetFieldsAccuracy
       2    0.3      313      1      SchemaTest.testGetGlobalSimilarityAccuracy
       2    0.3      313      1      SchemaTest.testGetUniqueKeyAccuracy
       2    0.3      313      1      
SchemaTest.testMultipleUpdateRequestAccuracy
       2    0.3      313      1      SchemaTest.testReplaceDynamicFieldAccuracy
       2    0.3      313      1      SchemaTest.testReplaceFieldAccuracy
       2    0.3      313      1      SchemaTest.testReplaceFieldTypeAccuracy
       2    0.3      313      1      SchemaTest.testSchemaNameRequestAccuracy
       2    0.3      313      1      SchemaTest.testSchemaRequestAccuracy
       2    0.3      313      1      SchemaTest.testSchemaVersionRequestAccuracy
       2    0.6      327      2      
SearchImplTest.testGetRangeSearchableFieldNames
       2    0.6      327      2      SearchImplTest.testGetSearchableFieldNames
       2    0.6      327      2      SearchImplTest.testGetSortType
       2    0.6      327      2      SearchImplTest.testGetSortTypeNoSuchField
       2    0.6      327      2      SearchImplTest.testGetSortableFieldNames
       2    0.6      327      2      SearchImplTest.testGuessSortTypes
       2    0.6      327      2      
SearchImplTest.testGuessSortTypesNoSuchField
       2    0.6      327      2      SearchImplTest.testNextPage
       2    0.6      327      2      SearchImplTest.testNextPageNoMoreResults
       2    0.6      327      2      SearchImplTest.testNextPageSearchNotStarted
       2    0.6      327      2      SearchImplTest.testParseClassic
       2    0.6      327      2      SearchImplTest.testParsePointRange
       2    0.6      327      2      SearchImplTest.testPrevPage
       2    0.6      327      2      SearchImplTest.testPrevPageNoMoreResults
       2    0.6      327      2      SearchImplTest.testPrevPageSearchNotStarted
       2    0.6      327      2      SearchImplTest.testSearch
       2    0.6      327      2      SearchImplTest.testSearchWithSort
       2    0.6      327      2      TermCountsTest.testNumTerms
       2    0.6      327      2      
TermCountsTest.testSortedTermCounts_count_asc
       2    0.6      327      2      
TermCountsTest.testSortedTermCounts_count_desc
       2    0.6      327      2      
TermCountsTest.testSortedTermCounts_name_asc
       2    0.6      327      2      
TermCountsTest.testSortedTermCounts_name_desc
       2    0.6      327      2      TermVectorsAdapterTest.testGetTermVector
       2    0.6      327      2      
TermVectorsAdapterTest.testGetTermVector_with_positions
       2    0.6      327      2      
TermVectorsAdapterTest.testGetTermVector_with_positions_offsets
       2    0.6      327      2      
TermVectorsAdapterTest.testGetTermVectors_notAvailable
       2    0.3      313      1      TermsFacetMapTest.testRejectInvalidMinCount
       2    0.3      313      1      
TermsFacetMapTest.testRejectInvalidOverRefineBuckets
       2    0.3      313      1      
TermsFacetMapTest.testRejectInvalidOverRequestBuckets
       2    0.3      313      1      
TermsFacetMapTest.testRejectInvalidTermPrefix
       2    0.3      313      1      TermsFacetMapTest.testRejectsInvalidMethod
       2    0.3      313      1      
TermsFacetMapTest.testRejectsInvalidSortString
       2    0.3      313      1      
TermsFacetMapTest.testRejectsNegativeBucketOffset
       2    0.3      313      1      TermsFacetMapTest.testSetsFacetTypeToTerm
       2    0.3      313      1      
TermsFacetMapTest.testStoresAllBucketsFlagWithCorrectKey
       2    0.3      313      1      
TermsFacetMapTest.testStoresBucketLimitWithCorrectKey
       2    0.3      313      1      
TermsFacetMapTest.testStoresBucketOffsetWithCorrectKey
       2    0.3      313      1      
TermsFacetMapTest.testStoresFieldWithCorrectKey
       2    0.3      313      1      
TermsFacetMapTest.testStoresMethodWithCorrectKey
       2    0.3      313      1      
TermsFacetMapTest.testStoresMinCountWithCorrectKey
       2    0.3      313      1      
TermsFacetMapTest.testStoresNumBucketsFlagWithCorrectKey
       2    0.3      313      1      
TermsFacetMapTest.testStoresOverRefineBucketsWithCorrectKey
       2    0.3      313      1      
TermsFacetMapTest.testStoresOverRequestBucketsWithCorrectKey
       2    0.3      313      1      
TermsFacetMapTest.testStoresRefinementFlagWithCorrectKey
       2    0.3      313      1      
TermsFacetMapTest.testStoresSortWithCorrectKey
       2    0.3      313      1      
TermsFacetMapTest.testStoresTermPrefixWithCorrectKey
       2    0.3      331      1      TestCachePurging.testBackgroundPurges
       2    0.3      313      1      TestConfigSetAdminRequest.testCreate
       2    0.3      313      1      TestConfigSetAdminRequest.testDelete
       2    0.3      313      1      TestConfigSetAdminRequest.testNoAction
       2    0.3      317      1      TestDistribIDF.testSimpleQuery
       2    0.3      320      1      TestDistributedMissingSort.test
       2    0.3      323      1      TestHighlightDedupGrouping.test
       2    6.7       30      2      TestInetAddressRangeQueries.testRandomBig
       2    0.3      335      1      
TestLucene80DocValuesFormat.testTermsEnumLongSharedPrefixes
       2    7.7       26      2      
TestLucene80DocValuesFormat.testTermsEnumRandomMany
       2    0.3      320      1      
TestMiniSolrCloudClusterSSL.testSslWithCheckPeerName
       2    3.2      342     11      
TestRandomChains.testRandomChainsWithLargeStrings
       2    0.3      318      1      
TestRandomFlRTGCloud.testRandomizedUpdatesAndRTGs
       2    0.3      319      1      TestRecovery.testExistOldBufferLog
       2    0.3      319      1      
TestSegmentSorting.testSegmentTerminateEarly
       2    0.3      319      1      TestSolrCLIRunExample.testSchemalessExample
       2    0.6      314      2      TestSolrJsonWriter.test
       2    0.3      313      1      TestSolrProperties.testProperties
       2    0.3      319      1      TestTlogReplica.testAddDocs
       2    0.3      319      1      TestTlogReplica.testBasicLeaderElection
       2    0.3      638      2      TestTlogReplica.testCreateDelete
       2    0.3      319      1      TestTlogReplica.testKillLeader
       2    0.3      319      1      
TestTlogReplica.testOutOfOrderDBQWithInPlaceUpdates
       2    0.3      319      1      TestTlogReplica.testRealTimeGet
       2    0.3      319      1      TestTlogReplica.testRecovery
       2    0.3      313      1      TestZkConfigManager.testConstants
       2    0.3      313      1      TestZkConfigManager.testUploadConfig
       2    0.3      313      1      TestZkConfigManager.testUploadWithACL
       2    0.3      322      1      ZkCLITest.testPutFile
        3   0.3      310      1      
CloudHttp2SolrClientTest.stateVersionParamTest
        3   0.3      322      1      
ConfusionMatrixGeneratorTest.testGetConfusionMatrixWithFLTKNN
        3   3.4      328     11      DistribCursorPagingTest.test
        3   0.3      311      1      DistributedFacetPivotLongTailTest.test
        3   4.3       23      1      HdfsUnloadDistributedZkTest.test
        3   0.6      315      2      IndexSizeTriggerTest.testSplitIntegration
        3   0.3      313      1      PeerSyncReplicationTest.test
        3   3.7       81      3      
SearchRateTriggerIntegrationTest.testAboveSearchRate
        3   0.3      324      1      ShardSplitTest.testSplitAfterFailedSplit
        3   0.3      324      1      ShardSplitTest.testSplitShardWithRuleLink
        3   3.4      319     11      SolrCmdDistributorTest.test
        3   0.3      316      1      SplitShardTest.testSplitFuzz
        3   3.1      324     10      TestDistribIDF.testMultiCollectionQuery
        3   0.3      331      1      TestIndexWriterDelete.testDeletesOnDiskFull
        3   0.3      332      1      
TestLucene80DocValuesFormat.testBinaryVariableLengthVsStoredFields
        3   0.3      329      1      
TestLucene80DocValuesFormat.testSortedVariableLengthBigVsStoredFields
        3   0.3      331      1      
TestLucene80DocValuesFormat.testSparseNumericBlocksOfVariousBitsPerValue
        3   0.3      313      1      TestPackages.testAPI
        3   0.3      324      1      
TestReplicationHandler.doTestIndexAndConfigReplication
        3  46.4       69     32      TestXYPolygonShapeQueries.testRandomBig



***********************Annotations report
   Number of AwaitsFix: 41 Number of BadApples: 6

*****************AwaitsFix Annotations:


************Lucene AwaitsFix
TestControlledRealTimeReopenThread.testCRTReopen
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-5737";)

TestICUNormalizer2CharFilter.testRandomStrings
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-5595";)

TestICUTokenizerCJK.TestICUTokenizerCJK suite
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/LUCENE-8222";)

TestMoreLikeThis.testMultiFieldShouldReturnPerFieldBooleanQuery
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-7161";)


    ************Solr AwaitsFix
AutoAddReplicasIntegrationTest.testRapidStopStartStopWithPropChange
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13811";)

CdcrBidirectionalTest.testBiDir
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-12524";)

CdcrBootstrapTest.testBootstrapWithContinousIndexingOnSourceCluster
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-12028";)

CollectionsAPISolrJTest.testCreateAndDeleteShard
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-13021";)

ComputePlanActionTest.testNodeLost
   
@LuceneTestCase.AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)

ConcurrentCreateRoutedAliasTest.ConcurrentCreateRoutedAliasTest suite
   @LuceneTestCase.AwaitsFix(bugUrl = 
"https://issues.apache.org/jira/browse/SOLR-12386";) // "Can't find resource"

LeaderTragicEventTest.LeaderTragicEventTest suite
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13237";)

MoveReplicaHDFSTest.MoveReplicaHDFSTest suite
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13924";)

MoveReplicaHDFSTest.testFailedMove
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12080";) // 
added 03-Oct-2018

ReplaceNodeNoTargetTest.ReplaceNodeNoTargetTest suite
   @LuceneTestCase.AwaitsFix(bugUrl = 
"https://issues.apache.org/jira/browse/SOLR-11067";)

ReplaceNodeNoTargetTest.test
   @LuceneTestCase.AwaitsFix(bugUrl = 
"https://issues.apache.org/jira/browse/SOLR-11067";)

RoutedAliasUpdateProcessorTest.alias,
   
@org.apache.lucene.util.LuceneTestCase.AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13696";)

SSLMigrationTest.SSLMigrationTest suite
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) // 
17-Mar-2018

SaslZkACLProviderTest.testSaslZkACLProvider
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-13075";)

ScheduledMaintenanceTriggerTest.testInactiveShardCleanup
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) // 
17-Mar-2018

ScheduledTriggerTest.testTrigger
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) // 
added 20-Sep-2018

SearchRateTriggerIntegrationTest.testDeleteNode
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13163";)

SearchRateTriggerTest.testTrigger
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)

SolrExporterIntegrationTest.SolrExporterIntegrationTest suite
   
@org.apache.lucene.util.LuceneTestCase.AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13786";)

Tagger2Test.testStopWords
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-8344";)

TestHierarchicalDocBuilder.testThreeLevelHierarchy
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-12801";) // 
this test fails easily under beasting

TestImpersonationWithHadoopAuth.testForwarding
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/HADOOP-9893";)

TestJsonFacetRefinement.testProcessEmptyRefinement
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12556";)

TestJsonFacetRefinement.testSortedSubFacetRefinementWhenParentOnlyReturnedByOneShardProcessEmpty
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12556";)

TestLTRReRankingPipeline.testDifferentTopN
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-11134";)

TestMinMaxOnMultiValuedField.testDoubleFieldCache
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-6709";)

TestMinMaxOnMultiValuedField.testFloatFieldCache
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-6709";)

TestMinMaxOnMultiValuedField.testIntFieldCache
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-6709";)

TestMinMaxOnMultiValuedField.testLongFieldCache
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-6709";)

TestPullReplica.TestPullReplica suite
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)

TestSimComputePlanAction.testNodeLost
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-12028";) // 
if you beast this, eventually you will see

TestSimExtremeIndexing.TestSimExtremeIndexing suite
   
@org.apache.lucene.util.LuceneTestCase.AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12923";)

TestSimLargeCluster.testBasic
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) // 
this test hits a timeout easily

TestStressRecovery.TestStressRecovery suite
   
@LuceneTestCase.AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)
 // 6-Sep-2018

TestTlogReplayVsRecovery.TestTlogReplayVsRecovery suite
   
@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13486;https://issues.apache.org/jira/browse/SOLR-14183";)

TimeRoutedAliasUpdateProcessorTest.testDateMathInStart
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13943";)

TriLevelCompositeIdRoutingTest.test
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13369";)



*****************BadApple Annotations:

************Lucene BadApple

************Solr BadApple
MoveReplicaHDFSTest.testNormalFailedMove
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) // 
14-Oct-2018

MultiThreadedOCPTest.test
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) // 
annotated on: 24-Dec-2018

SharedFSAutoReplicaFailoverTest.SharedFSAutoReplicaFailoverTest suite
   
@LuceneTestCase.BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)
 // added 20-Jul-2018

SolrZkClientTest.testSimpleUpdateACLs
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) // 
annotated on: 24-Dec-2018

TimeRoutedAliasUpdateProcessorTest.TimeRoutedAliasUpdateProcessorTest suite
   @LuceneTestCase.BadApple(bugUrl = 
"https://issues.apache.org/jira/browse/SOLR-13059";)




---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org

Reply via email to