Short form:

Raw fail count by week totals, most recent week first (corresponds to bits):
Week: 0  had  83 failures
Week: 1  had  253 failures
Week: 2  had  56 failures
Week: 3  had  66 failures

Failures in the last 4 reports..
   Report   Pct     runs    fails           test
     0123  16.7      839     82      BasicAuthIntegrationTest.testBasicAuth
     0123   1.8      828     10      
DimensionalRoutedAliasUpdateProcessorTest.testCatTime
     0123   1.8      828     21      
DimensionalRoutedAliasUpdateProcessorTest.testTimeCat
     0123   8.0       94      5      HdfsBasicDistributedZkTest.test
     0123  11.0      838     72      
LegacyCloudClusterPropTest.testCreateCollectionSwitchLegacyCloud
     0123  77.8      144     72      MoveReplicaHDFSTest.test
     0123   4.8       98      5      ShardSplitTest.testSplitWithChaosMonkey
     0123   0.9      801      9      SystemCollectionCompatTest.testBackCompat
     0123   1.9      817     57      
TestModelManagerPersistence.testFilePersistence
     0123   2.3      815     55      
TestModelManagerPersistence.testWrapperModelPersistence
     0123   2.2      795     10      TestStressLiveNodes.testStress
************ Will BadApple all tests above this line except ones listed at the 
top**************

Full report attached:

DO NOT ENABLE LIST:
    MoveReplicaHDFSTest.testFailedMove
    MoveReplicaHDFSTest.testNormalFailedMove
    TestControlledRealTimeReopenThread.testCRTReopen
    TestICUNormalizer2CharFilter.testRandomStrings
    TestICUTokenizerCJK
    TestImpersonationWithHadoopAuth.testForwarding
    TestLTRReRankingPipeline.testDifferentTopN
    TestRandomChains


DO NOT ANNOTATE LIST
    CdcrBidirectionalTest.testBiDir
    IndexSizeTriggerTest.testMergeIntegration
    IndexSizeTriggerTest.testMixedBounds
    IndexSizeTriggerTest.testSplitIntegration
    IndexSizeTriggerTest.testTrigger
    InfixSuggestersTest.testShutdownDuringBuild
    ShardSplitTest.test
    ShardSplitTest.testSplitMixedReplicaTypes
    ShardSplitTest.testSplitWithChaosMonkey
    TestLatLonShapeQueries.testRandomBig
    TestRandomChains.testRandomChainsWithLargeStrings
    TestTriggerIntegration.testSearchRate

Processing file (History bit 3): HOSS-2019-12-02.csv
Processing file (History bit 2): HOSS-2019-11-25.csv
Processing file (History bit 1): HOSS-2019-11-18.csv
Processing file (History bit 0): HOSS-2019-11-11.csv


Number of AwaitsFix: 40 Number of BadApples: 8


Raw fail count by week totals, most recent week first (corresponds to bits):
Week: 0  had  83 failures
Week: 1  had  253 failures
Week: 2  had  56 failures
Week: 3  had  66 failures


**Annotated tests that didn't fail in the last 4 weeks.

  **Tests removed from the next two lists because they were specified in 
'doNotEnable' in the properties file
     no tests removed

  **Annotations will be removed from the following tests because they haven't 
failed in the last 4 rollups.

  **Methods: 3
   FullSolrCloudDistribCmdsTest.test
   SolrZkClientTest.testSimpleUpdateACLs
   TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader


********Failures in Hoss' reports for the last 4 rollups.

There were 356 unannotated tests that failed in Hoss' rollups. Ordered by the 
date I downloaded the rollup file, newest->oldest. See above for the dates the 
files were collected 
These tests were NOT BadApple'd or AwaitsFix'd
All tests that failed 4 weeks running will be BadApple'd unless there are 
objections

Failures in the last 4 reports..
   Report   Pct     runs    fails           test
     0123  16.7      839     82      BasicAuthIntegrationTest.testBasicAuth
     0123   1.8      828     10      
DimensionalRoutedAliasUpdateProcessorTest.testCatTime
     0123   1.8      828     21      
DimensionalRoutedAliasUpdateProcessorTest.testTimeCat
     0123   8.0       94      5      HdfsBasicDistributedZkTest.test
     0123  11.0      838     72      
LegacyCloudClusterPropTest.testCreateCollectionSwitchLegacyCloud
     0123  77.8      144     72      MoveReplicaHDFSTest.test
     0123   4.8       98      5      ShardSplitTest.testSplitWithChaosMonkey
     0123   0.9      801      9      SystemCollectionCompatTest.testBackCompat
     0123   1.9      817     57      
TestModelManagerPersistence.testFilePersistence
     0123   2.3      815     55      
TestModelManagerPersistence.testWrapperModelPersistence
     0123   2.2      795     10      TestStressLiveNodes.testStress
************ Will BadApple all tests above this line except ones listed at the 
top**************



     012    0.5      577      3      
ChaosMonkeyNothingIsSafeWithPullReplicasTest.test
     012    0.5      584      3      
TestSimpleTextTermVectorsFormat.testRamBytesUsed
     012    0.5      487      8      TestSolrCachePerf.testGetPutCompute
     012    0.5      538      3      TestTlogReplica.testKillLeader
     01 3   0.9      602      5      LeaderVoteWaitTimeoutTest.basicTest
     01 3   1.8      630     14      RollingRestartTest.test
     01 3  27.6       87     19      StressHdfsTest.test
     01 3   0.5      545      4      
TestDelegationWithHadoopAuth.testDelegationTokenRenew
     01 3   0.5      604      3      
TestQueryingOnDownCollection.testQueryToDownCollectionShouldFailFast
     01 3  34.4       99     23      TestXYPolygonShapeQueries.testRandomBig
     01     1.4      399      5      LeaderFailoverAfterPartitionTest.test
     01    16.7       55      7      Test2BPostings.test
     01    39.7      532    163      TestDictionary.testInvalidData
     01     0.5      368      4      TestPackages.testPluginLoading
     0 23   2.3      608      9      SplitShardTest.testLiveSplit
     0  3   0.5      431      4      
MissingSegmentRecoveryTest.testLeaderRecovery
     0  3   0.5      408      2      TestPackedInts.testPackedLongValues
     0      0.5      214      1      AssignBackwardCompatibilityTest.test
     0      0.5      212      1      AutoScalingHandlerTest.testReadApi
     0      0.5      212      1      
AutoScalingHandlerTest.testSuggestionsWithPayload
     0      0.5      210      1      AutoscalingHistoryHandlerTest.testHistory
     0      0.5      213      1      
CollectionsAPISolrJTest.testReadOnlyCollection
     0      0.5      212      1      ComputePlanActionTest.testNodeAdded
     0      0.5      215      1      
ConfusionMatrixGeneratorTest.testGetConfusionMatrixWithFLTKNN
     0      4.8       21      1      
ForceLeaderWithTlogReplicasTest.testReplicasInLowerTerms
     0      4.3       23      1      HdfsChaosMonkeyNothingIsSafeTest.test
     0      0.5      215      1      
HealthCheckHandlerTest.testHealthCheckHandler
     0      0.5      210      1      HttpPartitionTest.test
     0      0.5      214      1      ShardSplitTest.testSplitShardWithRule
     0      0.5      212      1      
TestBugInSomething.testUnicodeShinglesAndNgrams
     0      0.9      211      2      
TestFieldCacheSortRandom.testRandomStringSort
     0      0.9      211      2      
TestFieldCacheSortRandom.testRandomStringValSort
     0      0.6      166      1      
TestHdfsCloudBackupRestore.testRestoreFailure
     0      0.5      211      1      TestIndexWriterDelete.testDeletesOnDiskFull
     0      1.2      259      3      
TestLRUQueryCache.testBooleanQueryCachesSubClauses
     0     20.0       75     15      
TestLRUQueryCache.testLRUConcurrentCachingAcrossSegments
     0      5.3       75      4      
TestLRUQueryCache.testLRUConcurrentLoadAndEviction
     0     34.7       75     26      
TestLRUQueryCache.testLRUConcurrentLoadsOfSameQuery
     0      1.2      241      3      
TestLRUQueryCache.testSkipCachingForTermQuery
     0      1.4      216      3      TestLatLonDocValuesQueries.testAllLatEqual
     0      1.4      216      3      
TestLatLonDocValuesQueries.testLowCardinality
     0      1.9      212      4      TestLatLonPointQueries.testRandomMedium
     0      0.9      214      2      
TestLatLonPointShapeQueries.testRandomMedium
     0      0.5      214      1      
TestLucene80DocValuesFormat.testSortedNumericBlocksOfVariousBitsPerValue
     0      0.5      213      1      
TestLucene80DocValuesFormat.testSparseLongNumericsVsStoredFields
     0      0.5      213      1      
TestLucene80DocValuesFormat.testSparseNumericBlocksOfVariousBitsPerValue
     0      0.5      214      1      
TestLucene80DocValuesFormat.testSparseSortedNumericBlocksOfVariousBitsPerValue
     0      4.0      150      6      
TestPhraseWildcardQuery.testOneSingleTermTwoMultiTerms
     0      0.5      211      1      TestRestoreCore.testFailedRestore
     0      0.5      216      1      
TestXYMultiLineShapeQueries.testLowCardinalityShapeManyTimes
     0      3.4       29      1      
TimeRoutedAliasUpdateProcessorTest.testPreemptiveCreation
      123   0.5      579      3      
ReindexCollectionTest.testSameTargetReindexing
      123   5.2      599     34      
TestCloudSearcherWarming.testRepFactor1LeaderStartup
      123   0.5      573      3      
TestPullReplicaErrorHandling.testPullReplicaDisconnectsFromZooKeeper
      123   1.6      587      9      
TestSkipOverseerOperations.testSkipLeaderOperations
      12    0.5      366      3      HttpPartitionWithTlogReplicasTest.test
      1 3   3.5      405      9      SyncSliceTest.test
      1 3   7.5      408     21      TestInPlaceUpdatesDistrib.test
      1 3   0.5      394      4      
TestSearcherManager.testConcurrentIndexCloseSearchAndRefresh
      1 3   0.5      388      2      TestV2Request.testHttpSolrClient
      1     0.5      183      1      AliasIntegrationTest.test
      1     0.5      183      1      
AliasIntegrationTest.testClusterStateProviderAPI
      1     0.5      183      1      
AliasIntegrationTest.testDeleteAliasWithExistingCollectionName
      1     0.5      183      1      
AliasIntegrationTest.testDeleteOneOfTwoCollectionsAliased
      1     0.5      183      1      AliasIntegrationTest.testErrorChecks
      1     0.5      183      1      
AliasIntegrationTest.testModifyPropertiesCAR
      1     0.5      183      1      AliasIntegrationTest.testModifyPropertiesV1
      1     0.5      183      1      AliasIntegrationTest.testModifyPropertiesV2
      1     0.5      183      1      AliasIntegrationTest.testProperties
      1     0.5      182      1      
AsyncCallRequestStatusResponseTest.testAsyncCallStatusResponse
      1     0.6      170      1      AuditLoggerIntegrationTest.authValid
      1     0.5      185      1      
AuditLoggerIntegrationTest.searchWithException
      1     0.5      185      1      
CdcrBootstrapTest.testBootstrapWithMultipleReplicas
      1     1.1      185      2      ChaosMonkeySafeLeaderTest.test
      1     0.5      184      1      CloudHttp2SolrClientRetryTest.testRetry
      1     0.5      184      1      
CloudHttp2SolrClientTest.checkCollectionParameters
      1     0.5      184      1      
CloudHttp2SolrClientTest.preferLocalShardsTest
      1     0.5      184      1      
CloudHttp2SolrClientTest.preferReplicaTypesTest
      1     0.5      184      1      
CloudHttp2SolrClientTest.stateVersionParamTest
      1     0.5      184      1      CloudHttp2SolrClientTest.testAliasHandling
      1     0.5      184      1      
CloudHttp2SolrClientTest.testInitializationWithSolrUrls
      1     0.5      184      1      
CloudHttp2SolrClientTest.testNonRetryableRequests
      1     0.5      184      1      
CloudHttp2SolrClientTest.testOverwriteOption
      1     0.5      184      1      
CloudHttp2SolrClientTest.testParallelUpdateQTime
      1     0.5      184      1      
CloudHttp2SolrClientTest.testRetryUpdatesWhenClusterStateIsStale
      1     0.5      184      1      CloudHttp2SolrClientTest.testRouting
      1     0.5      184      1      
CloudHttp2SolrClientTest.testVersionsAreReturned
      1     0.5      184      1      CloudSolrClientRetryTest.testRetry
      1     0.5      184      1      
CloudSolrClientTest.checkCollectionParameters
      1     0.5      184      1      CloudSolrClientTest.preferLocalShardsTest
      1     0.5      184      1      CloudSolrClientTest.preferReplicaTypesTest
      1     0.5      184      1      CloudSolrClientTest.stateVersionParamTest
      1     0.5      184      1      CloudSolrClientTest.testAliasHandling
      1     0.5      184      1      
CloudSolrClientTest.testInitializationWithSolrUrls
      1     0.5      184      1      
CloudSolrClientTest.testNonRetryableRequests
      1     0.5      184      1      CloudSolrClientTest.testOverwriteOption
      1     0.5      184      1      CloudSolrClientTest.testParallelUpdateQTime
      1     0.5      184      1      CloudSolrClientTest.testPing
      1     0.5      184      1      
CloudSolrClientTest.testRetryUpdatesWhenClusterStateIsStale
      1     0.5      184      1      CloudSolrClientTest.testRouting
      1     0.5      184      1      CloudSolrClientTest.testVersionsAreReturned
      1     0.5      183      1      
CollectionReloadTest.testReloadedLeaderStateAfterZkSessionLoss
      1     0.6      181      1      CollectionTooManyReplicasTest.testAddShard
      1     0.6      181      1      
CollectionTooManyReplicasTest.testAddTooManyReplicas
      1     0.6      181      1      
CollectionTooManyReplicasTest.testDownedShards
      1     0.5      183      1      
CollectionsAPIAsyncDistributedZkTest.testAsyncRequests
      1     0.5      183      1      
CollectionsAPIAsyncDistributedZkTest.testSolrJAPICalls
      1     0.5      184      1      
ConcurrentUpdateHttp2SolrClientMultiCollectionTest.testEnsureDocumentsSentToCorrectCollection
      1     0.5      184      1      
ConcurrentUpdateSolrClientMultiCollectionTest.testEnsureDocumentsSentToCorrectCollection
      1     0.6      180      1      DaemonStreamApiTest.testAPIs
      1     0.5      183      1      DistribCursorPagingTest.test
      1     0.5      183      1      ExecutePlanActionTest.testExecute
      1     0.5      183      1      ExecutePlanActionTest.testIntegration
      1     0.5      183      1      ExecutePlanActionTest.testTaskFail
      1     0.5      183      1      ExecutePlanActionTest.testTaskTimeout
      1     0.6      181      1      LeaderFailureAfterFreshStartTest.test
      1     0.5      186      1      
LeaderVoteWaitTimeoutTest.testMostInSyncReplicasCanWinElection
      1     0.5      184      1      LegacyFieldFacetCloudTest.countTest
      1     0.5      184      1      LegacyFieldFacetCloudTest.maxTest
      1     0.5      184      1      LegacyFieldFacetCloudTest.meanTest
      1     0.5      184      1      
LegacyFieldFacetCloudTest.medianFacetAscTest
      1     0.5      184      1      LegacyFieldFacetCloudTest.minTest
      1     0.5      184      1      LegacyFieldFacetCloudTest.missingFacetTest
      1     0.5      184      1      LegacyFieldFacetCloudTest.missingTest
      1     0.5      184      1      LegacyFieldFacetCloudTest.multiValueTest
      1     0.5      184      1      LegacyFieldFacetCloudTest.perc20Test
      1     0.5      184      1      LegacyFieldFacetCloudTest.perc60Test
      1     0.5      184      1      
LegacyFieldFacetCloudTest.stddevFacetAscTest
      1     0.5      184      1      LegacyFieldFacetCloudTest.sumTest
      1     0.5      184      1      LegacyFieldFacetCloudTest.uniqueTest
      1     0.5      184      1      LegacyFieldFacetExtrasCloudTest.limitTest
      1     0.5      184      1      LegacyFieldFacetExtrasCloudTest.offsetTest
      1     0.5      184      1      LegacyFieldFacetExtrasCloudTest.sortTest
      1     0.5      184      1      LegacyNoFacetCloudTest.countTest
      1     0.5      184      1      LegacyNoFacetCloudTest.maxTest
      1     0.5      184      1      LegacyNoFacetCloudTest.meanTest
      1     0.5      184      1      LegacyNoFacetCloudTest.medianTest
      1     0.5      184      1      LegacyNoFacetCloudTest.minTest
      1     0.5      184      1      LegacyNoFacetCloudTest.missingDefaultTest
      1     0.5      184      1      LegacyNoFacetCloudTest.perc20Test
      1     0.5      184      1      LegacyNoFacetCloudTest.perc60Test
      1     0.5      184      1      LegacyNoFacetCloudTest.stddevTest
      1     0.5      184      1      LegacyNoFacetCloudTest.sumTest
      1     0.5      184      1      LegacyNoFacetCloudTest.uniqueTest
      1     0.5      184      1      LegacyQueryFacetCloudTest.queryTest
      1     0.5      184      1      LegacyRangeFacetCloudTest.hardendRangeTest
      1     0.5      184      1      LegacyRangeFacetCloudTest.multiGapTest
      1     0.5      184      1      LegacyRangeFacetCloudTest.rangeTest
      1     0.5      182      1      
MigrateRouteKeyTest.multipleShardMigrateTest
      1     0.5      182      1      MigrateRouteKeyTest.testMissingSplitKey
      1     0.5      185      1      OverseerModifyCollectionTest.testModifyColl
      1     0.5      185      1      PeerSyncReplicationTest.test
      1     1.1      184      2      RoutingToNodesWithPropertiesTest.test
      1     0.5      183      1      RulesTest.doIntegrationTest
      1     1.1      184      2      RulesTest.testHostFragmentRule
      1     0.5      183      1      RulesTest.testModifyColl
      1     1.1      184      2      RulesTest.testPortRule
      1     1.1      184      2      
RulesTest.testPortRuleInPresenceOfClusterPolicy
      1     1.1      182      2      
ScheduledTriggerIntegrationTest.testScheduledTrigger
      1     0.5      184      1      SearchHandlerTest.testRequireZkConnected
      1     0.5      184      1      
SearchHandlerTest.testRequireZkConnectedDistrib
      1     0.5      184      1      SearchHandlerTest.testZkConnected
      1     0.6      181      1      SearchRateTriggerTest.testWaitForElapsed
      1     0.5      184      1      ShardRoutingTest.test
      1     1.0      192      2      ShardSplitTest.testSplitShardWithRuleLink
      1     0.5      183      1      SimpleCollectionCreateDeleteTest.test
      1     0.5      184      1      SolrZkClientTest.testWrappingWatches
      1     0.5      182      1      SplitByPrefixTest.doTest
      1     0.5      184      1      TestAuthenticationFramework.testBasics
      1     0.5      184      1      
TestCloudCollectionsListeners.testCollectionDeletion
      1     0.5      184      1      
TestCloudCollectionsListeners.testSimpleCloudCollectionsListener
      1     0.5      184      1      
TestCloudCollectionsListeners.testWatchesWorkForBothStateFormats
      1     0.5      192      1      
TestCloudSearcherWarming.testPeersyncFailureReplicationSuccess
      1     0.5      183      1      TestCollectionAPI.test
      1     0.5      183      1      
TestCollectionAPI.testRecreateCollectionAfterFailure
      1     0.5      184      1      
TestCollectionStateWatchers.testCanWaitForNonexistantCollection
      1     0.5      184      1      
TestCollectionStateWatchers.testCollectionWatchWithShutdownOfActiveNode
      1     0.5      184      1      
TestCollectionStateWatchers.testCollectionWatchWithShutdownOfUnusedNode
      1     0.5      184      1      
TestCollectionStateWatchers.testDeletionsTriggerWatches
      1     0.5      184      1      
TestCollectionStateWatchers.testLiveNodeChangesTriggerWatches
      1     0.5      184      1      
TestCollectionStateWatchers.testWaitForStateChecksCurrentState
      1     0.5      184      1      
TestCollectionStateWatchers.testWaitForStateWatcherIsRetainedOnPredicateFailure
      1     0.5      184      1      
TestCollectionStateWatchers.testWatchesWorkForStateFormat1
      1     0.5      183      1      
TestCustomStream.testDynamicLoadingCustomStream
      1     1.1      185      2      TestDistribDocBasedVersion.test
      1     0.5      183      1      TestDistribIDF.testMultiCollectionQuery
      1     0.5      183      1      TestDistribIDF.testSimpleQuery
      1     0.5      184      1      
TestDocCollectionWatcher.testDeletionsTriggerWatches
      1     0.5      184      1      
TestDocCollectionWatcher.testWaitForStateChecksCurrentState
      1     0.5      184      1      
TestDocCollectionWatcher.testWaitForStateWatcherIsRetainedOnPredicateFailure
      1     0.5      184      1      
TestDocCollectionWatcher.testWatchesWorkForStateFormat1
      1     0.5      184      1      
TestDownShardTolerantSearch.searchingShouldFailWithoutTolerantSearchSetToTrue
      1     0.5      183      1      TestDynamicLoading.testDynamicLoading
      1     0.6      181      1      TestDynamicLoadingUrl.testDynamicLoadingUrl
      1     0.5      184      1      TestLTROnSolrCloud.testSimpleQuery
      1     0.5      188      1      
TestLucene50TermVectorsFormat.testRamBytesUsed
      1     5.3       19      1      
TestLucene70NormsFormat.testSparseNCommonBig
      1     0.5      185      1      
TestLucene80DocValuesFormat.testRandomAdvanceBinary
      1     0.5      185      1      
TestLucene80DocValuesFormat.testTermsEnumLongSharedPrefixes
      1     0.6      173      1      TestPackages.testAPI
      1     0.5      183      1      TestPrepRecovery.testLeaderNotResponding
      1     0.5      183      1      TestPrepRecovery.testLeaderUnloaded
      1     0.5      183      1      
TestPullReplicaErrorHandling.testCantConnectToLeader
      1     0.5      183      1      
TestPullReplicaErrorHandling.testCantConnectToPullReplica
      1     0.5      183      1      TestRecovery.testExistOldBufferLog
      1     0.5      182      1      
TestSSLRandomization.testRandomizedSslAndClientAuth
      1     0.5      184      1      TestSolrCloudWithKerberosAlt.testBasics
      1     0.5      183      1      TestSolrConfigHandlerCloud.test
      1     0.5      184      1      TestV2Request.testCloudSolrClient
      1     0.5      184      1      TestV2Request.testV2Forwarding
      1     1.1      185      2      TestWithCollection.testAddReplicaSimple
      1     1.1      185      2      TestWithCollection.testAddReplicaWithPolicy
      1     1.1      185      2      TestWithCollection.testCreateCollection
      1     1.1      185      2      
TestWithCollection.testCreateCollectionNoWithCollection
      1     1.1      185      2      TestWithCollection.testDeleteWithCollection
      1     1.1      185      2      
TestWithCollection.testMoveReplicaMainCollection
      1     1.1      185      2      
TestWithCollection.testMoveReplicaWithCollection
      1     1.1      185      2      
TestWithCollection.testMultipleWithCollections
      1     1.1      185      2      TestWithCollection.testNodeAdded
      1     0.5      184      1      
TestZKPropertiesWriter.testZKPropertiesWriter
      1     0.5      187      1      ZkConfigFilesTest.testCanUploadConfigToZk
       23   0.6      385      2      
ChaosMonkeySafeLeaderWithPullReplicasTest.test
       23   5.3       45      5      
HdfsTlogReplayBufferedWhileIndexingTest.test
       23   1.1      391      3      
TestConcurrentMergeScheduler.testFlushExceptions
       23   1.1      290      4      TestTlogReplica.testKillTlogReplica
       23   4.2       53      2      
TestXYMultiPolygonShapeQueries.testRandomBig
       23   9.4       65      5      
TimeRoutedAliasUpdateProcessorTest.testDateMathInStart
       2    0.5      184      1      AnalyticsMergeStrategyTest.test
       2    0.6      181      1      BasicAuthOnSingleNodeTest.basicTest
       2    0.6      179      1      
CollectionsAPISolrJTest.testCreateCollWithDefaultClusterPropertiesNewFormat
       2    0.5      185      1      DistributedIntervalFacetingTest.test
       2    0.5      182      1      ExitableDirectoryReaderTest.testPrefixQuery
       2    0.6      181      1      GraphExpressionTest.testScoreNodesStream
       2    0.5      182      1      MathExpressionTest.testZipFDistribution
       2   57.6      132     76      PackageManagerCLITest.testPackageManager
       2    4.8       21      1      RestartWhileUpdatingTest.test
       2    0.6      178      1      
ShardSplitTest.testSplitMixedReplicaTypesLink
       2    0.6      177      1      
SpellCheckCollatorTest.testEstimatedHitCounts
       2    1.1      182      2      
TestBlockJoin.testMultiChildQueriesOfDiffParentLevels
       2    0.5      184      1      TestDistributedGrouping.test
       2    0.5      183      1      TestDistributedMissingSort.test
       2   18.2      121     22      TestFstDirectAddressing.testDeDupTails
       2    0.8      131      1      TestHdfsCloudBackupRestore.test
       2    0.6      181      1      TestIndexWriterDelete.testUpdatesOnDiskFull
       2    0.6      181      1      
TestLucene80DocValuesFormat.testSortedNumericsSingleValuedVsStoredFields
       2    3.3      120      4      TestReplicationHandler.testEmptyBackups
       2    0.6      168      1      TestSimScenario.testSuggestions
       2    0.6      174      1      TestTlogReplica.testRealTimeGet
        3   3.8       26      1      
CdcrReplicationHandlerTest.testReplicationWithBufferedUpdates
        3   1.0      206      2      
ConcurrentUpdateHttp2SolrClientTest.testConcurrentUpdate
        3   3.4       29      1      HdfsBasicDistributedZk2Test.test
        3   3.8       26      1      
HdfsCollectionsAPIDistributedZkTest.testCollectionsAPI
        3  10.0       30      3      HdfsWriteToMultipleCollectionsTest.test
        3   0.5      207      1      OverviewImplTest.testIsOptimized
        3   1.0      105      1      
TestDirectDocValuesFormat.testSortedNumericsMultipleValuesVsStoredFields
        3   0.5      204      1      
TestDocumentsWriterStallControl.testAccquireReleaseRace
        3   0.5      206      1      
TestReplicationHandler.doTestIndexFetchWithMasterUrl
        3   0.5      199      1      
TestSimTriggerIntegration.testNodeLostTriggerRestoreState
        3   1.0      208      2      
TestSolrCloudWithDelegationTokens.testDelegationTokenRenew
        3   2.4      206      5      TestStressCloudBlindAtomicUpdates.test_dv
        3   2.4      206      5      
TestStressCloudBlindAtomicUpdates.test_dv_idx
        3   2.4      206      5      
TestStressCloudBlindAtomicUpdates.test_dv_stored
        3   2.4      206      5      
TestStressCloudBlindAtomicUpdates.test_dv_stored_idx
        3   2.4      206      5      
TestStressCloudBlindAtomicUpdates.test_stored_idx
        3   1.0      203      2      TestTlogReplica.testDeleteById
        3   0.5      203      1      TestTlogReplica.testOnlyLeaderIndexes
        3   0.5      203      1      
TestTlogReplica.testOutOfOrderDBQWithInPlaceUpdates
        3  37.6      287    108      
ZkShardTermsTest.testCoreRemovalWhileRecovering



***********************Annotations report
   Number of AwaitsFix: 40 Number of BadApples: 8

*****************AwaitsFix Annotations:


************Lucene AwaitsFix
TestControlledRealTimeReopenThread.testCRTReopen
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-5737";)

TestICUNormalizer2CharFilter.testRandomStrings
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-5595";)

TestICUTokenizerCJK.TestICUTokenizerCJK suite
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/LUCENE-8222";)

TestMoreLikeThis.testMultiFieldShouldReturnPerFieldBooleanQuery
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-7161";)


    ************Solr AwaitsFix
AutoAddReplicasIntegrationTest.testRapidStopStartStopWithPropChange
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13811";)

CdcrBidirectionalTest.testBiDir
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-12524";)

CdcrBootstrapTest.testBootstrapWithContinousIndexingOnSourceCluster
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-12028";)

CollectionsAPISolrJTest.testCreateAndDeleteShard
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-13021";)

ComputePlanActionTest.testNodeLost
   
@LuceneTestCase.AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)

ConcurrentCreateRoutedAliasTest.ConcurrentCreateRoutedAliasTest suite
   @LuceneTestCase.AwaitsFix(bugUrl = 
"https://issues.apache.org/jira/browse/SOLR-12386";) // "Can't find resource"

LeaderTragicEventTest.LeaderTragicEventTest suite
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13237";)

MoveReplicaHDFSTest.MoveReplicaHDFSTest suite
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13924";)

MoveReplicaHDFSTest.testFailedMove
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12080";) // 
added 03-Oct-2018

ReplaceNodeNoTargetTest.ReplaceNodeNoTargetTest suite
   @LuceneTestCase.AwaitsFix(bugUrl = 
"https://issues.apache.org/jira/browse/SOLR-11067";)

ReplaceNodeNoTargetTest.test
   @LuceneTestCase.AwaitsFix(bugUrl = 
"https://issues.apache.org/jira/browse/SOLR-11067";)

SSLMigrationTest.SSLMigrationTest suite
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) // 
17-Mar-2018

SaslZkACLProviderTest.testSaslZkACLProvider
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-13075";)

ScheduledMaintenanceTriggerTest.testInactiveShardCleanup
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) // 
17-Mar-2018

ScheduledTriggerTest.testTrigger
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) // 
added 20-Sep-2018

SearchRateTriggerIntegrationTest.testDeleteNode
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13163";)

SearchRateTriggerTest.testTrigger
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)

SolrExporterIntegrationTest.SolrExporterIntegrationTest suite
   
@org.apache.lucene.util.LuceneTestCase.AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13786";)

Tagger2Test.testStopWords
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-8344";)

TestCollapseQParserPlugin.testStringCollapse
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-11974";)

TestHierarchicalDocBuilder.testThreeLevelHierarchy
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-12801";) // 
this test fails easily under beasting

TestImpersonationWithHadoopAuth.testForwarding
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/HADOOP-9893";)

TestJsonFacetRefinement.testProcessEmptyRefinement
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12556";)

TestJsonFacetRefinement.testSortedSubFacetRefinementWhenParentOnlyReturnedByOneShardProcessEmpty
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12556";)

TestLTRReRankingPipeline.testDifferentTopN
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-11134";)

TestMinMaxOnMultiValuedField.testDoubleFieldCache
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-6709";)

TestMinMaxOnMultiValuedField.testFloatFieldCache
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-6709";)

TestMinMaxOnMultiValuedField.testIntFieldCache
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-6709";)

TestMinMaxOnMultiValuedField.testLongFieldCache
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-6709";)

TestPullReplica.TestPullReplica suite
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)

TestSimComputePlanAction.testNodeLost
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-12028";) // 
if you beast this, eventually you will see

TestSimExtremeIndexing.TestSimExtremeIndexing suite
   
@org.apache.lucene.util.LuceneTestCase.AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12923";)

TestSimLargeCluster.testBasic
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) // 
this test hits a timeout easily

TestStressRecovery.TestStressRecovery suite
   
@LuceneTestCase.AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)
 // 6-Sep-2018

TimeRoutedAliasUpdateProcessorTest.testDateMathInStart
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13943";)

TriLevelCompositeIdRoutingTest.test
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13369";)



*****************BadApple Annotations:

************Lucene BadApple

************Solr BadApple
FullSolrCloudDistribCmdsTest.test
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) // 
annotated on: 24-Dec-2018

MoveReplicaHDFSTest.testNormalFailedMove
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) // 
14-Oct-2018

MultiThreadedOCPTest.test
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) // 
annotated on: 24-Dec-2018

SharedFSAutoReplicaFailoverTest.SharedFSAutoReplicaFailoverTest suite
   
@LuceneTestCase.BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)
 // added 20-Jul-2018

SolrZkClientTest.testSimpleUpdateACLs
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) // 
annotated on: 24-Dec-2018

TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) // 
6-Sep-2018

TimeRoutedAliasUpdateProcessorTest.TimeRoutedAliasUpdateProcessorTest suite
   @LuceneTestCase.BadApple(bugUrl = 
"https://issues.apache.org/jira/browse/SOLR-13059";)


---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org

Reply via email to