Here’s the summary:

Raw fail count by week totals, most recent week first (corresponds to bits):
Week: 0  had  113 failures
Week: 1  had  103 failures
Week: 2  had  102 failures
Week: 3  had  343 failures


********Failures in Hoss' reports for the last 4 rollups.

There were 511 unannotated tests that failed in Hoss' rollups. Ordered by the 
date I downloaded the rollup file, newest->oldest. See above for the dates the 
files were collected 
These tests were NOT BadApple'd or AwaitsFix'd

Failures in the last 4 reports..
   Report   Pct     runs    fails           test
     0123   0.7     1593     40      BasicDistributedZkTest.test
     0123   2.1     1518     28      MultiThreadedOCPTest.test
     0123   0.7     1613     14      RollingRestartTest.test
     0123   7.1     1635     44      
ScheduledTriggerIntegrationTest.testScheduledTrigger
     0123   2.4     1614     17      SearchRateTriggerTest.testWaitForElapsed
     0123   0.2     1614      6      ShardSplitTest.testSplitShardWithRuleLink
     0123   0.5     1577      5      
SolrCloudReportersTest.testExplicitConfiguration
     0123   0.7     1560     19      TestInPlaceUpdatesDistrib.test
     0123   1.0     1566     17      TestPackages.testPluginLoading
     0123   0.8     1598      7      
TestQueryingOnDownCollection.testQueryToDownCollectionShouldFailFast
     0123   0.7     1598      8      TestSimScenario.testAutoAddReplicas
********************************************


Full report:
DO NOT ENABLE LIST:
    MoveReplicaHDFSTest.testFailedMove
    MoveReplicaHDFSTest.testNormalFailedMove
    TestControlledRealTimeReopenThread.testCRTReopen
    TestICUNormalizer2CharFilter.testRandomStrings
    TestICUTokenizerCJK
    TestImpersonationWithHadoopAuth.testForwarding
    TestLTRReRankingPipeline.testDifferentTopN
    TestRandomChains


DO NOT ANNOTATE LIST
    CdcrBidirectionalTest.testBiDir
    IndexSizeTriggerTest.testMergeIntegration
    IndexSizeTriggerTest.testMixedBounds
    IndexSizeTriggerTest.testSplitIntegration
    IndexSizeTriggerTest.testTrigger
    InfixSuggestersTest.testShutdownDuringBuild
    ShardSplitTest.test
    ShardSplitTest.testSplitMixedReplicaTypes
    ShardSplitTest.testSplitWithChaosMonkey
    Test2BPostings.test
    TestLatLonShapeQueries.testRandomBig
    TestPackedInts.testPackedLongValues
    TestRandomChains.testRandomChainsWithLargeStrings
    TestTriggerIntegration.testSearchRate

SuppressWarnings count: last week: 1,130, this week: 1,130, delta 0



Processing file (History bit 3): HOSS-2020-05-25.csv
Processing file (History bit 2): HOSS-2020-05-18.csv
Processing file (History bit 1): HOSS-2020-05-11.csv
Processing file (History bit 0): HOSS-2020-05-04.csv


Number of AwaitsFix: 43 Number of BadApples: 4


**Annotated tests that didn't fail in the last 4 weeks.

  **Tests removed from the next two lists because they were specified in 
'doNotEnable' in the properties file
     MoveReplicaHDFSTest.testNormalFailedMove

  **Annotations can be removed from the following tests because they haven't 
failed in the last 4 rollups.

  **Methods: 0


Raw fail count by week totals, most recent week first (corresponds to bits):
Week: 0  had  113 failures
Week: 1  had  103 failures
Week: 2  had  102 failures
Week: 3  had  343 failures


********Failures in Hoss' reports for the last 4 rollups.

There were 511 unannotated tests that failed in Hoss' rollups. Ordered by the 
date I downloaded the rollup file, newest->oldest. See above for the dates the 
files were collected 
These tests were NOT BadApple'd or AwaitsFix'd

Failures in the last 4 reports..
   Report   Pct     runs    fails           test
     0123   0.7     1593     40      BasicDistributedZkTest.test
     0123   2.1     1518     28      MultiThreadedOCPTest.test
     0123   0.7     1613     14      RollingRestartTest.test
     0123   7.1     1635     44      
ScheduledTriggerIntegrationTest.testScheduledTrigger
     0123   2.4     1614     17      SearchRateTriggerTest.testWaitForElapsed
     0123   0.2     1614      6      ShardSplitTest.testSplitShardWithRuleLink
     0123   0.5     1577      5      
SolrCloudReportersTest.testExplicitConfiguration
     0123   0.7     1560     19      TestInPlaceUpdatesDistrib.test
     0123   1.0     1566     17      TestPackages.testPluginLoading
     0123   0.8     1598      7      
TestQueryingOnDownCollection.testQueryToDownCollectionShouldFailFast
     0123   0.7     1598      8      TestSimScenario.testAutoAddReplicas
********************************************

Failures over the last 4 weeks, but not every week. Ordered most-recent first:



     012    0.2     1203      3      ShardSplitTest.testSplitShardWithRule
     012    0.5     1196      8      SystemCollectionCompatTest.testBackCompat
     01 3   0.3     1217      9      
DeleteReplicaTest.deleteReplicaAndVerifyDirectoryCleanup
     01 3   0.3     1220      6      LeaderFailoverAfterPartitionTest.test
     01 3   0.3     1210      6      
NodeMarkersRegistrationTest.testNodeMarkersRegistration
     01 3   8.0       76      4      ShardSplitTest.testSplitWithChaosMonkey
     01 3   0.6      613      4      
StreamDecoratorTest.testParallelTerminatingDaemonUpdateStream
     01 3   1.0     1247     16      TestRandomChains.testRandomChains
     01 3   0.2     1209      5      TestSimScenario.testSplitShard
     01 3   0.5     1209      9      TestSimScenario.testSuggestions
     01     0.3      804      2      
ChaosMonkeyNothingIsSafeWithPullReplicasTest.test
     01    40.0       86     34      HdfsSyncSliceTest.test
     01     0.3      800      2      
MetricTriggerIntegrationTest.testMetricTrigger
     01     0.3      800      2      
NodeLostTriggerIntegrationTest.testNodeLostTrigger
     01     0.3      685      2      
SoftAutoCommitTest.testSoftAndHardCommitMaxTimeDelete
     01     0.3      804      3      TestLockTree.testLocks
     01     0.3      803      2      TestPrepRecovery.testLeaderUnloaded
     0 23   0.3     1189      6      
ConnectionManagerTest.testReconnectWhenZkDisappeared
     0 23   0.5     1186      4      ReplaceNodeTest.test
     0 23   1.5     1199     10      TestPointFields.testFloatPointStats
     0 23   0.3     1183      4      
TestPullReplicaErrorHandling.testCantConnectToLeader
     0 23   0.7     1187      5      TestSolrConfigHandlerCloud.test
     0 2    0.2      787      2      MoveReplicaTest.test
     0 2    0.3      784      2      TestCloudRecovery2.test
     0 2    0.2      786      2      
TestCustomStream.testDynamicLoadingCustomStream
     0 2    0.2      786      2      TriggerCooldownIntegrationTest.testCooldown
     0  3   0.3      798      2      
CdcrVersionReplicationTest.testCdcrDocVersions
     0  3   0.3      743      4      
CloudHttp2SolrClientTest.testRetryUpdatesWhenClusterStateIsStale
     0  3   0.3      780      3      
CloudSolrClientTest.testRetryUpdatesWhenClusterStateIsStale
     0  3   0.3      796      2      
TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeaderAfterRestart
     0      0.2      402      1      CollectionPropsTest.testWatcher
     0      0.4      234      1      
ComputePlanActionTest.testSelectedCollections
     0      0.2      401      1      DaemonStreamApiTest.testAPIs
     0      0.4      265      1      
DistributedUpdateProcessorTest.testVersionAdd
     0     12.5       24      3      HdfsBasicDistributedZk2Test.test
     0      0.3      399      1      IndexSizeTriggerTest.testMaxOps
     0      0.3      398      1      InfixSuggestersTest.testReloadDuringBuild
     0      0.3      390      1      
MathExpressionTest.testGeometricDistribution
     0      0.3      397      1      PeerSyncReplicationTest.test
     0      0.5      407      2      
ShardSplitTest.testSplitMixedReplicaTypesLink
     0      0.3      342      1      
SoftAutoCommitTest.testSoftCommitWithinAndHardCommitMaxTimeDelete
     0      0.2      405      1      
TestBKDRadixSelector.testRandomDataDimDiffValues
     0      0.3      396      1      TestCloudRecovery.corruptedLogTest
     0      0.7      405      3      
TestIndexWriterOnDiskFull.testAddDocumentOnDiskFull
     0      0.3      400      1      TestJmxIntegration.testJmxRegistration
     0     31.4       35     11      
TestLatLonMultiPolygonShapeQueries.testRandomBig
     0      0.5      214      1      TestLucene70NormsFormat.testAllZeros
     0      0.5      214      1      TestLucene70NormsFormat.testByteRange
     0      0.5      214      1      
TestLucene70NormsFormat.testCheckIntegrityReadsAllBytes
     0      0.5      214      1      TestLucene70NormsFormat.testFewLargeValues
     0      0.5      214      1      
TestLucene70NormsFormat.testFewSparseLargeValues
     0      2.7      219      6      TestLucene70NormsFormat.testFewSparseValues
     0      0.5      214      1      TestLucene70NormsFormat.testFewValues
     0      0.5      214      1      TestLucene70NormsFormat.testFullLongRange
     0      0.5      214      1      
TestLucene70NormsFormat.testIndependantIterators
     0      2.7      219      6      
TestLucene70NormsFormat.testIndependantSparseIterators
     0      0.5      214      1      TestLucene70NormsFormat.testLongRange
     0      0.5      214      1      TestLucene70NormsFormat.testMostZeros
     0      0.5      214      1      TestLucene70NormsFormat.testMultiClose
     0      0.5      214      1      TestLucene70NormsFormat.testNCommon
     0      0.5      214      1      TestLucene70NormsFormat.testOutliers
     0      2.7      219      6      TestLucene70NormsFormat.testOutliers2
     0      0.5      214      1      
TestLucene70NormsFormat.testRandomExceptions
     0      0.5      214      1      TestLucene70NormsFormat.testShortRange
     0      2.7      219      6      TestLucene70NormsFormat.testSparseAllZeros
     0      0.5      214      1      TestLucene70NormsFormat.testSparseByteRange
     0      0.5      214      1      
TestLucene70NormsFormat.testSparseFullLongRange
     0      2.7      219      6      TestLucene70NormsFormat.testSparseLongRange
     0      0.5      214      1      TestLucene70NormsFormat.testSparseNCommon
     0      0.5      214      1      TestLucene70NormsFormat.testSparseOutliers
     0      0.5      214      1      TestLucene70NormsFormat.testSparseOutliers2
     0      0.5      214      1      
TestLucene70NormsFormat.testSparseShortRange
     0      0.5      214      1      TestLucene70NormsFormat.testThreads
     0      0.5      214      1      TestLucene70NormsFormat.testUndeadNorms
     0      0.2      401      1      TestNamedUpdateProcessors.test
     0      0.5      399      2      TestRandomFaceting.testRandomFaceting
     0      0.3      398      1      TestRecovery.testExistOldBufferLog
     0      0.2      403      1      
TestReplicationHandler.testFetchIndexShouldReportErrorsWhenTheyOccur
     0      0.3      399      1      
TestSimGenericDistributedQueue.testDistributedQueueBlocking
     0      0.3      314      1      
TestSolrCloudWithSecureImpersonation.testForwarding
     0      0.5      400      2      
TestWithCollection.testMultipleWithCollections
      123   0.2     1153      4      ComputePlanActionTest.testNodeAdded
      123   0.7     1204     10      HttpPartitionTest.test
      123   0.7     1183     13      HttpPartitionWithTlogReplicasTest.test
      123   0.5     1200      4      
LeaderElectionIntegrationTest.testSimpleSliceLeaderElection
      12    0.7      792      5      
DocValuesNotIndexedTest.testGroupingDVOnlySortFirst
      12    0.2      798      2      
FullSolrCloudDistribCmdsTest.testConcurrentIndexing
      12    0.2      798      2      
FullSolrCloudDistribCmdsTest.testIndexQueryDeleteHierarchical
      12    0.2      798      2      
FullSolrCloudDistribCmdsTest.testThatCantForwardToLeaderFails
      12    0.2      790      2      
MigrateRouteKeyTest.multipleShardMigrateTest
      1 3   0.2      807      3      CustomHighlightComponentTest.test
      1 3   0.5      813      5      
DistributedQueueTest.testDistributedQueueBlocking
      1 3   0.2      806      2      
TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete
      1 3   1.0      810      5      TestDynamicLoading.testDynamicLoading
      1 3  31.4       62     22      
TestXYMultiPolygonShapeQueries.testRandomBig
      1 3   0.2      800      2      UnloadDistributedZkTest.test
      1     0.2      405      1      AutoScalingHandlerTest.testReadApi
      1     0.2      405      1      
AutoScalingHandlerTest.testSuggestionsWithPayload
      1     4.2       24      1      
CdcrReplicationHandlerTest.testReplicationWithBufferedUpdates
      1     0.2      405      1      
ComputePlanActionTest.testNodeLostTriggerWithDeleteNodePreferredOp
      1     0.2      406      1      
FullSolrCloudDistribCmdsTest.testIndexingBatchPerRequestWithHttpSolrClient
      1     0.2      406      1      
FullSolrCloudDistribCmdsTest.testIndexingOneDocPerRequestWithHttpSolrClient
      1     7.3      437     32      MathExpressionTest.testCache
      1     0.2      403      1      
NodeAddedTriggerIntegrationTest.testNodeAddedTrigger
      1     0.4      277      1      OverseerTest.testReplay
      1     0.2      403      1      PeerSyncWithLeaderTest.test
      1     0.2      402      1      
ReindexCollectionTest.testSameTargetReindexing
      1     6.6      228     15      StreamDecoratorTest.testClassifyStream
      1    40.9      641    262      
TestBackwardsCompatibility.testAllVersionsTested
      1     0.3      400      1      
TestCloudSolrClientConnections.testAlreadyClosedClusterStateProvider
      1     0.3      399      1      TestJSONParser.testArray
      1     0.2      408      1      TestLeaderElectionWithEmptyReplica.test
      1     4.0       25      1      TestLongBitSet.testHugeCapacity
      1     0.5      405      2      TestOfflineSorter.testThreadSafety
      1     0.2      404      1      
TestPullReplicaErrorHandling.testPullReplicaDisconnectsFromZooKeeper
      1     2.6      418     11      
TestRandomChains.testRandomChainsWithLargeStrings
      1     0.2      404      1      TestRecovery.stressLogReplay
      1     0.2      404      1      
TestSimDistribStateManager.testHasDataReturnsTrueForExistingButEmptyNodes
      1     0.2      402      1      TestTlogReplica.testDeleteById
      1     0.2      402      1      TestUtilizeNode.test
       23   0.3      794      3      DeleteReplicaTest.deleteReplicaByCount
       23   0.3      794      6      
DeleteReplicaTest.deleteReplicaFromClusterState
       23   0.3      794      8      DeleteReplicaTest.deleteReplicaOnIndexing
       23   0.3      749      3      
DistribDocExpirationUpdateProcessorTest.testNoAuth
       23   0.3      787      7      ExecutePlanActionTest.testTaskTimeout
       23   0.3      753      2      MoveReplicaTest.testFailedMove
       23   0.3      778      2      
TestCloudSearcherWarming.testPeersyncFailureReplicationSuccess
       23   0.5      788      6      TestCryptoKeys.test
       23   0.3      801      4      
TestIndexWriterDelete.testDeleteAllNoDeadLock
       23   0.3      789      2      TestWithCollection.testAddReplicaSimple
       23   0.3      755      3      TestWithCollection.testAddReplicaWithPolicy
       23   0.3      755      2      TestWithCollection.testNodeAdded
       2    2.8      400     11      BasicDistributedZk2Test.test
       2    0.3      382      1      
CollectionsAPIAsyncDistributedZkTest.testAsyncRequests
       2    0.5      392      2      
FullSolrCloudDistribCmdsTest.testBasicUpdates
       2   26.9      349     94      FuzzySearchTest.testTooComplex
       2    0.5      372      2      
HealthCheckHandlerTest.testHealthCheckHandler
       2    0.3      391      1      HttpPartitionOnCommitTest.test
       2    0.3      383      1      MathExpressionTest.testZipFDistribution
       2    0.3      383      1      MetricsHandlerTest.test
       2    0.3      383      1      MetricsHandlerTest.testCompact
       2    0.3      390      1      
MetricsHistoryWithAuthIntegrationTest.testValuesAreCollected
       2    5.3       19      1      
MoveReplicaHDFSFailoverTest.testDataDirAndUlogAreMaintained
       2    5.3       19      1      
MoveReplicaHDFSFailoverTest.testOldReplicaIsDeleted
       2    5.3       19      1      
MoveReplicaHDFSFailoverTest.testOldReplicaIsDeletedInRaceCondition
       2    0.3      384      1      ReindexCollectionTest.testFailure
       2    0.3      386      1      ShardRoutingCustomTest.test
       2    0.3      333      1      
SoftAutoCommitTest.testHardCommitWithinAndSoftCommitMaxTimeMixedAdds
       2    0.3      333      1      
SoftAutoCommitTest.testSoftCommitWithinAndHardCommitMaxTimeMixedAdds
       2    0.3      387      1      
TestAssertingStoredFieldsFormat.testNumericField
       2    0.3      383      1      
TestBuiltInEvaluators.testDateFormatEvaluator
       2    0.3      381      1      TestCloudJSONFacetSKG.testRandom
       2    0.3      386      1      
TestCollectionsAPIViaSolrCloudCluster.testStopAllStartAll
       2    0.3      306      1      
TestDelegationWithHadoopAuth.testDelegationTokenRenew
       2   33.3       30     10      
TestNRTReplication.testIndexingWhileReplicaIsDown
       2    2.5      394     10      
TestPointFields.testLongPointFieldMultiValuedRangeFacet
       2    0.3      397      1      
TestReplicationHandler.doTestIndexAndConfigAliasReplication
       2    0.3      383      1      
TestSkipOverseerOperations.testSkipDownOperations
       2    2.8      395     11      
TestXYMultiPolygonShapeQueries.testRandomMedium
        3   0.3      361      1      
AutoAddReplicasIntegrationTest.testClusterPropOverridesCollecitonProp
        3   0.2      404      1      BasicZkTest.testBasic
        3   0.2      414      1      
ChaosMonkeySafeLeaderWithPullReplicasTest.test
        3  62.8      853    536      CheckHdfsIndexTest.doTest
        3   0.8      355      3      
CloudHttp2SolrClientTest.checkCollectionParameters
        3   0.8      355      3      
CloudHttp2SolrClientTest.customHttpClientTest
        3   1.1      355      4      
CloudHttp2SolrClientTest.preferLocalShardsTest
        3   0.8      355      3      
CloudHttp2SolrClientTest.preferReplicaTypesTest
        3   0.8      355      3      
CloudHttp2SolrClientTest.singleShardedPreferenceRules
        3   0.8      355      3      
CloudHttp2SolrClientTest.stateVersionParamTest
        3   1.1      355      4      CloudHttp2SolrClientTest.testAliasHandling
        3   0.8      355      3      
CloudHttp2SolrClientTest.testCollectionDoesntExist
        3   0.8      355      3      
CloudHttp2SolrClientTest.testInitializationWithSolrUrls
        3   0.8      355      3      
CloudHttp2SolrClientTest.testNonRetryableRequests
        3   1.1      355      4      
CloudHttp2SolrClientTest.testOverwriteOption
        3   0.8      355      3      
CloudHttp2SolrClientTest.testParallelUpdateQTime
        3   0.6      355      2      CloudHttp2SolrClientTest.testRouting
        3   0.8      355      3      CloudHttp2SolrClientTest.testShutdown
        3   0.6      355      2      
CloudHttp2SolrClientTest.testVersionsAreReturned
        3   0.8      355      3      
CloudHttp2SolrClientTest.testWrongZkChrootTest
        3   0.5      392      2      
CloudSolrClientTest.checkCollectionParameters
        3   0.3      392      1      CloudSolrClientTest.preferLocalShardsTest
        3   0.3      392      1      CloudSolrClientTest.preferReplicaTypesTest
        3   0.3      357      1      
CloudSolrClientTest.singleShardedPreferenceRules
        3   0.5      392      2      CloudSolrClientTest.stateVersionParamTest
        3   0.5      392      2      CloudSolrClientTest.testAliasHandling
        3   0.3      392      1      
CloudSolrClientTest.testInitializationWithSolrUrls
        3   0.3      392      1      
CloudSolrClientTest.testNonRetryableRequests
        3   0.3      392      1      CloudSolrClientTest.testOverwriteOption
        3   0.3      392      1      CloudSolrClientTest.testParallelUpdateQTime
        3   0.3      357      1      CloudSolrClientTest.testPing
        3   0.3      392      1      CloudSolrClientTest.testShutdown
        3   0.5      392      2      CloudSolrClientTest.testVersionsAreReturned
        3   0.3      392      1      CloudSolrClientTest.testWrongZkChrootTest
        3   0.3      399      1      
CollectionsAPIAsyncDistributedZkTest.testSolrJAPICalls
        3   1.3      397      5      
CollectionsAPIDistributedZkTest.addReplicaTest
        3   0.8      397      3      
CollectionsAPIDistributedZkTest.deleteCollectionOnlyInZk
        3   1.0      397      4      
CollectionsAPIDistributedZkTest.deleteCollectionRemovesStaleZkCollectionsNode
        3   0.8      397      3      
CollectionsAPIDistributedZkTest.deletePartiallyCreatedCollection
        3   0.3      397      1      
CollectionsAPIDistributedZkTest.testBadActionNames
        3   0.8      397      3      
CollectionsAPIDistributedZkTest.testCollectionReload
        3   1.0      397      4      
CollectionsAPIDistributedZkTest.testCollectionsAPI
        3   1.3      397      5      
CollectionsAPIDistributedZkTest.testCoresAreDistributedAcrossNodes
        3   1.0      397      4      
CollectionsAPIDistributedZkTest.testCreateNodeSet
        3   1.3      397      5      
CollectionsAPIDistributedZkTest.testCreateShouldFailOnExistingCore
        3   0.3      397      1      
CollectionsAPIDistributedZkTest.testCreationAndDeletion
        3   0.5      397      2      
CollectionsAPIDistributedZkTest.testDeleteNonExistentCollection
        3   0.8      397      3      
CollectionsAPIDistributedZkTest.testMaxNodesPerShard
        3   0.8      397      3      
CollectionsAPIDistributedZkTest.testMissingNumShards
        3   0.5      397      2      
CollectionsAPIDistributedZkTest.testMissingRequiredParameters
        3   0.8      397      3      
CollectionsAPIDistributedZkTest.testNoConfigSetExist
        3   0.8      397      3      
CollectionsAPIDistributedZkTest.testSpecificConfigsets
        3   0.8      397      3      
CollectionsAPIDistributedZkTest.testTooManyReplicas
        3   1.0      397      4      
CollectionsAPIDistributedZkTest.testZeroNumShards
        3   0.7      405      3      
CollectionsAPISolrJTest.testAddAndDeleteReplica
        3   0.2      405      1      
CollectionsAPISolrJTest.testAddAndDeleteReplicaProp
        3   0.7      405      3      
CollectionsAPISolrJTest.testBalanceShardUnique
        3   0.5      405      2      
CollectionsAPISolrJTest.testCloudInfoInCoreStatus
        3   1.5      405      6      CollectionsAPISolrJTest.testClusterProp
        3   1.4      370      5      CollectionsAPISolrJTest.testColStatus
        3   0.5      405      2      CollectionsAPISolrJTest.testCollectionProp
        3   0.5      405      2      
CollectionsAPISolrJTest.testCreateAndDeleteAlias
        3   0.5      405      2      
CollectionsAPISolrJTest.testCreateAndDeleteCollection
        3   0.7      405      3      
CollectionsAPISolrJTest.testCreateCollWithDefaultClusterPropertiesNewFormat
        3   1.7      405      7      
CollectionsAPISolrJTest.testCreateCollWithDefaultClusterPropertiesOldFormat
        3   0.7      405      3      
CollectionsAPISolrJTest.testCreateCollectionWithPropertyParam
        3   1.5      405      6      
CollectionsAPISolrJTest.testCreateWithDefaultConfigSet
        3   1.9      370      7      
CollectionsAPISolrJTest.testDeleteAliasedCollection
        3   1.2      405      5      CollectionsAPISolrJTest.testList
        3   1.0      405      4      
CollectionsAPISolrJTest.testModifyCollectionAttribute
        3   1.2      405      5      CollectionsAPISolrJTest.testOverseerStatus
        3   0.8      370      3      
CollectionsAPISolrJTest.testReadOnlyCollection
        3   1.6      370      6      
CollectionsAPISolrJTest.testRenameCollection
        3   0.7      405      3      CollectionsAPISolrJTest.testSplitShard
        3   0.2      406      1      ConnectionManagerTest.testLikelyExpired
        3   1.1      376      4      DeleteReplicaTest.deleteLiveReplicaTest
        3   0.5      376      2      
DeleteReplicaTest.deleteReplicaByCountForAllShards
        3   1.5      411      6      
DeleteReplicaTest.deleteReplicaFromClusterStateLegacy
        3   0.8      376      3      
DeleteReplicaTest.raceConditionOnDeleteAndRegisterReplica
        3   1.3      376      5      
DeleteReplicaTest.raceConditionOnDeleteAndRegisterReplicaLegacy
        3   0.7      405      3      DeleteShardTest.test
        3   0.2      405      1      
DeleteShardTest.testDirectoryCleanupAfterDeleteShard
        3   0.5      366      2      
DistribDocExpirationUpdateProcessorTest.testBasicAuth
        3   0.2      402      1      DistributedQueueTest.testDistributedQueue
        3   0.7      402      3      
DistributedQueueTest.testDistributedQueueCache
        3   0.2      402      1      DistributedQueueTest.testLeakChildWatcher
        3   0.5      402      2      DistributedQueueTest.testLocallyOffer
        3   0.7      402      3      DistributedQueueTest.testPeekElements
        3   0.3      367      1      
DocValuesNotIndexedTest.testGroupingDVOnlySortLast
        3   0.2      403      1      ExecutePlanActionTest.testExecute
        3   0.5      403      2      ExecutePlanActionTest.testIntegration
        3   0.7      403      3      ExecutePlanActionTest.testTaskFail
        3   0.3      370      1      
IndexSizeTriggerSizeEstimationTest.testEstimatedIndexSize
        3   0.3      366      1      IndexSizeTriggerTest.testInvalidSplitConfig
        3   0.3      366      1      IndexSizeTriggerTest.testMergeIntegration
        3   0.3      366      1      IndexSizeTriggerTest.testSplitConfig
        3   0.3      366      1      IndexSizeTriggerTest.testSplitIntegration
        3   0.3      366      1      IndexSizeTriggerTest.testTrigger
        3   0.3      366      1      IndexSizeTriggerTest.testValidProperties
        3   0.3      360      1      
JWTAuthPluginIntegrationTest.infoRequestWithoutToken
        3   0.3      360      1      JWTAuthPluginIntegrationTest.testMetrics
        3   0.2      403      1      LeaderElectionTest.testBasic
        3   0.5      403      2      LeaderElectionTest.testCancelElection
        3   0.5      403      2      LeaderElectionTest.testElection
        3   0.5      403      2      LeaderElectionTest.testParallelElection
        3   0.5      403      2      LeaderElectionTest.testStressElection
        3   0.2      404      1      LeaderFailureAfterFreshStartTest.test
        3   0.3      362      1      NestedShardedAtomicUpdateTest.test
        3   0.5      400      2      
NodeAddedTriggerIntegrationTest.testNodeAddedTriggerRestoreState
        3   0.3      398      1      NodeAddedTriggerTest.testListenerAcceptance
        3   0.3      398      1      NodeAddedTriggerTest.testRestoreState
        3   0.3      398      1      NodeAddedTriggerTest.testTrigger
        3   0.3      397      1      
NodeLostTriggerIntegrationTest.testNodeLostTriggerRestoreState
        3   0.3      398      1      
OutOfBoxZkACLAndCredentialsProvidersTest.testOpenACLUnsafeAllover
        3   0.3      398      1      
OutOfBoxZkACLAndCredentialsProvidersTest.testOutOfBoxSolrZkClient
        3   0.3      400      1      
OverriddenZkACLAndCredentialsProvidersTest.testAllCredentialsSolrZkClientFactoryUsingCompletelyNewProviders
        3   0.3      400      1      
OverriddenZkACLAndCredentialsProvidersTest.testAllCredentialsSolrZkClientFactoryUsingVMParamsProvidersButWithDifferentVMParamsNames
        3   0.3      400      1      
OverriddenZkACLAndCredentialsProvidersTest.testNoCredentialsSolrZkClientFactoryUsingCompletelyNewProviders
        3   0.3      400      1      
OverriddenZkACLAndCredentialsProvidersTest.testReadonlyCredentialsSolrZkClientFactoryUsingCompletelyNewProviders
        3   0.3      400      1      
OverriddenZkACLAndCredentialsProvidersTest.testReadonlyCredentialsSolrZkClientFactoryUsingVMParamsProvidersButWithDifferentVMParamsNames
        3   0.3      400      1      
OverriddenZkACLAndCredentialsProvidersTest.testWrongCredentialsSolrZkClientFactoryUsingCompletelyNewProviders
        3   0.3      400      1      
OverriddenZkACLAndCredentialsProvidersTest.testWrongCredentialsSolrZkClientFactoryUsingVMParamsProvidersButWithDifferentVMParamsNames
        3   0.3      400      1      
OverseerTaskQueueTest.testDistributedQueueCache
        3   0.3      400      1      OverseerTaskQueueTest.testLocallyOffer
        3   0.3      400      1      
PingRequestHandlerTest.testPingInClusterWithNoHealthCheck
        3   0.5      398      2      RecoveryAfterSoftCommitTest.test
        3   0.5      396      2      ReplicationFactorTest.test
        3   0.2      403      1      ShardRoutingTest.test
        3   0.7      412      3      ShardSplitTest.testSplitLocking
        3   0.8      377      3      ShardSplitTest.testSplitMixedReplicaTypes
        3   0.5      411      2      
ShardSplitTest.testSplitStaticIndexReplication
        3   0.3      353      1      SolrZkClientTest.getConfig
        3   0.3      353      1      SolrZkClientTest.testWrappingWatches
        3   0.3      398      1      SpatialHeatmapFacetsTest.testClassicFacets
        3   0.3      398      1      SpatialHeatmapFacetsTest.testJsonFacets
        3   0.3     1194      3      SpatialHeatmapFacetsTest.testPng
        3  63.2       57     36      StressHdfsTest.test
        3   0.3      397      1      SystemLogListenerTest.test
        3   2.6      427     11      TestAllFilesHaveChecksumFooter.test
        3   2.6      428     11      TestAllFilesHaveCodecHeader.test
        3   0.5      388      2      
TestCloudCollectionsListeners.testCollectionDeletion
        3   0.3      388      1      
TestCloudCollectionsListeners.testSimpleCloudCollectionsListener
        3   0.2      401      1      TestCloudSchemaless.test
        3   0.8      354      3      
TestCollectionStateWatchers.testCanWaitForNonexistantCollection
        3   0.8      354      3      
TestCollectionStateWatchers.testCollectionWatchWithShutdownOfActiveNode
        3   0.8      354      3      
TestCollectionStateWatchers.testCollectionWatchWithShutdownOfUnusedNode
        3   0.8      389      3      
TestCollectionStateWatchers.testDeletionsTriggerWatches
        3   0.6      354      2      
TestCollectionStateWatchers.testLiveNodeChangesTriggerWatches
        3   0.8      389      3      
TestCollectionStateWatchers.testPredicateFailureTimesOut
        3   0.8      389      3      
TestCollectionStateWatchers.testStateWatcherChecksCurrentStateOnRegister
        3   0.8      389      3      
TestCollectionStateWatchers.testWaitForStateChecksCurrentState
        3   0.8      389      3      
TestCollectionStateWatchers.testWaitForStateWatcherIsRetainedOnPredicateFailure
        3   0.5      389      2      
TestCollectionStateWatchers.testWatcherIsRemovedAfterTimeout
        3   0.5      389      2      
TestCollectionStateWatchers.testWatchesWorkForStateFormat1
        3   0.3      399      1      TestConfigSetsAPI.testCreate
        3   0.3      399      1      TestConfigSetsAPI.testList
        3   0.3      399      1      TestConfigSetsAPI.testUpload
        3   0.3      399      1      TestConfigSetsAPI.testUploadDisabled
        3   0.3      399      1      TestConfigSetsAPI.testUploadErrors
        3   0.3      399      1      
TestConfigSetsAPI.testUploadWithScriptUpdateProcessor
        3   0.3      399      1      
TestConfigSetsAPI.testUserAndTestDefaultConfigsetsAreSame
        3   0.3      400      1      TestDistribDocBasedVersion.test
        3   0.3      354      1      
TestDocCollectionWatcher.testCanWaitForNonexistantCollection
        3   0.6      354      2      
TestDocCollectionWatcher.testDeletionsTriggerWatches
        3   0.6      354      2      
TestDocCollectionWatcher.testPredicateFailureTimesOut
        3   0.6      354      2      
TestDocCollectionWatcher.testStateWatcherChecksCurrentStateOnRegister
        3   0.6      354      2      
TestDocCollectionWatcher.testWaitForStateChecksCurrentState
        3   0.6      354      2      
TestDocCollectionWatcher.testWaitForStateWatcherIsRetainedOnPredicateFailure
        3   0.6      354      2      
TestDocCollectionWatcher.testWatcherIsRemovedAfterTimeout
        3   0.6      354      2      
TestDocCollectionWatcher.testWatchesWorkForStateFormat1
        3  14.3       21      3      
TestDocTermOrdsUninvertLimit.testTriggerUnInvertLimit
        3   0.2      414      1      TestDuelingCodecs.testCrazyReaderEquals
        3   4.5       22      1      
TestDuelingCodecsAtNight.testCrazyReaderEquals
        3   0.3      368      1      TestDynamicLoadingUrl.testDynamicLoadingUrl
        3   0.2      419      1      
TestIndexWriterWithThreads.testIOExceptionDuringWriteSegmentWithThreads
        3   0.3      352      1      TestJaegerConfigurator.testInjected
        3   0.3      355      1      TestLBHttp2SolrClient.testTwoServers
        3   0.3      387      1      TestLTROnSolrCloud.testSimpleQuery
        3   1.2      402      5      TestPointFields.testDoublePointStats
        3   0.2      402      1      
TestPointFields.testIntPointFieldMultiValuedRangeFacet
        3   1.0      406      4      TestRandomDVFaceting.testRandomFaceting
        3  27.1       48     13      TestSQLHandler.doTest
        3   0.2      415      1      TestSameScoresWithThreads.test
        3   2.6      427     11      TestShardSearching.testSimple
        3   0.3      397      1      TestSimTriggerIntegration.testCooldown
        3   0.2      419      1      
TestSimpleExplanationsWithFillerDocs.testMultiFieldBQofPQ5
        3   0.3      397      1      TestSolrCloudSnapshots.testSnapshots
        3   0.2      402      1      TestSolrConfigHandlerConcurrent.test
        3   0.3      400      1      TestWithCollection.testCreateCollection
        3   0.3      400      1      
TestWithCollection.testCreateCollectionNoWithCollection
        3   0.3      400      1      TestWithCollection.testDeleteWithCollection
        3   0.5      400      2      
TestWithCollection.testMoveReplicaMainCollection
        3   0.3      400      1      
TestWithCollection.testMoveReplicaWithCollection
        3   0.2      401      1      ZkCLITest.testInvalidZKAddress
        3   0.2      401      1      ZkCLITest.testPutFile
        3   0.3      394      1      ZkSolrClientTest.testMakeRootNode
        3   0.3      394      1      ZkSolrClientTest.testReconnect
        3   0.3      394      1      ZkSolrClientTest.testWatchChildren



***********************Annotations report

*****************AwaitsFix Annotations:


************Lucene AwaitsFix
TestControlledRealTimeReopenThread.testCRTReopen
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-5737";)

TestICUNormalizer2CharFilter.testRandomStrings
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-5595";)

TestICUTokenizerCJK.TestICUTokenizerCJK suite
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/LUCENE-8222";)

TestMoreLikeThis.testMultiFieldShouldReturnPerFieldBooleanQuery
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-7161";)


    ************Solr AwaitsFix
AutoAddReplicasIntegrationTest.testRapidStopStartStopWithPropChange
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13811";)

CdcrBidirectionalTest.testBiDir
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-12524";)

CdcrBootstrapTest.testBootstrapWithContinousIndexingOnSourceCluster
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-12028";)

CollectionsAPISolrJTest.testCreateAndDeleteShard
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-13021";)

ComputePlanActionTest.testNodeLost
   
@LuceneTestCase.AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)

ConcurrentCreateRoutedAliasTest.ConcurrentCreateRoutedAliasTest suite
   @LuceneTestCase.AwaitsFix(bugUrl = 
"https://issues.apache.org/jira/browse/SOLR-12386";) // "Can't find resource"

LeaderTragicEventTest.LeaderTragicEventTest suite
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13237";)

MoveReplicaHDFSTest.MoveReplicaHDFSTest suite
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13924";)

MoveReplicaHDFSTest.testFailedMove
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12080";) // 
added 03-Oct-2018

ReplaceNodeNoTargetTest.ReplaceNodeNoTargetTest suite
   @LuceneTestCase.AwaitsFix(bugUrl = 
"https://issues.apache.org/jira/browse/SOLR-11067";)

ReplaceNodeNoTargetTest.test
   @LuceneTestCase.AwaitsFix(bugUrl = 
"https://issues.apache.org/jira/browse/SOLR-11067";)

RoutedAliasUpdateProcessorTest.alias,
   
@org.apache.lucene.util.LuceneTestCase.AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13696";)

SSLMigrationTest.SSLMigrationTest suite
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) // 
17-Mar-2018

SaslZkACLProviderTest.testSaslZkACLProvider
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-13075";)

ScheduledMaintenanceTriggerTest.testInactiveShardCleanup
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) // 
17-Mar-2018

ScheduledTriggerTest.testTrigger
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) // 
added 20-Sep-2018

SearchRateTriggerIntegrationTest.testDeleteNode
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13163";)

SearchRateTriggerTest.testTrigger
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)

SolrExporterIntegrationTest.SolrExporterIntegrationTest suite
   
@org.apache.lucene.util.LuceneTestCase.AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13786";)

Tagger2Test.testStopWords
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-8344";)

TestCloudJSONFacetSKGEquiv.testBespokeAllBuckets
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-14467";)

TestHierarchicalDocBuilder.testThreeLevelHierarchy
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-12801";) // 
this test fails easily under beasting

TestImpersonationWithHadoopAuth.testForwarding
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/HADOOP-9893";)

TestJsonFacetRefinement.testProcessEmptyRefinement
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12556";)

TestJsonFacetRefinement.testSortedSubFacetRefinementWhenParentOnlyReturnedByOneShardProcessEmpty
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12556";)

TestLTRReRankingPipeline.testDifferentTopN
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-11134";)

TestMinMaxOnMultiValuedField.testDoubleFieldCache
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-6709";)

TestMinMaxOnMultiValuedField.testFloatFieldCache
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-6709";)

TestMinMaxOnMultiValuedField.testIntFieldCache
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-6709";)

TestMinMaxOnMultiValuedField.testLongFieldCache
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-6709";)

TestPullReplica.TestPullReplica suite
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)

TestSimComputePlanAction.testNodeLost
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-12028";) // 
if you beast this, eventually you will see

TestSimExtremeIndexing.TestSimExtremeIndexing suite
   
@org.apache.lucene.util.LuceneTestCase.AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12923";)

TestSimLargeCluster.testAddNode
   @AwaitsFix( bugUrl = "https://issues.apache.org/jira/browse/SOLR-14275";)

TestSimLargeCluster.testBasic
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) // 
this test hits a timeout easily

TestStressRecovery.TestStressRecovery suite
   
@LuceneTestCase.AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)
 // 6-Sep-2018

TestTlogReplayVsRecovery.TestTlogReplayVsRecovery suite
   
@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13486;https://issues.apache.org/jira/browse/SOLR-14183";)

TimeRoutedAliasUpdateProcessorTest.testDateMathInStart
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13943";)

TriLevelCompositeIdRoutingTest.test
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13369";)



*****************BadApple Annotations:

************Lucene BadApple

************Solr BadApple
MoveReplicaHDFSTest.testNormalFailedMove
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) // 
14-Oct-2018

SharedFSAutoReplicaFailoverTest.SharedFSAutoReplicaFailoverTest suite
   
@LuceneTestCase.BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)
 // added 20-Jul-2018

TimeRoutedAliasUpdateProcessorTest.TimeRoutedAliasUpdateProcessorTest suite
   @LuceneTestCase.BadApple(bugUrl = 
"https://issues.apache.org/jira/browse/SOLR-13059";)


---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org

Reply via email to