No annotation changes will happen this week.

Summary:
Processing file (History bit 3): HOSS-2019-088-05.csv
Processing file (History bit 2): HOSS-2019-08-19.csv
Processing file (History bit 1): HOSS-2019-08-12.csv
Processing file (History bit 0): HOSS-2019-07-29.csv


Number of AwaitsFix: 38 Number of BadApples: 11


Raw fail count by week totals, most recent week first (corresponds to bits):
Week: 0  had  28 failures
Week: 1  had  18 failures
Week: 2  had  21 failures
Week: 3  had  47 failures


**Annotated tests that didn't fail in the last 4 weeks.

  **Tests removed from the next two lists because they were specified in 
'doNotEnable' in the properties file
     MoveReplicaHDFSTest.testNormalFailedMove

  **Annotations will be removed from the following tests because they haven't 
failed in the last 4 rollups.

  **Methods: 3
   FullSolrCloudDistribCmdsTest.test
   SolrZkClientTest.testSimpleUpdateACLs
   TestDistributedStatsComponentCardinality.test


********Failures in Hoss' reports for the last 4 rollups.

There were 80 unannotated tests that failed in Hoss' rollups. Ordered by the 
date I downloaded the rollup file, newest->oldest. See above for the dates the 
files were collected 
These tests were NOT BadApple'd or AwaitsFix'd
All tests that failed 4 weeks running will be BadApple'd unless there are 
objections

Failures in the last 4 reports..
   Report   Pct     runs    fails           test
     0123   1.3      365      8      
AliasIntegrationTest.testClusterStateProviderAPI
     0123  26.7       44     15      
HdfsAutoAddReplicasIntegrationTest.testSimple
************ Will BadApple all tests above this line except ones listed at the 
top**************

DO NOT ENABLE LIST:
    MoveReplicaHDFSTest.testFailedMove
    MoveReplicaHDFSTest.testNormalFailedMove
    TestControlledRealTimeReopenThread.testCRTReopen
    TestICUNormalizer2CharFilter.testRandomStrings
    TestICUTokenizerCJK
    TestImpersonationWithHadoopAuth.testForwarding
    TestLTRReRankingPipeline.testDifferentTopN
    TestRandomChains


DO NOT ANNOTATE LIST
    CdcrBidirectionalTest.testBiDir
    IndexSizeTriggerTest.testMergeIntegration
    IndexSizeTriggerTest.testMixedBounds
    IndexSizeTriggerTest.testSplitIntegration
    IndexSizeTriggerTest.testTrigger
    InfixSuggestersTest.testShutdownDuringBuild
    ShardSplitTest.test
    ShardSplitTest.testSplitMixedReplicaTypes
    ShardSplitTest.testSplitWithChaosMonkey
    TestLatLonShapeQueries.testRandomBig
    TestRandomChains.testRandomChainsWithLargeStrings
    TestTriggerIntegration.testSearchRate

Processing file (History bit 3): HOSS-2019-088-05.csv
Processing file (History bit 2): HOSS-2019-08-19.csv
Processing file (History bit 1): HOSS-2019-08-12.csv
Processing file (History bit 0): HOSS-2019-07-29.csv


Number of AwaitsFix: 38 Number of BadApples: 11


Raw fail count by week totals, most recent week first (corresponds to bits):
Week: 0  had  28 failures
Week: 1  had  18 failures
Week: 2  had  21 failures
Week: 3  had  47 failures


**Annotated tests that didn't fail in the last 4 weeks.

  **Tests removed from the next two lists because they were specified in 
'doNotEnable' in the properties file
     MoveReplicaHDFSTest.testNormalFailedMove

  **Annotations will be removed from the following tests because they haven't 
failed in the last 4 rollups.

  **Methods: 3
   FullSolrCloudDistribCmdsTest.test
   SolrZkClientTest.testSimpleUpdateACLs
   TestDistributedStatsComponentCardinality.test


********Failures in Hoss' reports for the last 4 rollups.

There were 80 unannotated tests that failed in Hoss' rollups. Ordered by the 
date I downloaded the rollup file, newest->oldest. See above for the dates the 
files were collected 
These tests were NOT BadApple'd or AwaitsFix'd
All tests that failed 4 weeks running will be BadApple'd unless there are 
objections

Failures in the last 4 reports..
   Report   Pct     runs    fails           test
     0123   1.3      365      8      
AliasIntegrationTest.testClusterStateProviderAPI
     0123  26.7       44     15      
HdfsAutoAddReplicasIntegrationTest.testSimple
************ Will BadApple all tests above this line except ones listed at the 
top**************



     01 3   6.2      428    150      BasicAuthIntegrationTest.testBasicAuth
     01 3   1.4      268      3      RollingRestartTest.test
     0 23   1.0      351      6      HttpPartitionWithTlogReplicasTest.test
     0 23   1.4      276      3      TestCloudJSONFacetJoinDomain.testRandom
     0  3  16.7       19      3      
CdcrReplicationHandlerTest.testReplicationWithBufferedUpdates
     0  3   4.0      252      7      TestRandomChains.testRandomChains
     0  3   3.0      252      7      
TestRandomChains.testRandomChainsWithLargeStrings
     0  3   1.5      201      3      TestStressLiveNodes.testStress
     0  3   1.4      202      2      
TestUseDocValuesAsStored.testDuplicateMultiValued
     0      8.3       12      1      
CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync
     0      2.0      101      2      CollectionPropsTest.testWatcher
     0      1.5       67      1      
DimensionalRoutedAliasUpdateProcessorTest.testTimeCat
     0     12.5        8      1      HdfsWriteToMultipleCollectionsTest.test
     0      1.0       97      1      HttpPartitionTest.test
     0      1.4       72      1      LeaderVoteWaitTimeoutTest.basicTest
     0      1.3       75      1      OverseerTest.testShardLeaderChange
     0      2.7       73      2      RulesTest.doIntegrationTest
     0      1.3       79      1      
StatsReloadRaceTest.testParallelReloadAndStats
     0     16.7        6      1      StressHdfsTest.test
     0      1.0       98      1      
TestLucene80DocValuesFormat.testTermsEnumVariableWidth
     0      1.0       96      1      
TestRunWithRestrictedPermissions.testCompletelyForbidden1
     0      1.0       96      1      
TestRunWithRestrictedPermissions.testCompletelyForbidden2
     0      1.0       96      1      
TestRunWithRestrictedPermissions.testNormallyAllowedStuff
      123  22.2       43      7      ShardSplitTest.testSplitWithChaosMonkey
      123   1.4      284      5      SystemCollectionCompatTest.testBackCompat
      123   7.1      300     15      TestCloudJSONFacetSKG.testRandom
      1 3   1.9      255      4      LeaderFailoverAfterPartitionTest.test
      1 3   1.0      275     53      TestContainerReqHandler.testRuntimeLib
      1     1.2       81      1      
CdcrBootstrapTest.testBootstrapWithMultipleReplicas
      1     1.0      103      1      CreateRoutedAliasTest.testV2
      1     2.6       78      2      
DimensionalRoutedAliasUpdateProcessorTest.testCatTime
      1     1.5       65      1      IndexSizeEstimatorTest.testEstimator
      1     1.2       84      1      TestCloudJSONFacetSKG.testBespoke
      1     1.8      109      2      
TestConcurrentFacetedIndexing.testConcurrency
      1     0.9      111      1      TestIndexFileDeleter.testExcInDecRef
       2    1.0      100      1      
AuditLoggerIntegrationTest.testQueuedTimeMetric
       2    1.5       68      1      
CollectionsAPIDistributedZkTest.testCollectionsAPI
       2   53.3       15      8      ShardSplitTest.test
       2    1.4       71      1      
TestCollectionStateWatchers.testLiveNodeChangesTriggerWatches
       2    1.0       97      1      TestDemoParallelLeafReader.testBasic
       2    1.0       97      1      
TestDemoParallelLeafReader.testRandomMultipleSchemaGens
       2    1.3       79      1      TestExportWriter.testIndexOrder
       2    1.3       76      1      TestLBHttp2SolrClient.testTwoServers
       2    1.3       76      1      TestLBHttpSolrClient.testReliability
       2   11.1        9      1      TestXYPolygonShapeQueries.testRandomBig
       2    1.4       73      1      
TestZKPropertiesWriter.testZKPropertiesWriter
        3   1.6      128      2      AutoScalingHandlerTest.testReadApi
        3   0.7      149      1      CollectionPropsTest.testReadWriteCached
        3   0.8      122      1      LeaderElectionTest.testStressElection
        3   0.8      128      1      
LegacyCloudClusterPropTest.testCreateCollectionSwitchLegacyCloud
        3   1.6      129      2      
MetricsHistoryWithAuthIntegrationTest.testValuesAreCollected
        3   2.3       87      2      SplitByPrefixTest.doTest
        3   9.1       11      1      Test2BPostings.test
        3   0.7      151      1      TestCachePurging.testBackgroundPurges
        3   0.7      147      1      TestCloudSchemaless.test
        3   7.6      172     13      
TestContainerReqHandler.testPluginGlobalLoader
        3  30.2      172     52      
TestContainerReqHandler.testRuntimeLibWithSig2048
        3  31.4      172     54      
TestContainerReqHandler.testRuntimeLibWithSig512
        3   0.8      125      1      
TestDelegationWithHadoopAuth.testDelegationTokenRenew
        3   2.0      151      3      TestDynamicLoadingUrl.testDynamicLoadingUrl
        3   0.9      117      1      TestInPlaceUpdatesDistrib.test
        3   0.7      150      1      
TestIndexingSequenceNumbers.testStressConcurrentCommit
        3   0.8      125      1      TestJaegerConfigurator.testInjected
        3   9.1       11      1      
TestLucene80DocValuesFormat.testSortedVariableLengthManyVsStoredFields
        3   0.7      153      1      TestSearcherManager.testSearcherManager
        3   0.8      129      1      
TestSimLargeCluster.testCreateLargeSimCollections
        3   0.8      123      1      
TestSolrCloudWithDelegationTokens.testDelegationTokenRenew



***********************Annotations report
   Number of AwaitsFix: 38 Number of BadApples: 11

*****************AwaitsFix Annotations:


************Lucene AwaitsFix
TestControlledRealTimeReopenThread.testCRTReopen
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-5737";)

TestICUNormalizer2CharFilter.testRandomStrings
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-5595";)

TestICUTokenizerCJK.TestICUTokenizerCJK suite
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/LUCENE-8222";)

TestMoreLikeThis.testMultiFieldShouldReturnPerFieldBooleanQuery
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-7161";)


    ************Solr AwaitsFix
CdcrBidirectionalTest.testBiDir
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-12524";)

CdcrBootstrapTest.testBootstrapWithContinousIndexingOnSourceCluster
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-12028";)

CollectionsAPISolrJTest.testCreateAndDeleteShard
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-13021";)

ComputePlanActionTest.testNodeLost
   
@LuceneTestCase.AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)

ConcurrentCreateRoutedAliasTest.ConcurrentCreateRoutedAliasTest suite
   @LuceneTestCase.AwaitsFix(bugUrl = 
"https://issues.apache.org/jira/browse/SOLR-12386";) // "Can't find resource"

LeaderTragicEventTest.LeaderTragicEventTest suite
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13237";)

MoveReplicaHDFSTest.testFailedMove
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12080";) // 
added 03-Oct-2018

NodeMarkersRegistrationTest.testNodeMarkersRegistration
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13376";)

ReplaceNodeNoTargetTest.ReplaceNodeNoTargetTest suite
   @LuceneTestCase.AwaitsFix(bugUrl = 
"https://issues.apache.org/jira/browse/SOLR-11067";)

ReplaceNodeNoTargetTest.test
   @LuceneTestCase.AwaitsFix(bugUrl = 
"https://issues.apache.org/jira/browse/SOLR-11067";)

SSLMigrationTest.SSLMigrationTest suite
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) // 
17-Mar-2018

SaslZkACLProviderTest.testSaslZkACLProvider
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-13075";)

ScheduledMaintenanceTriggerTest.testInactiveShardCleanup
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) // 
17-Mar-2018

ScheduledTriggerTest.testTrigger
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) // 
added 20-Sep-2018

SearchRateTriggerIntegrationTest.testDeleteNode
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13163";)

SearchRateTriggerTest.testTrigger
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)

Tagger2Test.testStopWords
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-8344";)

TestCollapseQParserPlugin.testStringCollapse
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-11974";)

TestHierarchicalDocBuilder.testThreeLevelHierarchy
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-12801";) // 
this test fails easily under beasting

TestImpersonationWithHadoopAuth.testForwarding
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/HADOOP-9893";)

TestJsonFacetRefinement.testProcessEmptyRefinement
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12556";)

TestJsonFacetRefinement.testSortedSubFacetRefinementWhenParentOnlyReturnedByOneShardProcessEmpty
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12556";)

TestLTRReRankingPipeline.testDifferentTopN
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-11134";)

TestMinMaxOnMultiValuedField.testDoubleFieldCache
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-6709";)

TestMinMaxOnMultiValuedField.testFloatFieldCache
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-6709";)

TestMinMaxOnMultiValuedField.testIntFieldCache
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-6709";)

TestMinMaxOnMultiValuedField.testLongFieldCache
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-6709";)

TestPullReplica.TestPullReplica suite
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)

TestSimComputePlanAction.testNodeLost
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-12028";) // 
if you beast this, eventually you will see

TestSimExtremeIndexing.TestSimExtremeIndexing suite
   
@org.apache.lucene.util.LuceneTestCase.AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12923";)

TestSimLargeCluster.testBasic
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) // 
this test hits a timeout easily

TestStressRecovery.TestStressRecovery suite
   
@LuceneTestCase.AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)
 // 6-Sep-2018

TestTlogReplica.TestTlogReplica suite
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-12313";)

TriLevelCompositeIdRoutingTest.test
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13369";)



*****************BadApple Annotations:

************Lucene BadApple

************Solr BadApple
FullSolrCloudDistribCmdsTest.test
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) // 
annotated on: 24-Dec-2018

HdfsNNFailoverTest.HdfsNNFailoverTest suite
   
@LuceneTestCase.BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)
 // 12-Jun-2018

HdfsRecoveryZkTest.HdfsRecoveryZkTest suite
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)

MoveReplicaHDFSTest.testNormalFailedMove
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) // 
14-Oct-2018

MultiThreadedOCPTest.test
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) // 
annotated on: 24-Dec-2018

SharedFSAutoReplicaFailoverTest.SharedFSAutoReplicaFailoverTest suite
   
@LuceneTestCase.BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)
 // added 20-Jul-2018

SolrZkClientTest.testSimpleUpdateACLs
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) // 
annotated on: 24-Dec-2018

TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) // 
6-Sep-2018

TestDistributedStatsComponentCardinality.test
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) // 
14-Oct-2018

TimeRoutedAliasUpdateProcessorTest.TimeRoutedAliasUpdateProcessorTest suite
   @LuceneTestCase.BadApple(bugUrl = 
"https://issues.apache.org/jira/browse/SOLR-13059";)


---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org

Reply via email to