Hi Erick, I think it’s valuable to continue the BadApple process as you’re currently running it. I’m guessing most people will not engage, but some will, myself included (though I don’t claim to read the list every week).
I’m working on fixing InfixSuggestersTest.testShutdownDuringBuild (SOLR-12606), so please don’t BadApple it. Thanks, -- Steve www.lucidworks.com > On Jul 30, 2018, at 1:52 PM, Erick Erickson <[email protected]> wrote: > > Is anybody paying the least attention to this or should I just stop bothering? > > I'd hoped to get to a point where we could get at least semi-stable > and start whittling away at the backlog. But with an additional 63 > tests to BadApple (a little fudging here because of some issues with > counting suite-level tests .vs. individual test) it doesn't seem like > we're going in the right direction at all. > > Unless there's some value here, defined by people stepping up and at > least looking (and once a week is not asking too much) at the names of > the tests I'm going to BadApple to see if they ring any bells, I'll > stop wasting my time. > > There are currently 100 BadApple tests. That number will increase by a > hefty percentage _this week alone_. > > I suppose I'll just bet the latest example of tilting at this windmill. > > Erick > > > > **Annotated tests/suites that didn't fail in the last 4 weeks. > > > **Annotations will be removed from the following tests because they > haven't failed in the last 4 rollups. > > **Methods: 12 > AddReplicaTest.test > DeleteReplicaTest.deleteReplicaFromClusterState > LeaderVoteWaitTimeoutTest.testMostInSyncReplicasCanWinElection > MaxSizeAutoCommitTest > OverseerRolesTest.testOverseerRole > PeerSyncReplicationTest.test > RecoveryZkTest.test > RollingRestartTest.test > TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader > TestCloudPivotFacet.test > TestLargeCluster.testSearchRate > TestPullReplicaErrorHandling.throws > > **Suites: 0 > > > ********Failures in Hoss' reports for the last 4 rollups. > > All tests that failed 4 weeks running will be BadApple'd unless there > are objections > > Failures in the last 4 reports.. > Report Pct runs fails test > 0123 0.9 1689 27 AutoAddReplicasIntegrationTest.testSimple > 0123 1.1 1698 36 > CdcrBootstrapTest.testConvertClusterToCdcrAndBootstrap > 0123 0.9 1430 30 ChaosMonkeyNothingIsSafeTest(suite) > 0123 0.4 1453 16 ChaosMonkeyNothingIsSafeTest.test > 0123 0.4 1726 26 CloudSolrClientTest.preferLocalShardsTest > 0123 0.7 1726 64 CloudSolrClientTest.preferReplicaTypesTest > 0123 1.9 1682 34 > CollectionsAPIAsyncDistributedZkTest.testAsyncIdRaceCondition > 0123 0.9 1676 14 > CollectionsAPIDistributedZkTest.testCollectionsAPI > 0123 1.1 1717 13 ComputePlanActionTest.testNodeLost > 0123 0.2 1721 13 > ComputePlanActionTest.testNodeWithMultipleReplicasLost > 0123 0.4 1684 30 DistributedMLTComponentTest.test > 0123 0.4 1707 9 DocValuesNotIndexedTest.testGroupingDVOnly > 0123 0.4 1642 9 FullSolrCloudDistribCmdsTest.test > 0123 0.9 1663 49 GraphExpressionTest(suite) > 0123 0.4 1693 21 GraphExpressionTest.testShortestPathStream > 0123 1.8 1660 41 GraphTest(suite) > 0123 0.9 1686 20 GraphTest.testShortestPathStream > 0123 72.7 88 70 HdfsChaosMonkeySafeLeaderTest(suite) > 0123 1.3 1622 32 HttpSolrCallGetCoreTest(suite) > 0123 16.6 1992 223 > InfixSuggestersTest.testShutdownDuringBuild > 0123 0.4 1661 12 LargeVolumeJettyTest(suite) > 0123 0.4 1685 12 LargeVolumeJettyTest.testMultiThreaded > 0123 0.9 1661 9 > LeaderElectionIntegrationTest.testSimpleSliceLeaderElection > 0123 3.2 1695 55 > MetricTriggerIntegrationTest.testMetricTrigger > 0123 3.9 1624 84 MoveReplicaHDFSTest.testFailedMove > 0123 4.2 1716 71 > ScheduledTriggerIntegrationTest.testScheduledTrigger > 0123 2.2 1626 37 SchemaApiFailureTest(suite) > 0123 38.1 422 164 ShardSplitTest.test > 0123 9.2 329 26 ShardSplitTest.testSplitMixedReplicaTypes > 0123 0.7 1701 24 SolrCloudReportersTest.testDefaultPlugins > 0123 0.9 1701 36 > SolrCloudReportersTest.testExplicitConfiguration > 0123 1.9 1683 25 SolrJmxReporterCloudTest.testJmxReporter > 0123 11.8 568 12 StreamDecoratorTest.testClassifyStream > 0123 10.5 1133 60 StreamDecoratorTest.testExecutorStream > 0123 2.6 1133 16 > StreamDecoratorTest.testParallelComplementStream > 0123 5.3 1134 15 > StreamDecoratorTest.testParallelDaemonCommitStream > 0123 10.5 1134 66 > StreamDecoratorTest.testParallelExecutorStream > 0123 7.9 1133 24 > StreamDecoratorTest.testParallelFetchStream > 0123 7.9 1133 39 > StreamDecoratorTest.testParallelHavingStream > 0123 7.9 1133 25 > StreamDecoratorTest.testParallelMergeStream > 0123 17.6 568 24 > StreamDecoratorTest.testParallelPriorityStream > 0123 5.3 1133 19 > StreamDecoratorTest.testParallelReducerStream > 0123 2.6 1131 10 > StreamDecoratorTest.testParallelUniqueStream > 0123 2.6 1133 13 > StreamDecoratorTest.testParallelUpdateStream > 0123 1.1 880 22 > StreamExpressionTest.testParallelTopicStream > 0123 11.8 129 10 StressHdfsTest(suite) > 0123 0.2 1644 4 > TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeaderAfterRestart > 0123 0.7 1533 6 > TestDelegationWithHadoopAuth.testDelegationTokenRenew > 0123 0.4 1666 29 TestDistribIDF.testMultiCollectionQuery > 0123 1.5 1474 18 TestDistributedSearch.test > 0123 8.3 130 11 > TestGenericDistributedQueue.testDistributedQueue > 0123 0.5 1249 41 TestHdfsCloudBackupRestore.test > 0123 2.5 1433 25 TestHdfsUpdateLog(suite) > 0123 3.9 1681 40 TestInPlaceUpdatesDistrib.test > 0123 1.8 1660 23 TestLTROnSolrCloud(suite) > 0123 0.9 1679 12 TestLTROnSolrCloud.testSimpleQuery > 0123 1.1 1639 58 TestLocalFSCloudBackupRestore.test > 0123 20.3 1963 394 > TestMiniSolrCloudClusterSSL.testSslWithCheckPeerName > 0123 7.5 1635 103 TestSQLHandler(suite) > 0123 7.5 1751 109 TestSQLHandler.doTest > 0123 0.2 1648 8 TestTlogReplica(suite) > 0123 8.3 178 85 TestTlogReplica.testCreateDelete > 0123 12.3 868 102 > TestTriggerIntegration.testNodeLostTriggerRestoreState > <e-mail-2018-07-30.txt> > --------------------------------------------------------------------- > To unsubscribe, e-mail: [email protected] > For additional commands, e-mail: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
