Do we have any long term (aka "longitudinal") pass/fail rates for tests?

SharedFSAutoReplicaFailoverTest in particular is kinda-sorta tied to HDFS,
and that's going away to a plug-in for 9.0.  The shared file system notion
isn't well supported in SolrCloud, I think.

~ David Smiley
Apache Lucene/Solr Search Developer
http://www.linkedin.com/in/davidwsmiley


On Mon, Aug 3, 2020 at 7:26 AM Erick Erickson <erickerick...@gmail.com>
wrote:

> There are several tests that are causing a lot of noise:
>
> SharedFSAutoReplicaFailoverTest is failing 90%+ of the time.
> TestBulkSchemaConcurrent 31%
> StressHdfsTest  16%
> SchemaApiFailureTest 13.88%
>
> I encourage people to look at:
> http://fucit.org/solr-jenkins-reports/failure-report.html and see if
> anything looks like it is affected by recent work. TestBulkSchemaConcurrent
> has been failing off and on for a long time, but the failure rate picked up
> dramatically in the last couple of weeks. Ditto SchemaApiFailureTest.
>
> Do we even care about Hdfs? Are we deprecating it or not?
>
> Holding relatively steady otherwise:
>
> Raw fail count by week totals, most recent week first (corresponds to
> bits):
> Week: 0  had  82 failures
> Week: 1  had  94 failures
> Week: 2  had  502 failures
> Week: 3  had  19 failures
>
>
> ********Failures in Hoss' reports for the last 4 rollups.
>
> There were 562 unannotated tests that failed in Hoss' rollups. Ordered by
> the date I downloaded the rollup file, newest->oldest. See above for the
> dates the files were collected
> These tests were NOT BadApple'd or AwaitsFix'd
>
> Failures in the last 4 reports..
>    Report   Pct     runs    fails           test
>      0123   0.3     1271      8      RollingRestartTest.test
>      0123  93.3       41     36      SharedFSAutoReplicaFailoverTest.test
>      0123   3.5      627     16
> TestCircuitBreaker.testBuildingMemoryPressure
>      0123   1.0      627      8
> TestCircuitBreaker.testResponseWithCBTiming
>      0123   5.8     1483     79      TestContainerPlugin.testApiFromPackage
>      0123   2.3     1335     23      TestDistributedGrouping.test
> ********************************************
>
>
> Full report:
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
> For additional commands, e-mail: dev-h...@lucene.apache.org

Reply via email to