thcipriani added a comment.
I made a script that parses all Jenkins junit files and puts them in a database. The database (see here <https://data.releng.team/tests>) has about 5 million test cases <https://data.releng.team/tests/testcases> at this point. A test is flaky when it runs twice on the same code with different results, so I made a database query that finds any tests that both failed and passed for the same SHA1. Here's the jupyter notebook <https://gitlab.wikimedia.org/thcipriani/flaky-tests#flaky-tests> with the results. Is this useful at all? TASK DETAIL https://phabricator.wikimedia.org/T277205 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Addshore, thcipriani Cc: thcipriani, mmodell, alaa_wmde, Krinkle, Addshore, Aklapper, Invadibot, maantietaja, Akuckartz, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, zeljkofilipin, Mbch331, Jay8g, hashar
_______________________________________________ Wikidata-bugs mailing list -- [email protected] To unsubscribe send an email to [email protected]
