Re: Mesos Flakiness Statistics

2018-10-17 Thread Vinod Kone
This is great. Thanks Benno for sharing! What did you use to do the analysis? I would love it if we can have graphs that we can run on TVs. On Mon, Oct 15, 2018 at 5:23 AM Benno Evers wrote: > > Is there any reason the first portion of the test name is being > truncated? > > There is, although

Re: Mesos Flakiness Statistics

2018-10-15 Thread Benno Evers
> Is there any reason the first portion of the test name is being truncated? There is, although it is slightly embarrassing: We currently only store the detailed data including full test case name and platform for about a week, for anything older than that the abridged version is the best I could

Re: Mesos Flakiness Statistics

2018-10-12 Thread Benjamin Mahler
Thanks for sending this Benno! I for one would love to see more regular communication about the state of CI, especially so that I know how I can help fix tests (right now I don't know which flaky tests are in areas I am maintaining). Is there any reason the first portion of the test name is being

Mesos Flakiness Statistics

2018-10-12 Thread Benno Evers
Hey all, as you might know, we've set up an internal CI system that is running `make check` on a variety of different platforms and configurations, 16 in total. As we've experienced more and more pain maintaining a green master, I've compiled some statistics about which tests are most flaky. I