William Lachance writes: > Hi Karl, > > On 2015-06-04 12:30 AM, Karl Tomlinson wrote: >> jma...@mozilla.com writes: >> >>> >We will deprecate those instances of compare-talos next quarter >>> >completely.
>> The treeherder version seems to randomly choose which and how many >> of the results to load and so the comparison changes after >> reloads of the page. > > So this is a bug. :) Could you please file something here: > > https://bugzilla.mozilla.org/enter_bug.cgi?product=Tree%20Management&component=Perfherder > > For best results, include reproduction steps and comparison with > the existing snarkfest interface. Thanks for the link. Knowing the right component is half the process of filing bugs. https://bugzilla.mozilla.org/show_bug.cgi?id=1171707 I don't know how to compare with snarkfest, but comparing treeherder with treeherder is sufficient to observe the bug. >> can we keep the >> snarkfest version running please until this is resolved? My main concern was because I inferred from the previous post that deprecation of snarkfest was scheduled on a timeline basis. Can we instead schedule on a when-its-ready basis, please? >> If I may sneak in a request or two, then a number of results or an >> estimate of standard error in the mean would be helpful to know >> how to interpret the standard deviations. Also, a way to see >> whether higher or lower is better even for those tests without >> enough data to detect a statistically significant change would be >> a bonus. https://bugzilla.mozilla.org/show_bug.cgi?id=1171694 https://bugzilla.mozilla.org/show_bug.cgi?id=1171703 >> I'm keen to find out what is in the "Details" links, but they >> currently just ask me to "wait a minute". > > Likewise, that sounds like a bug. Clicking on details is supposed > to open up a subtest summary. Here it seems to work fine for me: > > https://treeherder.mozilla.org/perf.html#/compare?originalProject=mozilla-central&originalRevision=b2ad2f9f8e53&newProject=mozilla-central&newRevision=f21fac50a8cc That link is loading for me, and that info can be very helpful, thanks. However, others links are not. https://bugzilla.mozilla.org/show_bug.cgi?id=1171710 _______________________________________________ dev-platform mailing list dev-platform@lists.mozilla.org https://lists.mozilla.org/listinfo/dev-platform
