Re: The current state of Talos benchmarks

2012-08-30 Thread Justin Lebar
On Thu, Aug 30, 2012 at 3:34 AM, Mike Hommey m...@glandium.org wrote: Ideally, we should make talos regressions visible on tbpl as oranges, and star them as other oranges. FWIW, making this possible is an explicit goal of the SfN effort. -Justin ___

Re: The current state of Talos benchmarks

2012-08-30 Thread Matt Woodrow
I've just filed bug 786978 for this. - Matt - Original Message - From: Ehsan Akhgari ehsan.akhg...@gmail.com To: rob...@ocallahan.org Cc: dev-platform@lists.mozilla.org Sent: Thursday, August 30, 2012 1:02:43 PM Subject: Re: The current state of Talos benchmarks On 12-08-29 8:41 PM

Re: The current state of Talos benchmarks

2012-08-30 Thread Mark Finkle
On 08/29/2012 09:54 PM, Robert O'Callahan wrote: On Thu, Aug 30, 2012 at 1:00 PM, Ehsan Akhgari ehsan.akhg...@gmail.comwrote: I agree with that if we talk about performance in general. But this thread is about specific regressions in performance as a result of changeset going into our tree.

Re: The current state of Talos benchmarks

2012-08-30 Thread Mark Finkle
On 08/29/2012 07:32 PM, Nicholas Nethercote wrote: In my experience, a lot of those emails say there was a regression caused by one of the following 100 patches, and I will have written 1 of those patches. I usually ignore those ones (though it depends on the nature of the patch). But if

Re: The current state of Talos benchmarks (meeting notes)

2012-08-30 Thread Ehsan Akhgari
On 12-08-30 5:42 PM, Taras Glek wrote: * Joel will revisit maintaining Talos within mozilla-central to reduce developer barriers to understanding what a particular Talos test result means. This should also make Talos easier to run I have filed bug 787200 for this discussion. Ehsan

Re: The current state of Talos benchmarks (meeting notes)

2012-08-30 Thread L. David Baron
On Thursday 2012-08-30 14:42 -0700, Taras Glek wrote: * Joel will revisit maintaining Talos within mozilla-central to reduce developer barriers to understanding what a particular Talos test result means. This should also make Talos easier to run This will also solve one of the other problems

Re: The current state of Talos benchmarks

2012-08-29 Thread Ehsan Akhgari
On 12-08-29 8:10 PM, Justin Lebar wrote: After getting an e-mail every single time m-c was merged for a day or two, I filtered the e-mails and completely forgot about them. I imagine most other people did the same. If we fix bug 752002, we'd also need to change the e-mails so as to get around

Re: The current state of Talos benchmarks

2012-08-29 Thread Dave Mandelin
On Wednesday, August 29, 2012 4:03:24 PM UTC-7, Ehsan Akhgari wrote: Hi everyone, The way the current situation happens is that many of the developers ignore the Talos regression emails that go to dev-tree-management, Talos is widely disliked and distrusted by developers, because it's hard

Re: The current state of Talos benchmarks

2012-08-29 Thread Robert O'Callahan
On Thu, Aug 30, 2012 at 1:00 PM, Ehsan Akhgari ehsan.akhg...@gmail.comwrote: I agree with that if we talk about performance in general. But this thread is about specific regressions in performance as a result of changeset going into our tree. I don't think the same argument applies here,