Re: Proposal: Remove Linux PGO Testing

2012-11-14 Thread Mike Hommey
On Tue, Nov 13, 2012 at 05:22:22PM -0800, Ehsan Akhgari wrote: On 2012-11-13 5:03 PM, Justin Dolske wrote: On 11/13/12 4:34 PM, Ehsan Akhgari wrote: But the point here is that unless we know for sure that we're dealing with a compiler bug, disabling Linux PGO builds may just wallpaper over

Re: Proposal: Remove Linux PGO Testing

2012-11-14 Thread Alex Keybl
The majority of our Linux users also do not use any of our builds or even use the same compiler as we do. By above logic we should completely stop doing Linux builds, but that's clear not a good idea :) An attempt at getting closer to building what our Linux users use on a daily basis is

Re: Proposal: Remove Linux PGO Testing

2012-11-14 Thread Dave Mandelin
On Wednesday, November 14, 2012 10:53:37 AM UTC-8, Alex Keybl wrote: Discussions are ongoing as to whether disabling the test is our best path forward here, given engineering opposition to disabling PGO. I strongly recommend disabling the test for 32-bit Linux PGO and moving on. Bug 799295

Re: Proposal: Remove Linux PGO Testing

2012-11-13 Thread Dao
On 13.11.2012 00:47, Alex Keybl wrote: almost nobody uses Mozilla Firefox builds(and no Firefox disributors do pgo) We should really get the latter fixed. Disabling PGO for our builds seems like a step in the wrong direction; the numbers collected in this thread suggest that it's a major

Re: Proposal: Remove Linux PGO Testing

2012-11-13 Thread Ehsan Akhgari
On 2012-11-13 9:56 AM, Jonathan Kew wrote: On 12/11/12 15:47, Alex Keybl wrote: Bug 799295 [1], the driver for this thread, is still an open issue for FF18 (shipping in 6 weeks). The JS team's recommendation remains to disable PGO on Linux. According to Taras, the major benefits of PGO on Linux

Re: Proposal: Remove Linux PGO Testing

2012-11-13 Thread Justin Dolske
On 11/13/12 10:27 AM, Ehsan Akhgari wrote: Agreed. Actually, reading the bug closely, there's nothing which says someone has tried to debug this (it's not even clear if it's reproducible locally), and it seems like the only evidence that we have about this being PGO related is that it happens

Re: Proposal: Remove Linux PGO Testing

2012-11-13 Thread Alex Keybl
If the Snappy initiative (or any other group of Mozillians) has short-term plans to evangelize the perf wins of PGO to Linux distros, I agree that we should leave PGO builds and testing enabled on Linux and further investigate the mysterious crash in bug 799295. Otherwise, our builds/testing

Re: Proposal: Remove Linux PGO Testing

2012-11-13 Thread Taras Glek
On 11/13/2012 3:53 PM, Alex Keybl wrote: If the Snappy initiative (or any other group of Mozillians) has short-term plans to evangelize the perf wins of PGO to Linux distros, I agree that we should leave PGO builds and testing enabled on Linux and further investigate the mysterious crash in

Re: Proposal: Remove Linux PGO Testing

2012-11-12 Thread Mike Hommey
On Mon, Nov 12, 2012 at 03:47:32PM -0800, Alex Keybl wrote: Bug 799295 [1], the driver for this thread, is still an open issue for FF18 (shipping in 6 weeks). The JS team's recommendation remains to disable PGO on Linux. According to Taras, the major benefits of PGO on Linux are for a

Re: Proposal: Remove Linux PGO Testing

2012-10-12 Thread David Anderson
On Thursday, October 11, 2012 5:49:07 PM UTC-7, Brian Smith wrote: I think it is important to give Linux users the fastest browser we can give them, because: It's still unclear to me what our Linux PGO builds mean. Do distributions use them? If not, are they using the exact same compiler

Re: Proposal: Remove Linux PGO Testing

2012-10-12 Thread Brian Smith
David Anderson wrote: It's still unclear to me what our Linux PGO builds mean. Do distributions use them? If not, are they using the exact same compiler version and PGO environment data? If not, then they have a different configuration that we haven't tested. I agree that we should make sure

Re: Proposal: Remove Linux PGO Testing

2012-10-12 Thread Taras Glek
On 10/11/2012 1:34 PM, Mike Hommey wrote: On Thu, Oct 11, 2012 at 02:26:33PM -0400, Rafael Ávila de Espíndola wrote: On 10/11/2012 02:33 AM, Mike Hommey wrote: On Wed, Oct 10, 2012 at 05:57:53PM -0400, Justin Lebar wrote: By turning off Linux PGO testing, you really mean stop making and

Re: Proposal: Remove Linux PGO Testing

2012-10-11 Thread Mike Hommey
On Wed, Oct 10, 2012 at 05:57:53PM -0400, Justin Lebar wrote: By turning off Linux PGO testing, you really mean stop making and distributing Linux PGO builds, right? The main reason I'd want Linux PGO is for mobile. On desktop Linux, most users (I expect) don't run our builds, so it's not a

Re: Proposal: Remove Linux PGO Testing

2012-10-11 Thread Tim Taubert
On 10/10/2012 11:57 PM, Justin Lebar wrote: The main reason I'd want Linux PGO is for mobile. On desktop Linux, most users (I expect) don't run our builds, so it's not a big deal if they're some percent slower. (Unless distros commonly do PGO builds of Firefox?) But we're not doing mobile

Re: Proposal: Remove Linux PGO Testing

2012-10-11 Thread Boris Zbarsky
On 10/11/12 3:05 AM, Tim Taubert wrote: Also, I'm not sure how this affects Telemetry results. In terms of perf measurements we'd probably need to completely ignore everything from non-release builds as the results might differ heavily for some use cases. I'm not following. The suggestion, as

Re: Proposal: Remove Linux PGO Testing

2012-10-11 Thread Tim Taubert
On 10/11/2012 09:32 AM, Boris Zbarsky wrote: The suggestion, as far as I can tell, is to drop Linux PGO completely. We woudln't have it in nightly, Aurora, Beta, or releases. Compiling with PGO on Linux would be an unsupported configuration that we'd probably advise distros against, because

Re: Proposal: Remove Linux PGO Testing

2012-10-11 Thread David Anderson
Right, exactly. I am arguing that testing PGO, which is a buggy optimization pass, incurs too much developer cost to justify a 5-20% talos improvement on select benchmarks. On Linux, which is a very small percentage of our market share, and where distributions make their own builds anyway.

Re: Proposal: Remove Linux PGO Testing

2012-10-11 Thread David Anderson
Keep in mind that debug builds are probably at least an order of magnitude slower (or a large factor), whereas PGO is a very small factor. (After all, we do not PGO on Mac and it doesn't seem to be a problem.) -David On Thursday, October 11, 2012 12:05:35 AM UTC-7, Tim Taubert wrote: On

Re: Proposal: Remove Linux PGO Testing

2012-10-11 Thread Rafael Ávila de Espíndola
On 10/11/2012 02:33 AM, Mike Hommey wrote: On Wed, Oct 10, 2012 at 05:57:53PM -0400, Justin Lebar wrote: By turning off Linux PGO testing, you really mean stop making and distributing Linux PGO builds, right? The main reason I'd want Linux PGO is for mobile. On desktop Linux, most users (I

Re: Proposal: Remove Linux PGO Testing

2012-10-11 Thread Gary Kwong
I filed bug 800471 for considering using Clang on Linux. -Gary This also suggests another option: using clang on linux too. This would have the added benefit of using the same compiler for OS X and Linux, which would remove most of the argument of developers spending time on linux only

Re: Proposal: Remove Linux PGO Testing

2012-10-11 Thread Zack Weinberg
On 2012-10-11 3:12 PM, Anthony Jones wrote: On 11/10/12 19:33, Mike Hommey wrote: That being said, PGO on Linux is between 5 and 20% improvement on our various talos tests. That's with the version of gcc we currently use, which is 4.5. I'd expect 4.7 to do a better job even, especially if we

Re: Proposal: Remove Linux PGO Testing

2012-10-11 Thread Mike Hommey
On Thu, Oct 11, 2012 at 02:26:33PM -0400, Rafael Ávila de Espíndola wrote: On 10/11/2012 02:33 AM, Mike Hommey wrote: On Wed, Oct 10, 2012 at 05:57:53PM -0400, Justin Lebar wrote: By turning off Linux PGO testing, you really mean stop making and distributing Linux PGO builds, right? The

Re: Proposal: Remove Linux PGO Testing

2012-10-11 Thread Ehsan Akhgari
On 2012-10-11 4:34 PM, Mike Hommey wrote: On Thu, Oct 11, 2012 at 02:26:33PM -0400, Rafael Ávila de Espíndola wrote: On 10/11/2012 02:33 AM, Mike Hommey wrote: On Wed, Oct 10, 2012 at 05:57:53PM -0400, Justin Lebar wrote: By turning off Linux PGO testing, you really mean stop making and

Re: Proposal: Remove Linux PGO Testing

2012-10-11 Thread Bill McCloskey
On 10/11/2012 03:49 PM, Ehsan Akhgari wrote: Don't both of these proposals map to tons of manual work? I'm not convinced that doing either of those would necessarily be easier than finding and fixing the PGO bug at hand. The problem is that fixing this one bug might take only a few days, but

Re: Proposal: Remove Linux PGO Testing

2012-10-11 Thread Brian Smith
Zack Weinberg wrote: Link-time optimization is described as an experimental new feature in the GCC 4.5.0 release notes[1]. The 4.6.0 release notes[2] say that it has now stabilized to the point of being usable, and the 4.7.0 release notes[3] describe it as still further improved both in

Re: Proposal: Remove Linux PGO Testing

2012-10-11 Thread Justin Lebar
2. Linux is the foundation of B2G and Firefox for Android, where we *definitely* must deliver the fastest product we can I totally agree, but it's not clear to me whether continuing to do PGO on desktop Linux has any effect on our ability to potentially do PGO on Android/B2G. If we were to

Re: Proposal: Remove Linux PGO Testing

2012-10-10 Thread Justin Lebar
By turning off Linux PGO testing, you really mean stop making and distributing Linux PGO builds, right? The main reason I'd want Linux PGO is for mobile. On desktop Linux, most users (I expect) don't run our builds, so it's not a big deal if they're some percent slower. (Unless distros commonly

Re: Proposal: Remove Linux PGO Testing

2012-10-10 Thread David Anderson
Yeah, if we're not testing them I guess we don't have to make or distribute them at all. -David On Wednesday, October 10, 2012 2:58:18 PM UTC-7, Justin Lebar wrote: By turning off Linux PGO testing, you really mean stop making and distributing Linux PGO builds, right? The main reason

Re: Proposal: Remove Linux PGO Testing

2012-10-10 Thread Ted Mielczarek
On Wed, Oct 10, 2012 at 5:57 PM, Justin Lebar justin.le...@gmail.com wrote: By turning off Linux PGO testing, you really mean stop making and distributing Linux PGO builds, right? The main reason I'd want Linux PGO is for mobile. On desktop Linux, most users (I expect) don't run our builds,