Re: [PATCH] LTO streamer reorg - try to reduce WPA memory use

2014-07-30 Thread Jan Hubicka
Updated patch passing LTO bootstrap (one warning fix) and with a memory leak fixed. Testing with Firefox is impossible at the moment because of PR61885. One thing I've noticed (before the ICE) is that virtual memory usage is very high: AddressKbytes RSSDirty Mode

Re: [PATCH] LTO streamer reorg - try to reduce WPA memory use

2014-07-30 Thread Richard Biener
On Wed, Jul 30, 2014 at 7:51 AM, Markus Trippelsdorf mar...@trippelsdorf.de wrote: On 2014.07.29 at 15:10 +0200, Richard Biener wrote: On Tue, 29 Jul 2014, Richard Biener wrote: This re-organizes the LTO streamer to do compression transparently in the data-streamer routines (and disables

Re: [PATCH] LTO streamer reorg - try to reduce WPA memory use

2014-07-30 Thread Markus Trippelsdorf
On 2014.07.30 at 10:31 +0200, Richard Biener wrote: On Wed, Jul 30, 2014 at 7:51 AM, Markus Trippelsdorf mar...@trippelsdorf.de wrote: On 2014.07.29 at 15:10 +0200, Richard Biener wrote: On Tue, 29 Jul 2014, Richard Biener wrote: This re-organizes the LTO streamer to do compression

Re: [PATCH] LTO streamer reorg - try to reduce WPA memory use

2014-07-30 Thread Richard Biener
On Wed, 30 Jul 2014, Markus Trippelsdorf wrote: On 2014.07.30 at 10:31 +0200, Richard Biener wrote: On Wed, Jul 30, 2014 at 7:51 AM, Markus Trippelsdorf mar...@trippelsdorf.de wrote: On 2014.07.29 at 15:10 +0200, Richard Biener wrote: On Tue, 29 Jul 2014, Richard Biener wrote:

Re: [PATCH] LTO streamer reorg - try to reduce WPA memory use

2014-07-30 Thread Richard Biener
On Wed, 30 Jul 2014, Richard Biener wrote: On Wed, Jul 30, 2014 at 7:51 AM, Markus Trippelsdorf mar...@trippelsdorf.de wrote: On 2014.07.29 at 15:10 +0200, Richard Biener wrote: On Tue, 29 Jul 2014, Richard Biener wrote: This re-organizes the LTO streamer to do compression

Re: [PATCH] LTO streamer reorg - try to reduce WPA memory use

2014-07-30 Thread Martin Liška
On 07/30/2014 11:41 AM, Richard Biener wrote: On Wed, 30 Jul 2014, Richard Biener wrote: On Wed, Jul 30, 2014 at 7:51 AM, Markus Trippelsdorf mar...@trippelsdorf.de wrote: On 2014.07.29 at 15:10 +0200, Richard Biener wrote: On Tue, 29 Jul 2014, Richard Biener wrote: This re-organizes the

Re: [PATCH] LTO streamer reorg - try to reduce WPA memory use

2014-07-30 Thread Richard Biener
On Wed, Jul 30, 2014 at 1:14 PM, Martin Liška mli...@suse.cz wrote: On 07/30/2014 11:41 AM, Richard Biener wrote: On Wed, 30 Jul 2014, Richard Biener wrote: On Wed, Jul 30, 2014 at 7:51 AM, Markus Trippelsdorf mar...@trippelsdorf.de wrote: On 2014.07.29 at 15:10 +0200, Richard Biener

Re: [PATCH] LTO streamer reorg - try to reduce WPA memory use

2014-07-30 Thread Martin Liška
On 07/30/2014 12:37 PM, Richard Biener wrote: On Wed, Jul 30, 2014 at 1:14 PM, Martin Liška mli...@suse.cz wrote: On 07/30/2014 11:41 AM, Richard Biener wrote: On Wed, 30 Jul 2014, Richard Biener wrote: On Wed, Jul 30, 2014 at 7:51 AM, Markus Trippelsdorf mar...@trippelsdorf.de wrote: On

[PATCH] LTO streamer reorg - try to reduce WPA memory use

2014-07-29 Thread Richard Biener
This re-organizes the LTO streamer to do compression transparently in the data-streamer routines (and disables section compression by defaulting to -flto-compression-level=0). This avoids keeping the whole uncompressed sections in memory, only retaining the compressed ones. The downside is that

Re: [PATCH] LTO streamer reorg - try to reduce WPA memory use

2014-07-29 Thread Richard Biener
On Tue, 29 Jul 2014, Richard Biener wrote: This re-organizes the LTO streamer to do compression transparently in the data-streamer routines (and disables section compression by defaulting to -flto-compression-level=0). This avoids keeping the whole uncompressed sections in memory, only

Re: [PATCH] LTO streamer reorg - try to reduce WPA memory use

2014-07-29 Thread Markus Trippelsdorf
On 2014.07.29 at 15:10 +0200, Richard Biener wrote: On Tue, 29 Jul 2014, Richard Biener wrote: This re-organizes the LTO streamer to do compression transparently in the data-streamer routines (and disables section compression by defaulting to -flto-compression-level=0). This avoids