Re: xz -9 : Cannot allocate memory

2013-08-31 Thread Achim Gratz
Corinna Vinschen writes: That's an awful lot of memory, and it it could easily break later mmap's or thread stack reservations on 32 bit. Given that the default heap is 384 Megs already, I would prefer if we reserve subsequent heap memory in chunks of 1 or 2 Megs only, to lower the pressure

Re: xz -9 : Cannot allocate memory

2013-08-30 Thread Achim Gratz
Achim Gratz Stromeko at nexgo.de writes: Load xz under GDB, break on cygwin_exit, run it, and when it hits the breakpoint, observer the memory layout, either in GDB, or by cat'ing /proc/≤xz's pid/maps. OK, if it is still reproducible tomorrow I'll have a look. I'm not sure I'm looking at

Re: xz -9 : Cannot allocate memory

2013-08-30 Thread Corinna Vinschen
On Aug 30 09:26, Achim Gratz wrote: Achim Gratz Stromeko at nexgo.de writes: Load xz under GDB, break on cygwin_exit, run it, and when it hits the breakpoint, observer the memory layout, either in GDB, or by cat'ing /proc/≤xz's pid/maps. OK, if it is still reproducible tomorrow I'll

Re: xz -9 : Cannot allocate memory

2013-08-30 Thread Achim Gratz
Corinna Vinschen corinna-cygwin at cygwin.com writes: Yes, looks normal and expected from what you observed. mmap commits memory top-down and that was apparently the first free slot big enough to fullfil the request. The default heap size is 384 Megs and then there's apparently not enough

Re: xz -9 : Cannot allocate memory

2013-08-30 Thread Corinna Vinschen
On Aug 30 12:58, Achim Gratz wrote: Corinna Vinschen corinna-cygwin at cygwin.com writes: Yes, looks normal and expected from what you observed. mmap commits memory top-down and that was apparently the first free slot big enough to fullfil the request. The default heap size is 384 Megs

Re: xz -9 : Cannot allocate memory

2013-08-30 Thread Corinna Vinschen
On Aug 30 19:46, Corinna Vinschen wrote: On Aug 30 12:58, Achim Gratz wrote: Corinna Vinschen corinna-cygwin at cygwin.com writes: Yes, looks normal and expected from what you observed. mmap commits memory top-down and that was apparently the first free slot big enough to fullfil the

Re: xz -9 : Cannot allocate memory

2013-08-30 Thread Corinna Vinschen
On Aug 30 17:03, Christopher Faylor wrote: On Fri, Aug 30, 2013 at 09:00:48PM +0200, Corinna Vinschen wrote: On Aug 30 19:46, Corinna Vinschen wrote: On Aug 30 12:58, Achim Gratz wrote: Corinna Vinschen corinna-cygwin at cygwin.com writes: Yes, looks normal and expected from what you

Re: xz -9 : Cannot allocate memory

2013-08-30 Thread Christopher Faylor
On Fri, Aug 30, 2013 at 09:00:48PM +0200, Corinna Vinschen wrote: On Aug 30 19:46, Corinna Vinschen wrote: On Aug 30 12:58, Achim Gratz wrote: Corinna Vinschen corinna-cygwin at cygwin.com writes: Yes, looks normal and expected from what you observed. mmap commits memory top-down and

Re: xz -9 : Cannot allocate memory

2013-08-29 Thread Achim Gratz
David Stacey drstacey at tiscali.co.uk writes: I am trying to use 'xz -9' to compress a file, but the programme exits with the error message 'Cannot allocate memory'. Here's what I tried: $ echo Hello World compress_me.txt $ xz -9 compress_me.txt xz: compress_me.txt: Cannot allocate

Re: xz -9 : Cannot allocate memory

2013-08-29 Thread Achim Gratz
Achim Gratz Stromeko at NexGo.DE writes: With the initial heap size set to 1MB, the same allocations for mmap work just fine. The mmap length used by xz is the same for files of all sizes. The large mmap is for the scratchpad memory of xz, which can be limited via the -M option. Currently it

Re: xz -9 : Cannot allocate memory

2013-08-29 Thread Corinna Vinschen
On Aug 29 14:34, Achim Gratz wrote: Achim Gratz Stromeko at NexGo.DE writes: With the initial heap size set to 1MB, the same allocations for mmap work just fine. The mmap length used by xz is the same for files of all sizes. The large mmap is for the scratchpad memory of xz, which can be

Re: xz -9 : Cannot allocate memory

2013-08-29 Thread Charles Wilson
On 8/29/2013 11:11 AM, Corinna Vinschen wrote: On Aug 29 14:34, Achim Gratz wrote: Achim Gratz Stromeko at NexGo.DE writes: With the initial heap size set to 1MB, the same allocations for mmap work just fine. The mmap length used by xz is the same for files of all sizes. The large mmap is

Re: xz -9 : Cannot allocate memory

2013-08-29 Thread Corinna Vinschen
On Aug 29 11:32, Charles Wilson wrote: On 8/29/2013 11:11 AM, Corinna Vinschen wrote: On Aug 29 14:34, Achim Gratz wrote: Achim Gratz Stromeko at NexGo.DE writes: With the initial heap size set to 1MB, the same allocations for mmap work just fine. The mmap length used by xz is the same for

Re: xz -9 : Cannot allocate memory

2013-08-29 Thread Charles Wilson
On 8/29/2013 12:00 PM, Corinna Vinschen wrote: On Aug 29 11:32, Charles Wilson wrote: So...this is NOTABUG, right? Right. But is a bit lame that it just fails. Does it have to use this big buffer or would it also work with a smaller buffer, if there's no memory chunk big enough? From what

Re: xz -9 : Cannot allocate memory

2013-08-29 Thread Achim Gratz
Corinna Vinschen writes: I'm not exactly surprised. You're on a 32 bit machine, so you only have 2 Gigs VM. Probably some DLLs are in the way. I know, also it might be true I've hit a less fortunate meory layout than usual this time. However, I know there's plenty of unused memory before

Re: xz -9 : Cannot allocate memory

2013-08-29 Thread Achim Gratz
Charles Wilson writes: Right. But is a bit lame that it just fails. Does it have to use this big buffer or would it also work with a smaller buffer, if there's no memory chunk big enough? From what I understand, it will /not/ be able to perform the kinds of tasks that -9 specifies. E.g.

Re: xz -9 : Cannot allocate memory

2012-11-15 Thread David Stacey
On 15/11/12 06:30, JonY wrote: On 11/15/2012 13:37, Peter Rosin wrote: On 2012-11-15 05:40, marco atzeri wrote: On 11/14/2012 11:09 PM, David Stacey wrote: I am trying to use 'xz -9' to compress a file, but the programme exits with the error message 'Cannot allocate memory'. Here's what I

xz -9 : Cannot allocate memory

2012-11-14 Thread David Stacey
I am trying to use 'xz -9' to compress a file, but the programme exits with the error message 'Cannot allocate memory'. Here's what I tried: $ echo Hello World compress_me.txt $ xz -9 compress_me.txt xz: compress_me.txt: Cannot allocate memory $ xz --version xz (XZ Utils) 5.0.2 liblzma

Re: xz -9 : Cannot allocate memory

2012-11-14 Thread marco atzeri
On 11/14/2012 11:09 PM, David Stacey wrote: I am trying to use 'xz -9' to compress a file, but the programme exits with the error message 'Cannot allocate memory'. Here's what I tried: $ echo Hello World compress_me.txt $ xz -9 compress_me.txt xz: compress_me.txt: Cannot allocate memory $

Re: xz -9 : Cannot allocate memory

2012-11-14 Thread Peter Rosin
On 2012-11-15 05:40, marco atzeri wrote: On 11/14/2012 11:09 PM, David Stacey wrote: I am trying to use 'xz -9' to compress a file, but the programme exits with the error message 'Cannot allocate memory'. Here's what I tried: $ echo Hello World compress_me.txt $ xz -9 compress_me.txt xz:

Re: xz -9 : Cannot allocate memory

2012-11-14 Thread JonY
On 11/15/2012 13:37, Peter Rosin wrote: On 2012-11-15 05:40, marco atzeri wrote: On 11/14/2012 11:09 PM, David Stacey wrote: I am trying to use 'xz -9' to compress a file, but the programme exits with the error message 'Cannot allocate memory'. Here's what I tried: $ echo Hello World