Bug#537048: pbzip2 memory exhaustion with slow output pipe

2010-04-23 Thread Steven Chamberlain
Hi, I think this bug is fixed in the pbzip2 1.1.0-1 package. I thought I'd try it just now on a system running Debian 'squeeze', using that shellscript I posted before. It seems to work just fine. On my older Debian 'lenny' system running pbzip2 1.0.5-1, it would have exhausted all availab

Bug#537048: pbzip2 memory exhaustion with slow output pipe (was: Errore in, pbzip2)

2010-04-23 Thread AnĂ­bal Monsalve Salazar
On Tue, Oct 13, 2009 at 08:51:33PM +0100, Steven Chamberlain wrote: >Tags: patch > >Hi, > >I think my attached patch takes care of this issue. > >I've copied code from consumer_decompress() to consumer(), which limits >the output buffer to 20 * numCPU. It seems a bit of a hack to me, but, >probabl

Bug#537048: pbzip2 memory exhaustion with slow output pipe (was: Errore in, pbzip2)

2009-10-13 Thread Steven Chamberlain
Tags: patch Hi, I think my attached patch takes care of this issue. I've copied code from consumer_decompress() to consumer(), which limits the output buffer to 20 * numCPU. It seems a bit of a hack to me, but, probably no more than the rest of the program... but hey, it seems to work! With t

Bug#537048: pbzip2 memory exhaustion with slow output pipe (was: Errore in pbzip2)

2009-10-13 Thread Steven Chamberlain
Version: 1.0.5-1 Architecture: amd64 Hi, I'm seeing the same problem here too. I'm performing AMANDA tape backups, using pbzip2 to compress the output from 'tar' before it goes to the AMANDA taper program. When a tape becomes full (after 200GB of compressed data is written, which takes several