Ok, so it seems that the compressed stream is huge. bzcat etc works as it
should. *face-palm*
Sent from my BlackBerry — the most secure mobile device
Original Message
From: [email protected]
Sent: 20 April 2019 15:53
To: [email protected]
Cc: [email protected]
Subject: Re: bzcat/zcat does eat huge amounts of memory.
Maybe this has been fixed since 1.20.2 or maybe is due to the pipe.
For me it is most notable with bzcat. Will have to investigate this further on
Tuesday.
//M
Sent from my BlackBerry — the most secure mobile device
Original Message
From: [email protected]
Sent: 20 April 2019 14:37
To: [email protected]
Cc: [email protected]
Subject: Re: bzcat/zcat does eat huge amounts of memory.
On Fri, Apr 19, 2019 at 4:23 PM Markus Gothe <[email protected]> wrote:
>
> Seems to me that the implementation is seriously flawed, it decompress the
> whole file into the heap and then print it out.
Can't reproduce:
$ ./busybox zcat 392mbyte_gzipped_file.gz >/dev/null & pid=$!; pmap
$pid; while pmap $pid; do sleep 1; done
30164: ./busybox zcat 392mbyte_gzipped_file.gz
0000000008048000 960K r-x-- busybox
0000000008138000 4K rw--- busybox
0000000008139000 4K rw--- [ anon ]
00000000083f6000 4K rw--- [ anon ]
00000000f7741000 64K rw--- [ anon ]
00000000f7751000 12K r---- [ anon ]
00000000f7754000 8K r-x-- [ anon ]
00000000ffa06000 132K rw--- [ stack ]
total 1188K
30164: ./busybox zcat 392mbyte_gzipped_file.gz
0000000008048000 960K r-x-- busybox
0000000008138000 4K rw--- busybox
0000000008139000 4K rw--- [ anon ]
00000000083f6000 4K rw--- [ anon ]
00000000f7741000 64K rw--- [ anon ]
00000000f7751000 12K r---- [ anon ]
00000000f7754000 8K r-x-- [ anon ]
00000000ffa06000 132K rw--- [ stack ]
total 1188K
30164: ./busybox zcat 392mbyte_gzipped_file.gz
0000000008048000 960K r-x-- busybox
0000000008138000 4K rw--- busybox
0000000008139000 4K rw--- [ anon ]
00000000083f6000 4K rw--- [ anon ]
00000000f7741000 64K rw--- [ anon ]
00000000f7751000 12K r---- [ anon ]
00000000f7754000 8K r-x-- [ anon ]
00000000ffa06000 132K rw--- [ stack ]
total 1188K
30164: ./busybox zcat 392mbyte_gzipped_file.gz
0000000008048000 960K r-x-- busybox
0000000008138000 4K rw--- busybox
0000000008139000 4K rw--- [ anon ]
00000000083f6000 4K rw--- [ anon ]
00000000f7741000 64K rw--- [ anon ]
00000000f7751000 12K r---- [ anon ]
00000000f7754000 8K r-x-- [ anon ]
00000000ffa06000 132K rw--- [ stack ]
total 1188K
...
...
30164: ./busybox zcat 392mbyte_gzipped_file.gz
0000000008048000 960K r-x-- busybox
0000000008138000 4K rw--- busybox
0000000008139000 4K rw--- [ anon ]
00000000083f6000 4K rw--- [ anon ]
00000000f7741000 64K rw--- [ anon ]
00000000f7751000 12K r---- [ anon ]
00000000f7754000 8K r-x-- [ anon ]
00000000ffa06000 132K rw--- [ stack ]
total 1188K
I see no memory usage growth. At all.
_______________________________________________
busybox mailing list
[email protected]
http://lists.busybox.net/mailman/listinfo/busybox
_______________________________________________
busybox mailing list
[email protected]
http://lists.busybox.net/mailman/listinfo/busybox
