Hi all,
I'm trying to investigate some strage memory consumption, but have problem
with explanation.
Tested data is 100kb json text.
Tested script:
var fs = require('fs');
var data = fs.readFileSync(__dirname + '/' +'chartype.letter.json', 'utf8');
var p0 = JSON.parse(data);
var p1 = JSON.parse(data);
var p2 = JSON.parse(data);
var p3 = JSON.parse(data);
var p4 = JSON.parse(data);
var p5 = JSON.parse(data);
var p6 = JSON.parse(data);
var p7 = JSON.parse(data);
var p8 = JSON.parse(data);
var p9 = JSON.parse(data);
Empty case:
/usr/bin/time -f "%MKb" ./node empty.js
35360Kb
So expected result for main case will be empty case + data * count_times
and it should be something like 35360Kb + 100Kb * 10 ~~ 37Mb
Main case:
/usr/bin/time -f "%MKb" ./node bench.js
276672Kb
Actual result is 270Mb.
Running mtrace <https://github.com/Jimbly/node-mtrace>:
Addr Size Count Traffic
Module Symbol Offs
-------------- --------- ----- -------
-------------------------------- ------------------------------ ------
0x6b3bb7 0 0 2
./build/bin/node ares_init_options +0x857
0x6b3df7 0 0 2
./build/bin/node ares_init_options +0xa97
0x6b93c6 0 0 2
./build/bin/node ares__read_line +0xd6
0x7ff99d96aebb 0 0 6
/lib/x86_64-linux-gnu/libc.so.6
0x7ff99d984ab2 3 1 3
/lib/x86_64-linux-gnu/libc.so.6 __strdup +0x22
0x6b41e0 360 1 5
./build/bin/node ares_init_options +0xe80
0x90a519 928 4 738
./build/bin/node _ZN2v88internal8Malloced3NewEm +0x9
0x7ff99e44936d 5270 8 870
/usr/lib/x86_64-linux-gnu/lib... _Znwm +0x1d
0x6b33da 74216 1 1
./build/bin/node ares_init_options +0x7a
-------------- --------- ----- -------
-------------------------------- ------------------------------ ------
Totals 80777 15 1629
GC Trace attached.
Why we have such difference? Why is so HUGE consumption?
--
--
v8-users mailing list
[email protected]
http://groups.google.com/group/v8-users
---
You received this message because you are subscribed to the Google Groups
"v8-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to [email protected].
For more options, visit https://groups.google.com/d/optout.
[27817] 15 ms: Scavenge 2.1 (34.0) -> 2.0 (36.0) MB, 0 ms [allocation
failure].
[27817] Memory allocator, used: 36880 KB, available: 1462256 KB
[27817] New space, used: 251 KB, available: 772 KB, committed:
2048 KB
[27817] Old pointers, used: 710 KB, available: 1 KB, committed:
1519 KB
[27817] Old data space, used: 568 KB, available: 0 KB, committed:
1199 KB
[27817] Code space, used: 395 KB, available: 0 KB, committed:
996 KB
[27817] Map space, used: 83 KB, available: 0 KB, committed:
128 KB
[27817] Cell space, used: 14 KB, available: 0 KB, committed:
128 KB
[27817] Large object space, used: 0 KB, available: 1461215 KB, committed:
0 KB
[27817] All spaces, used: 2025 KB, available: 773 KB, committed:
6019 KB
[27817] Total time spent in GC : 0 ms
[27817] 15 ms: Scavenge 2.7 (36.0) -> 2.7 (37.0) MB, 0 ms [allocation
failure].
[27817] Memory allocator, used: 37904 KB, available: 1461232 KB
[27817] New space, used: 251 KB, available: 772 KB, committed:
2048 KB
[27817] Old pointers, used: 718 KB, available: 1 KB, committed:
1519 KB
[27817] Old data space, used: 1314 KB, available: 0 KB, committed:
2207 KB
[27817] Code space, used: 395 KB, available: 0 KB, committed:
996 KB
[27817] Map space, used: 83 KB, available: 0 KB, committed:
128 KB
[27817] Cell space, used: 14 KB, available: 0 KB, committed:
128 KB
[27817] Large object space, used: 0 KB, available: 1460191 KB, committed:
0 KB
[27817] All spaces, used: 2779 KB, available: 773 KB, committed:
7027 KB
[27817] Total time spent in GC : 0 ms
[27817] 16 ms: Scavenge 3.6 (37.0) -> 3.6 (37.0) MB, 0 ms [allocation
failure].
[27817] Memory allocator, used: 37904 KB, available: 1461232 KB
[27817] New space, used: 503 KB, available: 1544 KB, committed:
4096 KB
[27817] Old pointers, used: 910 KB, available: 1 KB, committed:
1519 KB
[27817] Old data space, used: 1816 KB, available: 0 KB, committed:
2207 KB
[27817] Code space, used: 395 KB, available: 0 KB, committed:
996 KB
[27817] Map space, used: 83 KB, available: 0 KB, committed:
128 KB
[27817] Cell space, used: 14 KB, available: 0 KB, committed:
128 KB
[27817] Large object space, used: 0 KB, available: 1460191 KB, committed:
0 KB
[27817] All spaces, used: 3725 KB, available: 1545 KB, committed:
9075 KB
[27817] Total time spent in GC : 0 ms
[27817] 17 ms: Scavenge 5.1 (37.0) -> 5.1 (39.0) MB, 0 ms [allocation
failure].
[27817] Memory allocator, used: 39952 KB, available: 1459184 KB
[27817] New space, used: 503 KB, available: 1544 KB, committed:
4096 KB
[27817] Old pointers, used: 910 KB, available: 1 KB, committed:
1519 KB
[27817] Old data space, used: 3325 KB, available: 1 KB, committed:
4223 KB
[27817] Code space, used: 395 KB, available: 0 KB, committed:
996 KB
[27817] Map space, used: 83 KB, available: 0 KB, committed:
128 KB
[27817] Cell space, used: 14 KB, available: 0 KB, committed:
128 KB
[27817] Large object space, used: 0 KB, available: 1458143 KB, committed:
0 KB
[27817] All spaces, used: 5233 KB, available: 1547 KB, committed:
11090 KB
[27817] Total time spent in GC : 0 ms
[27817] 18 ms: Scavenge 6.6 (39.0) -> 6.6 (40.0) MB, 0 ms [allocation
failure].
[27817] Memory allocator, used: 40976 KB, available: 1458160 KB
[27817] New space, used: 1007 KB, available: 3088 KB, committed:
8192 KB
[27817] Old pointers, used: 910 KB, available: 1 KB, committed:
1519 KB
[27817] Old data space, used: 4329 KB, available: 1 KB, committed:
5230 KB
[27817] Code space, used: 395 KB, available: 0 KB, committed:
996 KB
[27817] Map space, used: 83 KB, available: 0 KB, committed:
128 KB
[27817] Cell space, used: 14 KB, available: 0 KB, committed:
128 KB
[27817] Large object space, used: 0 KB, available: 1457119 KB, committed:
0 KB
[27817] All spaces, used: 6741 KB, available: 3091 KB, committed:
16194 KB
[27817] Total time spent in GC : 0 ms
[27817] 22 ms: Mark-sweep 10.3 (41.0) -> 2.9 (41.0) MB, 1 ms [allocation
failure] [promotion limit reached].
[27817] Memory allocator, used: 42000 KB, available: 1457136 KB
[27817] New space, used: 0 KB, available: 4096 KB, committed:
8192 KB
[27817] Old pointers, used: 1440 KB, available: 895 KB, committed:
2527 KB
[27817] Old data space, used: 1090 KB, available: 3562 KB, committed:
5230 KB
[27817] Code space, used: 384 KB, available: 611 KB, committed:
996 KB
[27817] Map space, used: 65 KB, available: 62 KB, committed:
128 KB
[27817] Cell space, used: 14 KB, available: 113 KB, committed:
128 KB
[27817] Large object space, used: 0 KB, available: 1456095 KB, committed:
0 KB
[27817] All spaces, used: 2994 KB, available: 9342 KB, committed:
17202 KB
[27817] Total time spent in GC : 1 ms
[27817] 24 ms: Scavenge 7.0 (41.0) -> 7.0 (44.0) MB, 1 ms [allocation
failure].
[27817] Memory allocator, used: 45072 KB, available: 1454064 KB
[27817] New space, used: 1007 KB, available: 3088 KB, committed:
8192 KB
[27817] Old pointers, used: 1632 KB, available: 286 KB, committed:
2527 KB
[27817] Old data space, used: 4107 KB, available: 3564 KB, committed:
8254 KB
[27817] Code space, used: 384 KB, available: 611 KB, committed:
996 KB
[27817] Map space, used: 65 KB, available: 62 KB, committed:
128 KB
[27817] Cell space, used: 14 KB, available: 113 KB, committed:
128 KB
[27817] Large object space, used: 0 KB, available: 1453023 KB, committed:
0 KB
[27817] All spaces, used: 7211 KB, available: 7727 KB, committed:
20225 KB
[27817] Total time spent in GC : 2 ms
[27817] 26 ms: Scavenge 10.7 (45.0) -> 7.0 (45.0) MB, 1 ms [allocation
failure].
[27817] Memory allocator, used: 46096 KB, available: 1453040 KB
[27817] New space, used: 116 KB, available: 8075 KB, committed:
16384 KB
[27817] Old pointers, used: 2400 KB, available: 895 KB, committed:
3535 KB
[27817] Old data space, used: 4137 KB, available: 3564 KB, committed:
8254 KB
[27817] Code space, used: 384 KB, available: 611 KB, committed:
996 KB
[27817] Map space, used: 65 KB, available: 62 KB, committed:
128 KB
[27817] Cell space, used: 14 KB, available: 113 KB, committed:
128 KB
[27817] Large object space, used: 0 KB, available: 1451999 KB, committed:
0 KB
[27817] All spaces, used: 7118 KB, available: 13322 KB, committed:
29425 KB
[27817] Total time spent in GC : 3 ms
[27817] 32 ms: Scavenge 14.7 (45.0) -> 14.4 (51.0) MB, 4 ms [allocation
failure].
[27817] Memory allocator, used: 52240 KB, available: 1446896 KB
[27817] New space, used: 2015 KB, available: 6176 KB, committed:
16384 KB
[27817] Old pointers, used: 3168 KB, available: 1134 KB, committed:
4543 KB
[27817] Old data space, used: 9148 KB, available: 3566 KB, committed:
13292 KB
[27817] Code space, used: 384 KB, available: 611 KB, committed:
996 KB
[27817] Map space, used: 65 KB, available: 62 KB, committed:
128 KB
[27817] Cell space, used: 14 KB, available: 113 KB, committed:
128 KB
[27817] Large object space, used: 0 KB, available: 1445855 KB, committed:
0 KB
[27817] All spaces, used: 14796 KB, available: 11665 KB, committed:
35471 KB
[27817] Total time spent in GC : 7 ms
[27817] Increasing marking speed to 3 due to high promotion rate
[27817] 40 ms: Mark-sweep 20.4 (51.0) -> 16.3 (54.0) MB, 4 ms (+ 2 ms in
35 steps since start of marking, biggest step 0.567139 ms) [allocation failure]
[promotion limit reached].
[27817] Memory allocator, used: 55312 KB, available: 1443824 KB
[27817] New space, used: 0 KB, available: 8192 KB, committed:
16384 KB
[27817] Old pointers, used: 3116 KB, available: 1378 KB, committed:
4543 KB
[27817] Old data space, used: 13075 KB, available: 3239 KB, committed:
16316 KB
[27817] Code space, used: 384 KB, available: 611 KB, committed:
996 KB
[27817] Map space, used: 65 KB, available: 62 KB, committed:
128 KB
[27817] Cell space, used: 14 KB, available: 113 KB, committed:
128 KB
[27817] Large object space, used: 0 KB, available: 1442783 KB, committed:
0 KB
[27817] All spaces, used: 16656 KB, available: 13598 KB, committed:
38495 KB
[27817] Total time spent in GC : 11 ms
[27817] 45 ms: Scavenge 24.9 (54.0) -> 22.7 (56.0) MB, 3 ms [allocation
failure].
[27817] Memory allocator, used: 57360 KB, available: 1441776 KB
[27817] New space, used: 4030 KB, available: 12353 KB, committed:
32768 KB
[27817] Old pointers, used: 4076 KB, available: 418 KB, committed:
4543 KB
[27817] Old data space, used: 14701 KB, available: 3240 KB, committed:
18331 KB
[27817] Code space, used: 384 KB, available: 611 KB, committed:
996 KB
[27817] Map space, used: 65 KB, available: 61 KB, committed:
128 KB
[27817] Cell space, used: 14 KB, available: 113 KB, committed:
128 KB
[27817] Large object space, used: 0 KB, available: 1440735 KB, committed:
0 KB
[27817] All spaces, used: 23273 KB, available: 16799 KB, committed:
56894 KB
[27817] Total time spent in GC : 14 ms
[27817] 57 ms: Mark-sweep 33.8 (57.0) -> 12.8 (58.0) MB, 4 ms (+ 3 ms in
40 steps since start of marking, biggest step 0.690918 ms) [StackGuard GC
request] [GC in old space requested].
[27817] Memory allocator, used: 59408 KB, available: 1439728 KB
[27817] New space, used: 0 KB, available: 16384 KB, committed:
32768 KB
[27817] Old pointers, used: 5406 KB, available: 912 KB, committed:
6558 KB
[27817] Old data space, used: 7214 KB, available: 11116 KB, committed:
18331 KB
[27817] Code space, used: 373 KB, available: 622 KB, committed:
996 KB
[27817] Map space, used: 65 KB, available: 62 KB, committed:
128 KB
[27817] Cell space, used: 14 KB, available: 113 KB, committed:
128 KB
[27817] Large object space, used: 0 KB, available: 1438687 KB, committed:
0 KB
[27817] All spaces, used: 13075 KB, available: 29211 KB, committed:
58910 KB
[27817] Total time spent in GC : 18 ms
[27817] 64 ms: Scavenge 28.5 (58.0) -> 20.3 (62.0) MB, 3 ms [allocation
failure].
[27817] Memory allocator, used: 63504 KB, available: 1435632 KB
[27817] New space, used: 4030 KB, available: 12353 KB, committed:
32768 KB
[27817] Old pointers, used: 6942 KB, available: 1391 KB, committed:
8574 KB
[27817] Old data space, used: 9356 KB, available: 10989 KB, committed:
20347 KB
[27817] Code space, used: 373 KB, available: 622 KB, committed:
996 KB
[27817] Map space, used: 65 KB, available: 61 KB, committed:
128 KB
[27817] Cell space, used: 14 KB, available: 113 KB, committed:
128 KB
[27817] Large object space, used: 0 KB, available: 1434591 KB, committed:
0 KB
[27817] All spaces, used: 20784 KB, available: 25531 KB, committed:
62941 KB
[27817] Total time spent in GC : 21 ms
[27817] 68 ms: Scavenge 32.0 (62.0) -> 19.5 (62.0) MB, 1 ms [allocation
failure].
[27817] Memory allocator, used: 63504 KB, available: 1435632 KB
[27817] New space, used: 3053 KB, available: 13330 KB, committed:
32768 KB
[27817] Old pointers, used: 6942 KB, available: 1391 KB, committed:
8574 KB
[27817] Old data space, used: 9479 KB, available: 10866 KB, committed:
20347 KB
[27817] Code space, used: 373 KB, available: 622 KB, committed:
996 KB
[27817] Map space, used: 65 KB, available: 61 KB, committed:
128 KB
[27817] Cell space, used: 14 KB, available: 113 KB, committed:
128 KB
[27817] Large object space, used: 0 KB, available: 1434591 KB, committed:
0 KB
[27817] All spaces, used: 19929 KB, available: 26386 KB, committed:
62941 KB
[27817] Total time spent in GC : 22 ms
gc_count=14 mark_sweep_count=3 max_gc_pause=4 total_gc_time=22 min_in_mutator=0
max_alive_after_gc=23832552
