Hi,
the output of
luaotfload-tool --update --force --verbose=5 --log=stdout
is available under
http://justpaste.it/2lhr
I stopped the program when suddenly the memory ran full. This happend at
some step, it did not increase steadily during the whole process. Also,
the CPU was at 100% from that point on. The output doesn't seem to
report an error, does it?
It doesn't seem to report any error. I've run a valgrind on luatex with
the attached simple test file calling fontloader.info(); it seems to
have a memleak of about 80kb+(2kb per font). It's not nothing, but 2kb
times your 7400 fonts is about 15Mb, we're far from 3Gb... This doesn't
seem very easy to debug, but I'll continue to make tests about this...
Maybe you could run dbg or valgrind to see what's happening? (you'll
have to build luatex from sources if you want to follow this way, but
it's fairly easy).
Thank you,
--
Elie
if fontloader.info('/tmp/LinLibertine_RBIah.ttf') then
texio.write_nl("yes")
else
texio.write_nl("no")
end
==7537== Memcheck, a memory error detector
==7537== Copyright (C) 2002-2010, and GNU GPL'd, by Julian Seward et al.
==7537== Using Valgrind-3.6.0.SVN-Debian and LibVEX; rerun with -h for copyright info
==7537== Command: texlua toto.lua
==7537==
--7537-- Valgrind options:
--7537-- --suppressions=/usr/lib/valgrind/debian-libc6-dbg.supp
--7537-- -v
--7537-- --leak-check=full
--7537-- --show-reachable=yes
--7537-- Contents of /proc/version:
--7537-- Linux version 2.6.32-5-486 (Debian 2.6.32-48squeeze1) ([email protected]) (gcc version 4.3.5 (Debian 4.3.5-4) ) #1 Mon Feb 25 00:22:26 UTC 2013
--7537-- Arch and hwcaps: X86, x86-sse1-sse2
--7537-- Page sizes: currently 4096, max supported 4096
--7537-- Valgrind library directory: /usr/lib/valgrind
--7537-- Reading syms from /lib/ld-2.11.3.so (0x4000000)
--7537-- Considering /lib/ld-2.11.3.so ..
--7537-- .. CRC mismatch (computed 19231304 wanted 2b6c260a)
--7537-- Considering /usr/lib/debug/lib/ld-2.11.3.so ..
--7537-- .. CRC is valid
--7537-- Reading syms from /usr/bin/luatex-test (0x8048000)
--7537-- Reading syms from /usr/lib/valgrind/memcheck-x86-linux (0x38000000)
--7537-- object doesn't have a dynamic symbol table
--7537-- Reading suppressions file: /usr/lib/valgrind/debian-libc6-dbg.supp
--7537-- Reading suppressions file: /usr/lib/valgrind/default.supp
--7537-- REDIR: 0x4016490 (index) redirected to 0x3803eda3 (vgPlain_x86_linux_REDIR_FOR_index)
--7537-- Reading syms from /usr/lib/valgrind/vgpreload_core-x86-linux.so (0x401f000)
--7537-- Reading syms from /usr/lib/valgrind/vgpreload_memcheck-x86-linux.so (0x4021000)
==7537== WARNING: new redirection conflicts with existing -- ignoring it
--7537-- new: 0x04016490 (index ) R-> 0x04024cb0 index
--7537-- REDIR: 0x4016670 (strlen) redirected to 0x40250f0 (strlen)
--7537-- Reading syms from /lib/i686/cmov/libdl-2.11.3.so (0x4044000)
--7537-- Considering /lib/i686/cmov/libdl-2.11.3.so ..
--7537-- .. CRC mismatch (computed cc131032 wanted 3e040edb)
--7537-- Considering /usr/lib/debug/lib/i686/cmov/libdl-2.11.3.so ..
--7537-- .. CRC is valid
--7537-- Reading syms from /lib/i686/cmov/libm-2.11.3.so (0x4049000)
--7537-- Considering /lib/i686/cmov/libm-2.11.3.so ..
--7537-- .. CRC mismatch (computed 192a77c4 wanted 54f9f60e)
--7537-- Considering /usr/lib/debug/lib/i686/cmov/libm-2.11.3.so ..
--7537-- .. CRC is valid
--7537-- Reading syms from /lib/i686/cmov/libc-2.11.3.so (0x406f000)
--7537-- Considering /lib/i686/cmov/libc-2.11.3.so ..
--7537-- .. CRC mismatch (computed 54553e9a wanted b0c0c033)
--7537-- Considering /usr/lib/debug/lib/i686/cmov/libc-2.11.3.so ..
--7537-- .. CRC is valid
--7537-- REDIR: 0x40e25a0 (rindex) redirected to 0x4024b60 (rindex)
--7537-- REDIR: 0x40e4b60 (strchrnul) redirected to 0x4026590 (strchrnul)
--7537-- REDIR: 0x40de840 (free) redirected to 0x4023ae5 (free)
--7537-- REDIR: 0x40e2130 (strlen) redirected to 0x401f42c (_vgnU_ifunc_wrapper)
--7537-- REDIR: 0x40e2170 (__strlen_sse2) redirected to 0x40250b0 (strlen)
--7537-- REDIR: 0x40de920 (malloc) redirected to 0x4023ecb (malloc)
--7537-- REDIR: 0x40e3390 (mempcpy) redirected to 0x4026600 (mempcpy)
--7537-- REDIR: 0x40e21f0 (__GI_strlen) redirected to 0x40250d0 (__GI_strlen)
--7537-- REDIR: 0x40e1c00 (strcpy) redirected to 0x4025130 (strcpy)
--7537-- REDIR: 0x40e1a20 (index) redirected to 0x4024c20 (index)
--7537-- REDIR: 0x40e1b90 (strcmp) redirected to 0x40256b0 (strcmp)
--7537-- REDIR: 0x409dac0 (putenv) redirected to 0x40267a0 (putenv)
--7537-- REDIR: 0x40e22b0 (strnlen) redirected to 0x4025030 (strnlen)
--7537-- REDIR: 0x40e3830 (memcpy) redirected to 0x4025870 (memcpy)
--7537-- REDIR: 0x40e23e0 (strncmp) redirected to 0x40255d0 (strncmp)
--7537-- REDIR: 0x40df8a0 (realloc) redirected to 0x4023f7a (realloc)
--7537-- REDIR: 0x40e2fd0 (bcmp) redirected to 0x4026080 (bcmp)
--7537-- REDIR: 0x40de040 (calloc) redirected to 0x40231af (calloc)
--7537-- REDIR: 0x40e3520 (stpcpy) redirected to 0x4026120 (stpcpy)
--7537-- REDIR: 0x40e3330 (memset) redirected to 0x40264a0 (memset)
--7537-- REDIR: 0x40e24c0 (strncpy) redirected to 0x40252f0 (strncpy)
--7537-- REDIR: 0x40e1870 (strcat) redirected to 0x4024d40 (strcat)
==7537==
==7537== HEAP SUMMARY:
==7537== in use at exit: 90,146 bytes in 7,310 blocks
==7537== total heap usage: 14,868 allocs, 7,558 frees, 752,578 bytes allocated
==7537==
==7537== Searching for pointers to 7,310 not-freed blocks
==7537== Checked 3,318,612 bytes
==7537==
==7537== 4 bytes in 1 blocks are still reachable in loss record 1 of 20
==7537== at 0x4023F50: malloc (vg_replace_malloc.c:236)
==7537== by 0x40E1EAF: strdup (strdup.c:43)
==7537== by 0x813F178: do_texio_ini_print (ltexiolib.c:97)
==7537== by 0x813F23C: texio_printnl (ltexiolib.c:120)
==7537== by 0x82C99A7: luaD_precall (ldo.c:317)
==7537== by 0x82DE7B3: luaV_execute (lvm.c:710)
==7537== by 0x82C9D39: luaD_call (ldo.c:393)
==7537== by 0x82C1E83: f_call (lapi.c:920)
==7537== by 0x82C91EA: luaD_rawrunprotected (ldo.c:131)
==7537== by 0x82CA38D: luaD_pcall (ldo.c:590)
==7537== by 0x82C1F1E: lua_pcallk (lapi.c:946)
==7537== by 0x80BFBBB: lua_initialize (luainit.w:851)
==7537==
==7537== 5 bytes in 1 blocks are indirectly lost in loss record 2 of 20
==7537== at 0x4023F50: malloc (vg_replace_malloc.c:236)
==7537== by 0x81DFA1B: galloc (memory.c:52)
==7537== by 0x81DFB0D: copy (memory.c:87)
==7537== by 0x8257E24: SplineFontEmpty (splineutil2.c:1632)
==7537== by 0x81FAA00: SFFillFromTTFInfo (parsettf.c:6321)
==7537== by 0x81FAD36: _SFReadTTFInfo (parsettf.c:6376)
==7537== by 0x81FAE30: SFReadTTFInfo (parsettf.c:6398)
==7537== by 0x8227DD0: ReadSplineFontInfo (splinefont.c:534)
==7537== by 0x82704B4: ff_info (luafflib.c:3452)
==7537== by 0x82C99A7: luaD_precall (ldo.c:317)
==7537== by 0x82DE7B3: luaV_execute (lvm.c:710)
==7537== by 0x82C9D39: luaD_call (ldo.c:393)
==7537==
==7537== 5 bytes in 1 blocks are indirectly lost in loss record 3 of 20
==7537== at 0x4023F50: malloc (vg_replace_malloc.c:236)
==7537== by 0x81DFA1B: galloc (memory.c:52)
==7537== by 0x81DFB0D: copy (memory.c:87)
==7537== by 0x8257E51: SplineFontEmpty (splineutil2.c:1634)
==7537== by 0x81FAA00: SFFillFromTTFInfo (parsettf.c:6321)
==7537== by 0x81FAD36: _SFReadTTFInfo (parsettf.c:6376)
==7537== by 0x81FAE30: SFReadTTFInfo (parsettf.c:6398)
==7537== by 0x8227DD0: ReadSplineFontInfo (splinefont.c:534)
==7537== by 0x82704B4: ff_info (luafflib.c:3452)
==7537== by 0x82C99A7: luaD_precall (ldo.c:317)
==7537== by 0x82DE7B3: luaV_execute (lvm.c:710)
==7537== by 0x82C9D39: luaD_call (ldo.c:393)
==7537==
==7537== 7 bytes in 1 blocks are still reachable in loss record 4 of 20
==7537== at 0x4023F50: malloc (vg_replace_malloc.c:236)
==7537== by 0x86C30B5: xmalloc (xmalloc.c:25)
==7537== by 0x86C33F3: xstrdup (xstrdup.c:27)
==7537== by 0x80BEF7A: cleaned_invocation_name (luainit.w:484)
==7537== by 0x80BF914: lua_initialize (luainit.w:789)
==7537== by 0x80B4237: main (luatex.c:469)
==7537==
==7537== 8 bytes in 1 blocks are still reachable in loss record 5 of 20
==7537== at 0x4023F50: malloc (vg_replace_malloc.c:236)
==7537== by 0x86C30B5: xmalloc (xmalloc.c:25)
==7537== by 0x82A2E79: gww_iconv_open (gwwiconv.c:151)
==7537== by 0x8278CDA: _FindOrMakeEncoding (encoding.c:314)
==7537== by 0x82793DF: FindOrMakeEncoding (encoding.c:437)
==7537== by 0x8270880: luaopen_ff (luafflib.c:3581)
==7537== by 0x80C07DE: luainterpreter (luastuff.w:236)
==7537== by 0x80BFA33: lua_initialize (luainit.w:827)
==7537== by 0x80B4237: main (luatex.c:469)
==7537==
==7537== 8 bytes in 1 blocks are still reachable in loss record 6 of 20
==7537== at 0x4023F50: malloc (vg_replace_malloc.c:236)
==7537== by 0x86C30B5: xmalloc (xmalloc.c:25)
==7537== by 0x82A2E79: gww_iconv_open (gwwiconv.c:151)
==7537== by 0x8278D0A: _FindOrMakeEncoding (encoding.c:317)
==7537== by 0x82793DF: FindOrMakeEncoding (encoding.c:437)
==7537== by 0x8270880: luaopen_ff (luafflib.c:3581)
==7537== by 0x80C07DE: luainterpreter (luastuff.w:236)
==7537== by 0x80BFA33: lua_initialize (luainit.w:827)
==7537== by 0x80B4237: main (luatex.c:469)
==7537==
==7537== 9 bytes in 1 blocks are still reachable in loss record 7 of 20
==7537== at 0x4023F50: malloc (vg_replace_malloc.c:236)
==7537== by 0x86C30B5: xmalloc (xmalloc.c:25)
==7537== by 0x86C33F3: xstrdup (xstrdup.c:27)
==7537== by 0x80BEB8A: parse_options (luainit.w:381)
==7537== by 0x80BF9EB: lua_initialize (luainit.w:814)
==7537== by 0x80B4237: main (luatex.c:469)
==7537==
==7537== 10 bytes in 1 blocks are still reachable in loss record 8 of 20
==7537== at 0x4023F50: malloc (vg_replace_malloc.c:236)
==7537== by 0x81DFA1B: galloc (memory.c:52)
==7537== by 0x81DFB0D: copy (memory.c:87)
==7537== by 0x8279173: _FindOrMakeEncoding (encoding.c:402)
==7537== by 0x82793DF: FindOrMakeEncoding (encoding.c:437)
==7537== by 0x8270880: luaopen_ff (luafflib.c:3581)
==7537== by 0x80C07DE: luainterpreter (luastuff.w:236)
==7537== by 0x80BFA33: lua_initialize (luainit.w:827)
==7537== by 0x80B4237: main (luatex.c:469)
==7537==
==7537== 12 bytes in 1 blocks are still reachable in loss record 9 of 20
==7537== at 0x4023F50: malloc (vg_replace_malloc.c:236)
==7537== by 0x86C30B5: xmalloc (xmalloc.c:25)
==7537== by 0x81472DA: luaopen_tex (ltexlib.c:2539)
==7537== by 0x80C07E9: luainterpreter (luastuff.w:237)
==7537== by 0x80BFA33: lua_initialize (luainit.w:827)
==7537== by 0x80B4237: main (luatex.c:469)
==7537==
==7537== 15 bytes in 1 blocks are still reachable in loss record 10 of 20
==7537== at 0x4023F50: malloc (vg_replace_malloc.c:236)
==7537== by 0x86C30B5: xmalloc (xmalloc.c:25)
==7537== by 0x86C337A: xrealloc (xrealloc.c:29)
==7537== by 0x86BE70A: element (path-elt.c:72)
==7537== by 0x86BE79C: kpathsea_path_element (path-elt.c:91)
==7537== by 0x86C01EA: kpathsea_selfdir (progname.c:368)
==7537== by 0x86C0313: kpse_selfdir (progname.c:413)
==7537== by 0x80BE148: ex_selfdir (luainit.w:138)
==7537== by 0x80BE20F: prepare_cmdline (luainit.w:156)
==7537== by 0x80BFA5E: lua_initialize (luainit.w:829)
==7537== by 0x80B4237: main (luatex.c:469)
==7537==
==7537== 20 bytes in 1 blocks are still reachable in loss record 11 of 20
==7537== at 0x4023F50: malloc (vg_replace_malloc.c:236)
==7537== by 0x81DFA1B: galloc (memory.c:52)
==7537== by 0x81DFB0D: copy (memory.c:87)
==7537== by 0x82A2684: DefaultXUID (noprefs.c:427)
==7537== by 0x82A2696: NOUI_SetDefaults (noprefs.c:431)
==7537== by 0x82A1BB7: InitSimpleStuff (start.c:70)
==7537== by 0x827084A: luaopen_ff (luafflib.c:3577)
==7537== by 0x80C07DE: luainterpreter (luastuff.w:236)
==7537== by 0x80BFA33: lua_initialize (luainit.w:827)
==7537== by 0x80B4237: main (luatex.c:469)
==7537==
==7537== 26 (16 direct, 10 indirect) bytes in 1 blocks are definitely lost in loss record 12 of 20
==7537== at 0x402328F: calloc (vg_replace_malloc.c:467)
==7537== by 0x81DFA64: gcalloc (memory.c:60)
==7537== by 0x8257E04: SplineFontEmpty (splineutil2.c:1631)
==7537== by 0x81FAA00: SFFillFromTTFInfo (parsettf.c:6321)
==7537== by 0x81FAD36: _SFReadTTFInfo (parsettf.c:6376)
==7537== by 0x81FAE30: SFReadTTFInfo (parsettf.c:6398)
==7537== by 0x8227DD0: ReadSplineFontInfo (splinefont.c:534)
==7537== by 0x82704B4: ff_info (luafflib.c:3452)
==7537== by 0x82C99A7: luaD_precall (ldo.c:317)
==7537== by 0x82DE7B3: luaV_execute (lvm.c:710)
==7537== by 0x82C9D39: luaD_call (ldo.c:393)
==7537== by 0x82C1E83: f_call (lapi.c:920)
==7537==
==7537== 72 bytes in 1 blocks are still reachable in loss record 13 of 20
==7537== at 0x402328F: calloc (vg_replace_malloc.c:467)
==7537== by 0x81DFA64: gcalloc (memory.c:60)
==7537== by 0x827914D: _FindOrMakeEncoding (encoding.c:400)
==7537== by 0x82793DF: FindOrMakeEncoding (encoding.c:437)
==7537== by 0x8270880: luaopen_ff (luafflib.c:3581)
==7537== by 0x80C07DE: luainterpreter (luastuff.w:236)
==7537== by 0x80BFA33: lua_initialize (luainit.w:827)
==7537== by 0x80B4237: main (luatex.c:469)
==7537==
==7537== 85 bytes in 1 blocks are still reachable in loss record 14 of 20
==7537== at 0x4023F50: malloc (vg_replace_malloc.c:236)
==7537== by 0x86C30B5: xmalloc (xmalloc.c:25)
==7537== by 0x80BF8CE: lua_initialize (luainit.w:784)
==7537== by 0x80B4237: main (luatex.c:469)
==7537==
==7537== 132 bytes in 1 blocks are definitely lost in loss record 15 of 20
==7537== at 0x402328F: calloc (vg_replace_malloc.c:467)
==7537== by 0x81DFA64: gcalloc (memory.c:60)
==7537== by 0x81E89A6: ParseSaveTablesPref (parsettf.c:733)
==7537== by 0x81E99F0: readttfheader (parsettf.c:1055)
==7537== by 0x81FA830: readttfinfo (parsettf.c:6278)
==7537== by 0x81FAD18: _SFReadTTFInfo (parsettf.c:6373)
==7537== by 0x81FAE30: SFReadTTFInfo (parsettf.c:6398)
==7537== by 0x8227DD0: ReadSplineFontInfo (splinefont.c:534)
==7537== by 0x82704B4: ff_info (luafflib.c:3452)
==7537== by 0x82C99A7: luaD_precall (ldo.c:317)
==7537== by 0x82DE7B3: luaV_execute (lvm.c:710)
==7537== by 0x82C9D39: luaD_call (ldo.c:393)
==7537==
==7537== 285 bytes in 1 blocks are definitely lost in loss record 16 of 20
==7537== at 0x4023F50: malloc (vg_replace_malloc.c:236)
==7537== by 0x81DFA1B: galloc (memory.c:52)
==7537== by 0x81DFB0D: copy (memory.c:87)
==7537== by 0x81EB74F: FindLangEntry (parsettf.c:1662)
==7537== by 0x81EBAA3: readttfcopyrights (parsettf.c:1744)
==7537== by 0x81EBDBD: readttfpreglyph (parsettf.c:1804)
==7537== by 0x81FA84D: readttfinfo (parsettf.c:6281)
==7537== by 0x81FAD18: _SFReadTTFInfo (parsettf.c:6373)
==7537== by 0x81FAE30: SFReadTTFInfo (parsettf.c:6398)
==7537== by 0x8227DD0: ReadSplineFontInfo (splinefont.c:534)
==7537== by 0x82704B4: ff_info (luafflib.c:3452)
==7537== by 0x82C99A7: luaD_precall (ldo.c:317)
==7537==
==7537== 1,989 bytes in 13 blocks are indirectly lost in loss record 17 of 20
==7537== at 0x4023F50: malloc (vg_replace_malloc.c:236)
==7537== by 0x81DFA1B: galloc (memory.c:52)
==7537== by 0x8294DB9: MacStrToUtf8 (macenc.c:1180)
==7537== by 0x81E7D37: _readencstring (parsettf.c:459)
==7537== by 0x81EB1B5: TTFAddLangStr (parsettf.c:1563)
==7537== by 0x81EBA76: readttfcopyrights (parsettf.c:1738)
==7537== by 0x81EBDBD: readttfpreglyph (parsettf.c:1804)
==7537== by 0x81FA84D: readttfinfo (parsettf.c:6281)
==7537== by 0x81FAD18: _SFReadTTFInfo (parsettf.c:6373)
==7537== by 0x81FAE30: SFReadTTFInfo (parsettf.c:6398)
==7537== by 0x8227DD0: ReadSplineFontInfo (splinefont.c:534)
==7537== by 0x82704B4: ff_info (luafflib.c:3452)
==7537==
==7537== 2,093 (104 direct, 1,989 indirect) bytes in 1 blocks are definitely lost in loss record 18 of 20
==7537== at 0x402328F: calloc (vg_replace_malloc.c:467)
==7537== by 0x81DFA64: gcalloc (memory.c:60)
==7537== by 0x81EB272: TTFAddLangStr (parsettf.c:1579)
==7537== by 0x81EBA76: readttfcopyrights (parsettf.c:1738)
==7537== by 0x81EBDBD: readttfpreglyph (parsettf.c:1804)
==7537== by 0x81FA84D: readttfinfo (parsettf.c:6281)
==7537== by 0x81FAD18: _SFReadTTFInfo (parsettf.c:6373)
==7537== by 0x81FAE30: SFReadTTFInfo (parsettf.c:6398)
==7537== by 0x8227DD0: ReadSplineFontInfo (splinefont.c:534)
==7537== by 0x82704B4: ff_info (luafflib.c:3452)
==7537== by 0x82C99A7: luaD_precall (ldo.c:317)
==7537== by 0x82DE7B3: luaV_execute (lvm.c:710)
==7537==
==7537== 21,516 bytes in 1,793 blocks are still reachable in loss record 19 of 20
==7537== at 0x402328F: calloc (vg_replace_malloc.c:467)
==7537== by 0x81DFA64: gcalloc (memory.c:60)
==7537== by 0x8295F58: psaddbucket (namelist.c:76)
==7537== by 0x829603D: NameListHash (namelist.c:89)
==7537== by 0x829610A: psinitnames (namelist.c:107)
==7537== by 0x82963F1: UniFromName (namelist.c:167)
==7537== by 0x82A1A7E: initadobeenc (start.c:46)
==7537== by 0x82A1AE0: InitSimpleStuff (start.c:62)
==7537== by 0x827084A: luaopen_ff (luafflib.c:3577)
==7537== by 0x80C07DE: luainterpreter (luastuff.w:236)
==7537== by 0x80BFA33: lua_initialize (luainit.w:827)
==7537== by 0x80B4237: main (luatex.c:469)
==7537==
==7537== 65,844 bytes in 5,487 blocks are still reachable in loss record 20 of 20
==7537== at 0x402328F: calloc (vg_replace_malloc.c:467)
==7537== by 0x81DFA64: gcalloc (memory.c:60)
==7537== by 0x8295F58: psaddbucket (namelist.c:76)
==7537== by 0x82960DC: psinitnames (namelist.c:105)
==7537== by 0x82963F1: UniFromName (namelist.c:167)
==7537== by 0x82A1A7E: initadobeenc (start.c:46)
==7537== by 0x82A1AE0: InitSimpleStuff (start.c:62)
==7537== by 0x827084A: luaopen_ff (luafflib.c:3577)
==7537== by 0x80C07DE: luainterpreter (luastuff.w:236)
==7537== by 0x80BFA33: lua_initialize (luainit.w:827)
==7537== by 0x80B4237: main (luatex.c:469)
==7537==
==7537== LEAK SUMMARY:
==7537== definitely lost: 537 bytes in 4 blocks
==7537== indirectly lost: 1,999 bytes in 15 blocks
==7537== possibly lost: 0 bytes in 0 blocks
==7537== still reachable: 87,610 bytes in 7,291 blocks
==7537== suppressed: 0 bytes in 0 blocks
==7537==
==7537== ERROR SUMMARY: 4 errors from 4 contexts (suppressed: 17 from 8)
--7537--
--7537-- used_suppression: 17 dl-hack3-cond-1
==7537==
==7537== ERROR SUMMARY: 4 errors from 4 contexts (suppressed: 17 from 8)
