Bugs item #2138231, was opened at 2008-09-30 13:18 Message generated for change (Comment added) made by nielsnes You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=482468&aid=2138231&group_id=56967
Please note that this message will contain a full copy of the comment thread, including the initial issue submission, for this request, not just the latest update. Category: None Group: None Status: Open Resolution: None Priority: 5 Private: No Submitted By: Andrew Volkov (andriiv) Assigned to: Nobody/Anonymous (nobody) Summary: DB server exits (FATAL) while performing count(*) operation Initial Comment: While executing count(*) on 130M table with 2 int columns the following FATAL error occurs and server exits. !FATAL: GDKmallocmax: failed for 531804336 bytes OS Vista: 32bit [Version 6.0.6001] # MonetDB server v5.6.0, based on kernel v1.24.0 # Serving database 'demo' # Compiled for i686-pc-win32/32bit with 32bit OIDs dynamically linked ---------------------------------------------------------------------- >Comment By: Niels Nes (nielsnes) Date: 2008-10-07 11:37 Message: Your running on a 32bit windows system. Could you also tell us the amount of memory in it? The server stops because it cannot allocate .5G. It will need .5 per column so a distinct will require a hash table which does need 1G in this case. So 1.5G is taken. ---------------------------------------------------------------------- Comment By: Andrew Volkov (andriiv) Date: 2008-10-03 13:10 Message: table is type(int), val(int). table has 130M rows, and 20K unique types select count(distinct type) from voc.test crashes the db. even count(*) is pretty fast (less than 0.5sec), count (type) or count(val) take almost 10 seconds (could be memory related). any query with math function on column type kill DB as well, e.g. select type, avg(val) as m_val from voc.test group by type order by m_val desc below is the out from memory debugger. before dying the DB stops at the last line and then eventually crashes. ##GDKmemchk (memcur=48,memmax=2616192040) (vmcur=0,vmmax=1610612736) ##GDKmemchk (memcur=317568,memmax=2616192040) (vmcur=58720256,vmmax=1610612736) ##GDKmemchk (memcur=369832,memmax=2616192040) (vmcur=58720256,vmmax=1610612736) # MonetDB server v5.6.0, based on kernel v1.24.0 # Serving database 'demo' # Compiled for i686-pc-win32/32bit with 32bit OIDs dynamically linked # Copyright (c) 1993-2008 CWI, all rights reserved # Visit http://monetdb.cwi.nl/ for further information #warning: please don't forget to set your vault key! #(see C:\Program Files\CWI\MonetDB5\etc\monetdb5.conf) ##GDKmemchk (memcur=578680,memmax=2616192040) (vmcur=58720256,vmmax=1610612736) ##GDKmemchk (memcur=647968,memmax=2616192040) (vmcur=58720256,vmmax=1610612736) ##GDKmemchk (memcur=714296,memmax=2616192040) (vmcur=58720256,vmmax=1610612736) ##GDKmemchk (memcur=775376,memmax=2616192040) (vmcur=58720256,vmmax=1610612736) ##GDKmemchk (memcur=837296,memmax=2616192040) (vmcur=58720256,vmmax=1610612736) ##GDKmemchk (memcur=903256,memmax=2616192040) (vmcur=58720256,vmmax=1610612736) ##GDKmemchk (memcur=968128,memmax=2616192040) (vmcur=58720256,vmmax=1610612736) ##GDKmemchk (memcur=1029128,memmax=2616192040) (vmcur=58720256,vmmax=1610612736) ##GDKmemchk (memcur=1090064,memmax=2616192040) (vmcur=58720256,vmmax=1610612736) ##GDKmemchk (memcur=1151032,memmax=2616192040) (vmcur=58720256,vmmax=1610612736) ##GDKmemchk (memcur=1213208,memmax=2616192040) (vmcur=58720256,vmmax=1610612736) ##GDKmemchk (memcur=1275368,memmax=2616192040) (vmcur=58720256,vmmax=1610612736) ##GDKmemchk (memcur=1337832,memmax=2616192040) (vmcur=58720256,vmmax=1610612736) ##GDKmemchk (memcur=1399824,memmax=2616192040) (vmcur=58720256,vmmax=1610612736) ##GDKmemchk (memcur=1462624,memmax=2616192040) (vmcur=58720256,vmmax=1610612736) ##GDKmemchk (memcur=1524704,memmax=2616192040) (vmcur=58720256,vmmax=1610612736) ##GDKmemchk (memcur=1590216,memmax=2616192040) (vmcur=58720256,vmmax=1610612736) ##GDKmemchk (memcur=1648960,memmax=2616192040) (vmcur=58720256,vmmax=1610612736) ##GDKmemchk (memcur=1707368,memmax=2616192040) (vmcur=58720256,vmmax=1610612736) ##GDKmemchk (memcur=1767912,memmax=2616192040) (vmcur=58720256,vmmax=1610612736) ##GDKmemchk (memcur=1833392,memmax=2616192040) (vmcur=58720256,vmmax=1610612736) ##GDKmemchk (memcur=1894584,memmax=2616192040) (vmcur=58720256,vmmax=1610612736) ##GDKmemchk (memcur=1962648,memmax=2616192040) (vmcur=58720256,vmmax=1610612736) ##GDKmemchk (memcur=2025656,memmax=2616192040) (vmcur=58720256,vmmax=1610612736) ##GDKmemchk (memcur=2091040,memmax=2616192040) (vmcur=58720256,vmmax=1610612736) ##GDKmemchk (memcur=2150824,memmax=2616192040) (vmcur=58720256,vmmax=1610612736) ##GDKmemchk (memcur=2210368,memmax=2616192040) (vmcur=58720256,vmmax=1610612736) ##GDKmemchk (memcur=2270056,memmax=2616192040) (vmcur=58720256,vmmax=1610612736) ##GDKmemchk (memcur=2329544,memmax=2616192040) (vmcur=58720256,vmmax=1610612736) ##GDKmemchk (memcur=2389352,memmax=2616192040) (vmcur=58720256,vmmax=1610612736) ##GDKmemchk (memcur=2449136,memmax=2616192040) (vmcur=58720256,vmmax=1610612736) ##GDKmemchk (memcur=2509760,memmax=2616192040) (vmcur=58720256,vmmax=1610612736) ##GDKmemchk (memcur=2568200,memmax=2616192040) (vmcur=58720256,vmmax=1610612736) ##GDKmemchk (memcur=2626032,memmax=2616192040) (vmcur=58720256,vmmax=1610612736) ##GDKmemchk (memcur=2683640,memmax=2616192040) (vmcur=58720256,vmmax=1610612736) ##GDKmemchk (memcur=2744696,memmax=2616192040) (vmcur=58720256,vmmax=1610612736) ##GDKmemchk (memcur=2804824,memmax=2616192040) (vmcur=58720256,vmmax=1610612736) ##GDKmemchk (memcur=2865808,memmax=2616192040) (vmcur=58720256,vmmax=1610612736) ##GDKmemchk (memcur=2930408,memmax=2616192040) (vmcur=58720256,vmmax=1610612736) ##GDKmemchk (memcur=2997192,memmax=2616192040) (vmcur=58720256,vmmax=1610612736) ##GDKmemchk (memcur=3062952,memmax=2616192040) (vmcur=58720256,vmmax=1610612736) ##GDKmemchk (memcur=3125224,memmax=2616192040) (vmcur=58720256,vmmax=1610612736) ##GDKmemchk (memcur=3188840,memmax=2616192040) (vmcur=58720256,vmmax=1610612736) ##GDKmemchk (memcur=3253712,memmax=2616192040) (vmcur=58720256,vmmax=1610612736) ##GDKmemchk (memcur=3307232,memmax=2616192040) (vmcur=58720256,vmmax=1610612736) ##GDKmemchk (memcur=3367648,memmax=2616192040) (vmcur=58720256,vmmax=1610612736) ##GDKmemchk (memcur=3428640,memmax=2616192040) (vmcur=58720256,vmmax=1610612736) ##GDKmemchk (memcur=3497240,memmax=2616192040) (vmcur=58720256,vmmax=1610612736) ##GDKmemchk (memcur=3563000,memmax=2616192040) (vmcur=58720256,vmmax=1610612736) ##GDKmemchk (memcur=3629472,memmax=2616192040) (vmcur=58720256,vmmax=1610612736) ##GDKmemchk (memcur=3684584,memmax=2616192040) (vmcur=58720256,vmmax=1610612736) ##GDKmemchk (memcur=3738712,memmax=2616192040) (vmcur=58720256,vmmax=1610612736) ##GDKmemchk (memcur=3793568,memmax=2616192040) (vmcur=58720256,vmmax=1610612736) ##GDKmemchk (memcur=3847784,memmax=2616192040) (vmcur=58720256,vmmax=1610612736) ##GDKmemchk (memcur=3902296,memmax=2616192040) (vmcur=58720256,vmmax=1610612736) ##GDKmemchk (memcur=3957008,memmax=2616192040) (vmcur=58720256,vmmax=1610612736) ##GDKmemchk (memcur=4016088,memmax=2616192040) (vmcur=58720256,vmmax=1610612736) # Listening for connection requests on mapi:monetdb://127.0.0.1:50000/ ##GDKmemchk (memcur=4096088,memmax=2616192040) (vmcur=58720256,vmmax=1610612736) ##GDKmemchk (memcur=4154928,memmax=2616192040) (vmcur=58720256,vmmax=1610612736) ##GDKmemchk (memcur=4213336,memmax=2616192040) (vmcur=58720256,vmmax=1610612736) ##GDKmemchk (memcur=4271696,memmax=2616192040) (vmcur=58720256,vmmax=1610612736) ##GDKmemchk (memcur=4329744,memmax=2616192040) (vmcur=58720256,vmmax=1610612736) # MonetDB/SQL module v2.24.0 loaded >##GDKmemchk (memcur=4408568,memmax=2616192040) (vmcur=58720256,vmmax=1610612736) ##GDKmemchk (memcur=4628400,memmax=2616192040) (vmcur=58720256,vmmax=1610612736) ##GDKmemchk (memcur=4651584,memmax=2616192040) (vmcur=58720256,vmmax=1610612736) ##GDKmemchk (memcur=4674056,memmax=2616192040) (vmcur=58720256,vmmax=1610612736) ##GDKmemchk (memcur=4696528,memmax=2616192040) (vmcur=58720256,vmmax=1610612736) ##GDKmemchk (memcur=4719032,memmax=2616192040) (vmcur=58720256,vmmax=1610612736) ##GDKmemchk (memcur=4741528,memmax=2616192040) (vmcur=58720256,vmmax=1610612736) ##GDKmemchk (memcur=4764184,memmax=2616192040) (vmcur=58720256,vmmax=1610612736) ##GDKmemchk (memcur=4786816,memmax=2616192040) (vmcur=58720256,vmmax=1610612736) ##GDKmemchk (memcur=4809528,memmax=2616192040) (vmcur=58720256,vmmax=1610612736) ##GDKmemchk (memcur=4832352,memmax=2616192040) (vmcur=58720256,vmmax=1610612736) ##GDKmemchk (memcur=4856208,memmax=2616192040) (vmcur=58720256,vmmax=1610612736) ##GDKmemchk (memcur=4906288,memmax=2616192040) (vmcur=58720256,vmmax=1610612736) ##GDKmemchk (memcur=5337968,memmax=2616192040) (vmcur=58720256,vmmax=1610612736) ##GDKmemchk (memcur=6067880,memmax=2616192040) (vmcur=58720256,vmmax=1610612736) ##GDKmemchk (memcur=6559160,memmax=2616192040) (vmcur=58720256,vmmax=1610612736) ##GDKmemchk (memcur=7016184,memmax=2616192040) (vmcur=58720256,vmmax=1610612736) ##GDKmemchk (memcur=7469688,memmax=2616192040) (vmcur=58720256,vmmax=1610612736) ##GDKmemchk (memcur=8096960,memmax=2616192040) (vmcur=58720256,vmmax=1610612736) ##GDKmemchk (memcur=8622248,memmax=2616192040) (vmcur=58720256,vmmax=1610612736) ##GDKmemchk (memcur=9145864,memmax=2616192040) (vmcur=58720256,vmmax=1610612736) ##GDKmemchk (memcur=9699744,memmax=2616192040) (vmcur=58720256,vmmax=1610612736) ##GDKmemchk (memcur=10141080,memmax=2616192040) (vmcur=58720256,vmmax=1610612736) ##GDKmemchk (memcur=10578680,memmax=2616192040) (vmcur=58720256,vmmax=1610612736) ##GDKmemchk (memcur=11040408,memmax=2616192040) (vmcur=58720256,vmmax=1610612736) ##GDKmemchk (memcur=11483680,memmax=2616192040) (vmcur=58720256,vmmax=1610612736) ##GDKmemchk (memcur=11920696,memmax=2616192040) (vmcur=58720256,vmmax=1610612736) ##GDKmemchk (memcur=12139920,memmax=2616192040) (vmcur=58720256,vmmax=1610612736) !FATAL: GDKmallocmax: failed for 531804336 bytes ---------------------------------------------------------------------- Comment By: Martin Kersten (mlkersten) Date: 2008-10-03 09:09 Message: Can you be more precise on the SQL query and what was in the table, e.g. unique numbers or not? ---------------------------------------------------------------------- You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=482468&aid=2138231&group_id=56967 ------------------------------------------------------------------------- This SF.Net email is sponsored by the Moblin Your Move Developer's challenge Build the coolest Linux based applications with Moblin SDK & win great prizes Grand prize is a trip for two to an Open Source event anywhere in the world http://moblin-contest.org/redirect.php?banner_id=100&url=/ _______________________________________________ Monetdb-bugs mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/monetdb-bugs
