Bugs item #2138231, was opened at 2008-09-30 13:18
Message generated for change (Comment added) made by nielsnes
You can respond by visiting: 
https://sourceforge.net/tracker/?func=detail&atid=482468&aid=2138231&group_id=56967

Please note that this message will contain a full copy of the comment thread,
including the initial issue submission, for this request,
not just the latest update.
Category: SQL/Core
Group: None
>Status: Closed
>Resolution: Duplicate
Priority: 5
Private: No
Submitted By: Andrew Volkov (andriiv)
Assigned to: Niels Nes (nielsnes)
Summary: SQL server exits (FATAL) while performing count(*) operation

Initial Comment:
While executing count(*) on 130M table with 2 int columns the following FATAL 
error occurs and server exits.

!FATAL: GDKmallocmax: failed for 531804336 bytes



OS Vista: 32bit [Version 6.0.6001]
# MonetDB server v5.6.0, based on kernel v1.24.0
# Serving database 'demo'
# Compiled for i686-pc-win32/32bit with 32bit OIDs dynamically linked



----------------------------------------------------------------------

>Comment By: Niels Nes (nielsnes)
Date: 2009-11-22 21:11

Message:
out of memory (on 32 bit system). we are working to improve this situation.
A small test for this bug seems impossible

----------------------------------------------------------------------

Comment By: Stefan Manegold (stmane)
Date: 2009-08-14 12:09

Message:
tagged subject

----------------------------------------------------------------------

Comment By: Niels Nes (nielsnes)
Date: 2008-10-07 11:37

Message:
Your running on a 32bit windows system. Could you also tell us the amount
of memory in it? The server stops because it cannot allocate .5G. It will
need .5 per column so a distinct will require a hash table which does need
1G in this case. So 1.5G is taken.

----------------------------------------------------------------------

Comment By: Andrew Volkov (andriiv)
Date: 2008-10-03 13:10

Message:
table is type(int), val(int).

table has 130M rows, and 20K unique types

select count(distinct type) from voc.test crashes the db.

even count(*) is pretty fast (less than 0.5sec), count (type) or
count(val) take almost 10 seconds (could be memory related).

any query with math function on column type kill DB as well, e.g. select
type, avg(val) as m_val from voc.test group by type order by m_val desc

below is the out from memory debugger. before dying the DB stops at the
last line and then eventually crashes.


##GDKmemchk (memcur=48,memmax=2616192040) (vmcur=0,vmmax=1610612736)
##GDKmemchk (memcur=317568,memmax=2616192040)
(vmcur=58720256,vmmax=1610612736)
##GDKmemchk (memcur=369832,memmax=2616192040)
(vmcur=58720256,vmmax=1610612736)
# MonetDB server v5.6.0, based on kernel v1.24.0
# Serving database 'demo'
# Compiled for i686-pc-win32/32bit with 32bit OIDs dynamically linked
# Copyright (c) 1993-2008 CWI, all rights reserved
# Visit http://monetdb.cwi.nl/ for further information
#warning: please don't forget to set your vault key!
#(see C:\Program Files\CWI\MonetDB5\etc\monetdb5.conf)
##GDKmemchk (memcur=578680,memmax=2616192040)
(vmcur=58720256,vmmax=1610612736)
##GDKmemchk (memcur=647968,memmax=2616192040)
(vmcur=58720256,vmmax=1610612736)
##GDKmemchk (memcur=714296,memmax=2616192040)
(vmcur=58720256,vmmax=1610612736)
##GDKmemchk (memcur=775376,memmax=2616192040)
(vmcur=58720256,vmmax=1610612736)
##GDKmemchk (memcur=837296,memmax=2616192040)
(vmcur=58720256,vmmax=1610612736)
##GDKmemchk (memcur=903256,memmax=2616192040)
(vmcur=58720256,vmmax=1610612736)
##GDKmemchk (memcur=968128,memmax=2616192040)
(vmcur=58720256,vmmax=1610612736)
##GDKmemchk (memcur=1029128,memmax=2616192040)
(vmcur=58720256,vmmax=1610612736)
##GDKmemchk (memcur=1090064,memmax=2616192040)
(vmcur=58720256,vmmax=1610612736)
##GDKmemchk (memcur=1151032,memmax=2616192040)
(vmcur=58720256,vmmax=1610612736)
##GDKmemchk (memcur=1213208,memmax=2616192040)
(vmcur=58720256,vmmax=1610612736)
##GDKmemchk (memcur=1275368,memmax=2616192040)
(vmcur=58720256,vmmax=1610612736)
##GDKmemchk (memcur=1337832,memmax=2616192040)
(vmcur=58720256,vmmax=1610612736)
##GDKmemchk (memcur=1399824,memmax=2616192040)
(vmcur=58720256,vmmax=1610612736)
##GDKmemchk (memcur=1462624,memmax=2616192040)
(vmcur=58720256,vmmax=1610612736)
##GDKmemchk (memcur=1524704,memmax=2616192040)
(vmcur=58720256,vmmax=1610612736)
##GDKmemchk (memcur=1590216,memmax=2616192040)
(vmcur=58720256,vmmax=1610612736)
##GDKmemchk (memcur=1648960,memmax=2616192040)
(vmcur=58720256,vmmax=1610612736)
##GDKmemchk (memcur=1707368,memmax=2616192040)
(vmcur=58720256,vmmax=1610612736)
##GDKmemchk (memcur=1767912,memmax=2616192040)
(vmcur=58720256,vmmax=1610612736)
##GDKmemchk (memcur=1833392,memmax=2616192040)
(vmcur=58720256,vmmax=1610612736)
##GDKmemchk (memcur=1894584,memmax=2616192040)
(vmcur=58720256,vmmax=1610612736)
##GDKmemchk (memcur=1962648,memmax=2616192040)
(vmcur=58720256,vmmax=1610612736)
##GDKmemchk (memcur=2025656,memmax=2616192040)
(vmcur=58720256,vmmax=1610612736)
##GDKmemchk (memcur=2091040,memmax=2616192040)
(vmcur=58720256,vmmax=1610612736)
##GDKmemchk (memcur=2150824,memmax=2616192040)
(vmcur=58720256,vmmax=1610612736)
##GDKmemchk (memcur=2210368,memmax=2616192040)
(vmcur=58720256,vmmax=1610612736)
##GDKmemchk (memcur=2270056,memmax=2616192040)
(vmcur=58720256,vmmax=1610612736)
##GDKmemchk (memcur=2329544,memmax=2616192040)
(vmcur=58720256,vmmax=1610612736)
##GDKmemchk (memcur=2389352,memmax=2616192040)
(vmcur=58720256,vmmax=1610612736)
##GDKmemchk (memcur=2449136,memmax=2616192040)
(vmcur=58720256,vmmax=1610612736)
##GDKmemchk (memcur=2509760,memmax=2616192040)
(vmcur=58720256,vmmax=1610612736)
##GDKmemchk (memcur=2568200,memmax=2616192040)
(vmcur=58720256,vmmax=1610612736)
##GDKmemchk (memcur=2626032,memmax=2616192040)
(vmcur=58720256,vmmax=1610612736)
##GDKmemchk (memcur=2683640,memmax=2616192040)
(vmcur=58720256,vmmax=1610612736)
##GDKmemchk (memcur=2744696,memmax=2616192040)
(vmcur=58720256,vmmax=1610612736)
##GDKmemchk (memcur=2804824,memmax=2616192040)
(vmcur=58720256,vmmax=1610612736)
##GDKmemchk (memcur=2865808,memmax=2616192040)
(vmcur=58720256,vmmax=1610612736)
##GDKmemchk (memcur=2930408,memmax=2616192040)
(vmcur=58720256,vmmax=1610612736)
##GDKmemchk (memcur=2997192,memmax=2616192040)
(vmcur=58720256,vmmax=1610612736)
##GDKmemchk (memcur=3062952,memmax=2616192040)
(vmcur=58720256,vmmax=1610612736)
##GDKmemchk (memcur=3125224,memmax=2616192040)
(vmcur=58720256,vmmax=1610612736)
##GDKmemchk (memcur=3188840,memmax=2616192040)
(vmcur=58720256,vmmax=1610612736)
##GDKmemchk (memcur=3253712,memmax=2616192040)
(vmcur=58720256,vmmax=1610612736)
##GDKmemchk (memcur=3307232,memmax=2616192040)
(vmcur=58720256,vmmax=1610612736)
##GDKmemchk (memcur=3367648,memmax=2616192040)
(vmcur=58720256,vmmax=1610612736)
##GDKmemchk (memcur=3428640,memmax=2616192040)
(vmcur=58720256,vmmax=1610612736)
##GDKmemchk (memcur=3497240,memmax=2616192040)
(vmcur=58720256,vmmax=1610612736)
##GDKmemchk (memcur=3563000,memmax=2616192040)
(vmcur=58720256,vmmax=1610612736)
##GDKmemchk (memcur=3629472,memmax=2616192040)
(vmcur=58720256,vmmax=1610612736)
##GDKmemchk (memcur=3684584,memmax=2616192040)
(vmcur=58720256,vmmax=1610612736)
##GDKmemchk (memcur=3738712,memmax=2616192040)
(vmcur=58720256,vmmax=1610612736)
##GDKmemchk (memcur=3793568,memmax=2616192040)
(vmcur=58720256,vmmax=1610612736)
##GDKmemchk (memcur=3847784,memmax=2616192040)
(vmcur=58720256,vmmax=1610612736)
##GDKmemchk (memcur=3902296,memmax=2616192040)
(vmcur=58720256,vmmax=1610612736)
##GDKmemchk (memcur=3957008,memmax=2616192040)
(vmcur=58720256,vmmax=1610612736)
##GDKmemchk (memcur=4016088,memmax=2616192040)
(vmcur=58720256,vmmax=1610612736)
# Listening for connection requests on mapi:monetdb://127.0.0.1:50000/
##GDKmemchk (memcur=4096088,memmax=2616192040)
(vmcur=58720256,vmmax=1610612736)
##GDKmemchk (memcur=4154928,memmax=2616192040)
(vmcur=58720256,vmmax=1610612736)
##GDKmemchk (memcur=4213336,memmax=2616192040)
(vmcur=58720256,vmmax=1610612736)
##GDKmemchk (memcur=4271696,memmax=2616192040)
(vmcur=58720256,vmmax=1610612736)
##GDKmemchk (memcur=4329744,memmax=2616192040)
(vmcur=58720256,vmmax=1610612736)
# MonetDB/SQL module v2.24.0 loaded
>##GDKmemchk (memcur=4408568,memmax=2616192040)
(vmcur=58720256,vmmax=1610612736)
##GDKmemchk (memcur=4628400,memmax=2616192040)
(vmcur=58720256,vmmax=1610612736)
##GDKmemchk (memcur=4651584,memmax=2616192040)
(vmcur=58720256,vmmax=1610612736)
##GDKmemchk (memcur=4674056,memmax=2616192040)
(vmcur=58720256,vmmax=1610612736)
##GDKmemchk (memcur=4696528,memmax=2616192040)
(vmcur=58720256,vmmax=1610612736)
##GDKmemchk (memcur=4719032,memmax=2616192040)
(vmcur=58720256,vmmax=1610612736)
##GDKmemchk (memcur=4741528,memmax=2616192040)
(vmcur=58720256,vmmax=1610612736)
##GDKmemchk (memcur=4764184,memmax=2616192040)
(vmcur=58720256,vmmax=1610612736)
##GDKmemchk (memcur=4786816,memmax=2616192040)
(vmcur=58720256,vmmax=1610612736)
##GDKmemchk (memcur=4809528,memmax=2616192040)
(vmcur=58720256,vmmax=1610612736)
##GDKmemchk (memcur=4832352,memmax=2616192040)
(vmcur=58720256,vmmax=1610612736)
##GDKmemchk (memcur=4856208,memmax=2616192040)
(vmcur=58720256,vmmax=1610612736)
##GDKmemchk (memcur=4906288,memmax=2616192040)
(vmcur=58720256,vmmax=1610612736)
##GDKmemchk (memcur=5337968,memmax=2616192040)
(vmcur=58720256,vmmax=1610612736)
##GDKmemchk (memcur=6067880,memmax=2616192040)
(vmcur=58720256,vmmax=1610612736)
##GDKmemchk (memcur=6559160,memmax=2616192040)
(vmcur=58720256,vmmax=1610612736)
##GDKmemchk (memcur=7016184,memmax=2616192040)
(vmcur=58720256,vmmax=1610612736)
##GDKmemchk (memcur=7469688,memmax=2616192040)
(vmcur=58720256,vmmax=1610612736)
##GDKmemchk (memcur=8096960,memmax=2616192040)
(vmcur=58720256,vmmax=1610612736)
##GDKmemchk (memcur=8622248,memmax=2616192040)
(vmcur=58720256,vmmax=1610612736)
##GDKmemchk (memcur=9145864,memmax=2616192040)
(vmcur=58720256,vmmax=1610612736)
##GDKmemchk (memcur=9699744,memmax=2616192040)
(vmcur=58720256,vmmax=1610612736)
##GDKmemchk (memcur=10141080,memmax=2616192040)
(vmcur=58720256,vmmax=1610612736)
##GDKmemchk (memcur=10578680,memmax=2616192040)
(vmcur=58720256,vmmax=1610612736)
##GDKmemchk (memcur=11040408,memmax=2616192040)
(vmcur=58720256,vmmax=1610612736)
##GDKmemchk (memcur=11483680,memmax=2616192040)
(vmcur=58720256,vmmax=1610612736)
##GDKmemchk (memcur=11920696,memmax=2616192040)
(vmcur=58720256,vmmax=1610612736)
##GDKmemchk (memcur=12139920,memmax=2616192040)
(vmcur=58720256,vmmax=1610612736)
!FATAL: GDKmallocmax: failed for 531804336 bytes





----------------------------------------------------------------------

Comment By: Martin Kersten (mlkersten)
Date: 2008-10-03 09:09

Message:
Can you be more precise on the SQL query
and what was in the table, e.g. unique
numbers or not?

----------------------------------------------------------------------

You can respond by visiting: 
https://sourceforge.net/tracker/?func=detail&atid=482468&aid=2138231&group_id=56967

------------------------------------------------------------------------------
Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day 
trial. Simplify your report design, integration and deployment - and focus on 
what you do best, core application coding. Discover what's new with
Crystal Reports now.  http://p.sf.net/sfu/bobj-july
_______________________________________________
Monetdb-bugs mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/monetdb-bugs

Reply via email to