Bugs item #2644925, was opened at 2009-02-27 11:49
Message generated for change (Comment added) made by stmane
You can respond by visiting: 
https://sourceforge.net/tracker/?func=detail&atid=482468&aid=2644925&group_id=56967

Please note that this message will contain a full copy of the comment thread,
including the initial issue submission, for this request,
not just the latest update.
Category: SQL/Core
Group: SQL CVS Head
Status: Open
Resolution: None
Priority: 5
Private: Yes
Submitted By: Jens Oehlschlägel (jens_oehl)
Assigned to: Niels Nes (nielsnes)
Summary: crash-points with 1.5M

Initial Comment:
Stefan,
attached you find a csv with the forward non-ODBC timings of
- 600k version from Feb20
- 600k version from Feb26
- 1.5M version from Feb26
The 1.5M was crashing several times, number of the crashing queries: 875, 983, 
987, 999, the four SQLs follow for your convenience.

version from Feb26 is

MonetDB server v5.10.0 (32-bit), based on kernel v1.28.0 (32-bit oids)
Copyright (c) 1993-July 2008 CWI
Copyright (c) August 2008-2009 MonetDB B.V., all rights reserved
Visit http://monetdb.cwi.nl/ for further information
Configured for prefix: C:\Documents and Settings\sjoerd\My 
Documents\src\stable\vs32\NT32
Libraries:
  libpcre: 7.7 2008-05-07
  libxml2: 2.6.32
Compiled by: sjo...@gans
Compilation: cl -GF -W3 -WX -wd4273 -wd4102 -MD -nologo -Ox
Linking    : cl -GF -W3 -WX -wd4273 -wd4102 -MD -nologo -Ox

crashing query SQL:

SELECT KX, PostingYear, PostingStep, SUM(num1) as sNum1, SUM(den1) as sDen1 
FROM ( SELECT MIN(1) as PostingStep, PostingYear, Min('X') as KX, SUM(DT_D02) 
as num1, MIN(0) as den1 FROM voc.q_SourceKPIReportsTarget WHERE 
((PostingYear>=2005)  AND (PostingYear <= 2006)) GROUP BY PostingYear) as sSub3 
GROUP BY KX, PostingYear, PostingStep;

SELECT KX, PostingYear, PostingStep, SUM(num1) as sNum1, SUM(den1) as sDen1 
FROM ( SELECT Postingsemi as PostingStep, PostingYear, Min('X') as KX, 
SUM(DT_D02) as num1, MIN(0) as den1 FROM voc.q_SourceKPIReports WHERE 
(((PostingYear>2005  AND PostingYear<2006) OR (PostingYear=2005  AND 
Postingsemi>=1) OR (PostingYear=2006  AND Postingsemi<=2))) GROUP BY 
PostingYear, Postingsemi) as sSub3 GROUP BY KX, PostingYear, PostingStep;

SELECT KX, PostingYear, PostingStep, SUM(num1) as sNum1, SUM(den1) as sDen1 
FROM ( SELECT Postingsemi as PostingStep, PostingYear, Min('X') as KX, 
SUM(DT_D02) as num1, MIN(0) as den1 FROM voc.q_SourceKPIReportsTarget WHERE 
(((PostingYear>2005  AND PostingYear<2006) OR (PostingYear=2005  AND 
Postingsemi>=1) OR (PostingYear=2006  AND Postingsemi<=2))) GROUP BY 
PostingYear, Postingsemi) as sSub3 GROUP BY KX, PostingYear, PostingStep;

SELECT KX, PostingYear, PostingStep, SUM(num1) as sNum1, SUM(den1) as sDen1 
FROM ( SELECT Postingsemi as PostingStep, PostingYear, Min('X') as KX, 
SUM(DT_D04) as num1, MIN(0) as den1 FROM voc.q_SourceKPIReportsTarget WHERE 
(((PostingYear>2005  AND PostingYear<2006) OR (PostingYear=2005  AND 
Postingsemi>=1) OR (PostingYear=2006  AND Postingsemi<=2))) GROUP BY 
PostingYear, Postingsemi) as sSub3 GROUP BY KX, PostingYear, PostingStep;


----------------------------------------------------------------------

>Comment By: Stefan Manegold (stmane)
Date: 2009-02-28 00:43

Message:
some more experimental results:

On a 32-bit (Gentoo) Linux box with 1 GB RAM and 2 GB swap,
mserver5 "happily" survives 4 consecutive runs of all 1207 queries
(without crash or restart) on both the 150k & the 1.5M data set.

On the 2 GB Win32 box,
mserver5 "happily" survives 4 consecutive runs of the first 982 out of the
total 1207 queries without crash or restart) also on the 1.5M data set.

... more to come tomorrow, once nightly testing will have released the
Windows box, again ...


----------------------------------------------------------------------

Comment By: Stefan Manegold (stmane)
Date: 2009-02-27 21:44

Message:
some status info about my tests on Windows:

Win64 (Server 2003; v5.2) with 2 GB RAM:
mserver5 "Happily" survives 4 consecutive runs of all 1207 queries
(without crash or restart) on both the 150k & the 1.5M data set.

Win32 (XP; v5.1) with 2 GB RAM:
mserver5 "happily" survives 4 consecutive runs of all 1207 queries
(without crash or restart) only on the 150k data set.
On the 1.5M dataset,
running queries1207.sql in "forward" direction, query #983 crashes the
server with
!FATAL: GDKmallocmax: failed for 247669440 bytes
while running queries1207.sql in "backward" direction, query #999 (209th
query from the end) crashes the server with
!FATAL: GDKmallocmax: failed for 206391200 bytes

(did not yet test the queries between #983 & #999)


----------------------------------------------------------------------

Comment By: Stefan Manegold (stmane)
Date: 2009-02-27 19:09

Message:
Jens,

thank you very much for the details.

I have not yet been able to have a closer look at the 4 failing queries on
a 2 GB Win32 machine,
but we plugged some more leaks since yesterday's installer.
This afternoon, Sjoerd built new installers which will most probably be
the version that we will "officially" release;
you find them at
http://monetdb.cwi.nl/downloads/Windows/Feb2009/
*Maybe* this already helps with the four failing queries ...


Unfortunately we have not yet been able to properly fix the (indeed)
"scary" SUM-CASE bug you reported.

We'll provide you with an other installer, once also this bug is fixed.

Stefan


----------------------------------------------------------------------

You can respond by visiting: 
https://sourceforge.net/tracker/?func=detail&atid=482468&aid=2644925&group_id=56967

------------------------------------------------------------------------------
Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA
-OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise
-Strategies to boost innovation and cut costs with open source participation
-Receive a $600 discount off the registration fee with the source code: SFAD
http://p.sf.net/sfu/XcvMzF8H
_______________________________________________
Monetdb-bugs mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/monetdb-bugs

Reply via email to