Bugs item #2783279, was opened at 2009-04-29 00:33
Message generated for change (Comment added) made by mlkersten
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=482468&aid=2783279&group_id=56967
Please note that this message will contain a full copy of the comment thread,
including the initial issue submission, for this request,
not just the latest update.
Category: Core
Group: MonetDB Common CVS Head
Status: Open
Resolution: None
Priority: 5
Private: No
Submitted By: Stefan de Konink (skinkie)
Assigned to: Nobody/Anonymous (nobody)
Summary: SEGV upon bat too large
Initial Comment:
CREATE TABLE "sys"."way_nds" (
"way" int,
"idx" int,
"to_node" int
);
create table segments (way integer, node1 integer, node2 integer);
insert into segments select t1.way, t1.to_node, t2.to_node from way_nds as t1,
way_nds as t2 where t1.way = t2.way and t1.idx = t2.idx-1;
way_nds consists of 370896230 rows
The error on the server:
!ERROR: bunfastins: bat too large
!ERROR: bunfastins: bat too large
!ERROR: bunfastins: bat too large
!ERROR: bunfastins: bat too large
!ERROR: bunfastins: bat too large
!ERROR: bunfastins: bat too large
!ERROR: bunfastins: bat too large
!ERROR: bunfastins: bat too large
!ERROR: bunfastins: bat too large
!ERROR: bunfastins: bat too large
Segmentation fault
(will try to run GDB, but currently have enabled optimize)
I am using 64bit/oid32.
----------------------------------------------------------------------
>Comment By: Martin Kersten (mlkersten)
Date: 2009-04-29 09:45
Message:
The sporadic segfault has been catched in the HEAD
----------------------------------------------------------------------
Comment By: Stefan Manegold (stmane)
Date: 2009-04-29 08:46
Message:
My question about the primary key was not about to add one, but rather
about which attribute (or combination of attributes) has unique values /
value combinations (and hence would qualify as a primary key) --- this
information would help to (roughly) estimate the join result size ...
... apart from that, ALGjoinPath() should of course not segfault, even if
(a previous) inter mediate result "overflows", and hence triggers an
exception/error ...
----------------------------------------------------------------------
Comment By: Stefan de Konink (skinkie)
Date: 2009-04-29 08:10
Message:
Program received signal SIGSEGV, Segmentation fault.
[Switching to Thread 0x7fffe2aa3950 (LWP 7736)]
0x00007fffe544a9c9 in ALGjoinPath ()
from
/export/scratch1/konink/monetdb-head/lib/MonetDB5/lib/lib_optimizer.so
(gdb) bt
#0 0x00007fffe544a9c9 in ALGjoinPath ()
from
/export/scratch1/konink/monetdb-head/lib/MonetDB5/lib/lib_optimizer.so
#1 0x00007ffff7d12975 in DFLOWstep ()
from /export/scratch1/konink/monetdb-head/lib/libmonetdb5.so.5
#2 0x00007ffff7d14894 in runDFLOWworker ()
from /export/scratch1/konink/monetdb-head/lib/libmonetdb5.so.5
#3 0x0000003c1a4073da in start_thread () from /lib64/libpthread.so.0
#4 0x0000003c19ce62bd in clone () from /lib64/libc.so.6
[I'll recompile with debugging enabled again]
Currently no primary key has been set. But if I set it, it would be (way,
idx). But since my query makes an explicit relation between way and idx,
would a primary key make any difference?
----------------------------------------------------------------------
Comment By: Stefan Manegold (stmane)
Date: 2009-04-29 05:09
Message:
"bat too large" occurs only if there are BUN_MAX BUNs; with 32-bit OIDs,
BUN_MAX is INT_MAX-1, i.e., 2^31-1-1 == 2147483646 >> 370896230.
I suspect that an intermediate result while calculating the (self-)join
"explodes".
What is the primary key of table way_nds? (way), (idx), (to_node),
(way,idx), ..., (way,idx,to_node)?
----------------------------------------------------------------------
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=482468&aid=2783279&group_id=56967
------------------------------------------------------------------------------
Register Now & Save for Velocity, the Web Performance & Operations
Conference from O'Reilly Media. Velocity features a full day of
expert-led, hands-on workshops and two days of sessions from industry
leaders in dedicated Performance & Operations tracks. Use code vel09scf
and Save an extra 15% before 5/3. http://p.sf.net/sfu/velocityconf
_______________________________________________
Monetdb-bugs mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/monetdb-bugs
