Bugs item #2879117, was opened at 2009-10-14 20:04 Message generated for change (Comment added) made by stmane You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=482468&aid=2879117&group_id=56967
Please note that this message will contain a full copy of the comment thread, including the initial issue submission, for this request, not just the latest update. Category: SQL/Core Group: MonetDB5 "stable" Status: Open Resolution: None Priority: 5 Private: No Submitted By: Guillaume Theoret (smokinn) Assigned to: Niels Nes (nielsnes) Summary: Consistent segmentation fault Initial Comment: It seems I can consistently crash MonetDB by running inserts in a while loop. I have a script that reads 7.5MM rows from mysql and runs the inserts on MonetDB. After about 24 hours the database segfaults. The messages my scripts output before crashing Run 1: 6380000 done - 84.2207% in 86083.58 (0.0109 avg) Segmentation fault Run 2: 6380000 done - 84.2207% in 85957.17 (0.0107 avg) Segmentation fault (core dumped) I also log all get_last_error messages if there are any and got these two messages just before the crash: MALException:!ERROR: HEAPextend: failed to extend to 244108529 for 07/744theap MALException:!ERROR: HEAPextend: failed to extend to 244108529 for 07/744theap On the second run I installed Apport to get a dump that I've attached. I'm running Ubuntu 9.04 Jaunty on a 32bit machine with 2GB of ram. I compiled from the bz2 tarball linked here: http://monetdb.cwi.nl/projects/monetdb//Download/ ( http://monetdb.cwi.nl/downloads/sources/Aug2009-SP1/MonetDB-Aug2009-SuperBall-SP1.tar.bz2 ) and the crash occurs both when compiling with and without optimizations and with and without debug. guilla...@dev3:~$ gcc -v Using built-in specs. Target: i486-linux-gnu Configured with: ../src/configure -v --with-pkgversion='Ubuntu 4.3.3-5ubuntu4' --with-bugurl=file:///usr/share/doc/gcc-4.3/README.Bugs --enable-languages=c,c++,fortran,objc,obj-c++ --prefix=/usr --enable-shared --with-system-zlib --libexecdir=/usr/lib --without-included-gettext --enable-threads=posix --enable-nls --with-gxx-include-dir=/usr/include/c++/4.3 --program-suffix=-4.3 --enable-clocale=gnu --enable-libstdcxx-debug --enable-objc-gc --enable-mpfr --enable-targets=all --with-tune=generic --enable-checking=release --build=i486-linux-gnu --host=i486-linux-gnu --target=i486-linux-gnu Thread model: posix gcc version 4.3.3 (Ubuntu 4.3.3-5ubuntu4) guilla...@dev3:~$ bison -V bison (GNU Bison) 2.3 guilla...@dev3:~$ yacc -V bison (GNU Bison) 2.3 guilla...@dev3:~$ autoconf -V autoconf (GNU Autoconf) 2.63 guilla...@dev3:~$ automake --version automake (GNU automake) 1.10.2 guilla...@dev3:~$ libtool --version ltmain.sh (GNU libtool) 2.2.6 The attached tarball also contains the script I was running. Thanks, Guillaume Edit: I've tried attaching the file but sourceforge keeps telling me I haven't chosen a group when I have. I'm going to submit without the file and try to add the file later. ---------------------------------------------------------------------- >Comment By: Stefan Manegold (stmane) Date: 2009-10-14 20:33 Message: While indeed MonetDB should not segfault (will have to investigate and fix that), I have two comments / questions: 1) How wide is your 7.5M row table (number and type of columns), i.e., how much data do you try to load in total? MonetDB might just run out of address space on your 32-bit system. How big was mserver5 just before crashing? 2) Would it be an option for you to have MySQL dump the table into a CSV file, and then bulk-load the data from there into MonetDB using COPY INTO? In MonetDB, bulk-loading should be (much) faster than individual insert statements ... ---------------------------------------------------------------------- Comment By: Guillaume Theoret (smokinn) Date: 2009-10-14 20:12 Message: Sourceforge refuses to let me upload a file. It says success but nothing happens. I've uploaded the file here: http://smokinn.com/files/monetdb_crash.tar.gz ---------------------------------------------------------------------- You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=482468&aid=2879117&group_id=56967 ------------------------------------------------------------------------------ Come build with us! The BlackBerry(R) Developer Conference in SF, CA is the only developer event you need to attend this year. Jumpstart your developing skills, take BlackBerry mobile applications to market and stay ahead of the curve. Join us from November 9 - 12, 2009. Register now! http://p.sf.net/sfu/devconference _______________________________________________ Monetdb-bugs mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/monetdb-bugs
