Bugs item #1856034, was opened at 2007-12-21 12:10
Message generated for change (Comment added) made by matt_harrison
You can respond by visiting: 
https://sourceforge.net/tracker/?func=detail&atid=482468&aid=1856034&group_id=56967

Please note that this message will contain a full copy of the comment thread,
including the initial issue submission, for this request,
not just the latest update.
Category: Core
Group: MonetDB5 5.2
Status: Open
Resolution: None
Priority: 5
Private: No
Submitted By: mharrison (matt_harrison)
Assigned to: Nobody/Anonymous (nobody)
Summary: Memory leaks when bulk loading

Initial Comment:
While attempting to load 1Mil rows into a table memory use goes 700+Megs.

Loading the same tables in My/postgre/sql doesn't ever take more than 20Megs!

After bulk load is done memory comes down a bit (100M or so) but still stays 
high.

Am attaching valgrind log.

----------------------------------------------------------------------

>Comment By: mharrison (matt_harrison)
Date: 2007-12-22 05:42

Message:
Logged In: YES 
user_id=1164236
Originator: YES

Memory consumed by ram/top.

Memory get's mmapped during bulk load?  Then there's no way I'm every
going to get 100+Mil rows loaded.

----------------------------------------------------------------------

Comment By: Martin Kersten (mlkersten)
Date: 2007-12-22 00:21

Message:
Logged In: YES 
user_id=490798
Originator: NO

Are you referring to the on-disk size?
or the memory consumption as seen by 'top'

Note that the memory consumption of the ^sql
are based on the memory buffer pool set aside
for processing. Not the table sizes.

In MonetDB you see the table size as a large
memory mapped file.

----------------------------------------------------------------------

You can respond by visiting: 
https://sourceforge.net/tracker/?func=detail&atid=482468&aid=1856034&group_id=56967

-------------------------------------------------------------------------
This SF.net email is sponsored by: Microsoft
Defy all challenges. Microsoft(R) Visual Studio 2005.
http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/
_______________________________________________
Monetdb-bugs mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/monetdb-bugs

Reply via email to