Bugs item #2528563, was opened at 2009-01-22 14:32
Message generated for change (Comment added) made by andreasmeinl
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=482468&aid=2528563&group_id=56967
Please note that this message will contain a full copy of the comment thread,
including the initial issue submission, for this request,
not just the latest update.
Category: PF general
Group: Pathfinder "stable"
Status: Open
Resolution: None
Priority: 5
Private: No
Submitted By: Andreas Meinl (andreasmeinl)
Assigned to: Nobody/Anonymous (nobody)
Summary: Server crashes
Initial Comment:
During the import of some xml files, the server crashed with the error message
"MonetDB>!FATAL: GDKmallocmax: failed for 252933552 bytes".
After that the server crashes repeatedly for example executing the very simple
xquery "count(collection("test"))".
The output of mclient, where I execute the xquery, is everytime more or less
the same:
xquery>count(collection("test"))
more><>
#GDKmalloc(210756272) fail => BBPtrim(enter) usage[mem=639556716,vm=1117388800]
#GDKmalloc(210756272) fail => BBPtrim(ready) usage[mem=413709780,vm=1096351744]
#GDKmallocmax: recovery ok. Continuing..
15831
MAPI = mone...@localhost:50000
QUERY = count(collection("test"))
ERROR = !ERROR: BBPdecref: 1000000163_rid_level does not have pointer fixes.
xquery>count(collection("test"))
more><>
15831
MAPI = mone...@localhost:50000
QUERY = count(collection("test"))
ERROR = !ERROR: BBPdecref: 1000000163_rid_level does not have pointer fixes.
!ERROR: BBPdecref: 1000000163_attr_qn does not have pointer fixes.
!ERROR: BBPdecref: 1000000163_attr_prop does not have pointer fixes.
xquery>count(collection("test"))
more><>
MAPI = mone...@localhost:50000
ACTION= read_line
QUERY = count(collection("test"))
ERROR = Connection terminated
The environment I use is Windows XP Professional x86 and MonetDB/XQuery server
and client, 32 bit, windows installer, version 20081216.
----------------------------------------------------------------------
>Comment By: Andreas Meinl (andreasmeinl)
Date: 2009-01-24 18:37
Message:
I wanted to rescue my imported files (or to be more precisely, the time I
had to spent for the import) and to backup the database to restore it on
another instance of MonetDB/XQuery on another computer.
But unfortunately the backup also failed with the error message I've
attached as a PNG file.
Is there any way to repair my database and not having to import all files
again?
File Added: monetdb.png
----------------------------------------------------------------------
Comment By: Andreas Meinl (andreasmeinl)
Date: 2009-01-22 15:25
Message:
- My notebook is equipped with two GB of RAM.
After I have started the server, 1164 MB are still available (and the
system cache has 620 MB) - referring to Windows Task-Manager.
- I wanted to import 492086 files (into one collection), but the server
crashed after having imported 15831 files (with the message I mentioned
before). The size of one file is about 20 to 70 KB.
- Sorry, but these documents represent confidential business documents;
I'm not allowed to distribute them.
- For the import I just use a quick & simple Java loop of the form:
statement = connection.createStatement();
statement.executeUpdate("pf:add-doc(\"C:\\[...]\\test.xml\", \"test.xml\",
\"test\")");
statement.close();
- The crash seems to happen always in the same way, that is after
executing the xquery three times. After the crash there are 1205 MB
available and 794 MB are assigned to the system cache.
----------------------------------------------------------------------
Comment By: Stefan Manegold (stmane)
Date: 2009-01-22 15:00
Message:
Hm, this look as if your Mserver fails to allocate an extra ~200 MB,
probably running out of available address spcae on your 32-bit system (or
at least not finding a consecutive free 200 MB address range due to
excessive memory/address space fragmentation on Windows).
The first question is, why these 200 MB are required, or differently:
How many documents did you (sucessfully) load into how many collections,
and how large are the individual documents and the collections you're
using?
How much physical and virtual memory does your machine have?
Stefan
----------------------------------------------------------------------
Comment By: Ying Zhang (yingying)
Date: 2009-01-22 14:49
Message:
Hello Andreas,
Would you please provide us some more information:
- How large is your memory? How many memory is still available when you
start monet?
- How many files are you trying to add? How large is each document, or
how large are they in total?
- Is it possible to provide us your complete set of documents, in a
compressed form, as attachment or via a URL?
- How do you exactly add the documents? which command do you use?
- How often does the crash happen (always or sometimes)?
Regards,
Jennie
----------------------------------------------------------------------
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=482468&aid=2528563&group_id=56967
------------------------------------------------------------------------------
This SF.net email is sponsored by:
SourcForge Community
SourceForge wants to tell your story.
http://p.sf.net/sfu/sf-spreadtheword
_______________________________________________
Monetdb-bugs mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/monetdb-bugs
