Bugs item #2698327, was opened at 2009-03-20 20:37
Message generated for change (Comment added) made by boncz
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=482468&aid=2698327&group_id=56967
Please note that this message will contain a full copy of the comment thread,
including the initial issue submission, for this request,
not just the latest update.
Category: Core
Group: MonetDB4 "stable"
>Status: Closed
>Resolution: Fixed
Priority: 5
Private: No
Submitted By: Wouter Alink (vzzzbx)
>Assigned to: Peter Boncz (boncz)
Summary: XQ/GDK: strPut: Assertion failed
Initial Comment:
With a document with 100000 patents the following happens when shredding it:
$ ls -l patent_100000_problem_data.xml
-rw-r--r-- 1 roberto ins 6139885886 2009-03-20 17:44
patent_100000_problem_data.xml
$ echo
'pf:add-doc("/export/scratch0/roberto/lhm/patent_100000_problem_data.xml","bug.xml")'
| mclient -lxq -p50030
MAPI = mone...@localhost:50030
ACTION= read_line
QUERY =
pf:add-doc("/export/scratch0/roberto/lhm/patent_100000_problem_data.xml","bug.xml")
ERROR = Connection terminated
On the server side an assertion is raised:
$ Mserver --dbfarm=/export/scratch0/roberto/lhm/dbfarm_xquery_2
--dbinit="module(pathfinder);" --set mapi_port=50030
# MonetDB Server v4.29.0
# based on GDK v1.29.0
# Copyright (c) 1993-July 2008, CWI. All rights reserved.
# Copyright (c) August 2008-, MonetDB B.V.. All rights reserved.
# Compiled for x86_64-unknown-linux-gnu/64bit with 32bit OIDs; dynamically
linked.
# Visit http://monetdb.cwi.nl/ for further information.
# PF/Tijah module v0.9.0 loaded. http://dbappl.cs.utwente.nl/pftijah
# MonetDB/XQuery module v0.29.0 loaded (default back-end is 'algebra')
# XRPC administrative console at http://127.0.0.1:50031/admin
MonetDB>Mserver:
/export/scratch0/roberto/MonetDB/src/MonetDB/src/gdk/gdk_atoms.mx:2097: strPut:
Assertion `h->free + sizeof(var_t) <= ((var_t) 2147483647)' failed.
Aborted
It is the exact same document that gave the entity reference loop on the LDC.
It is reproducable (got exactly the same result twice). The data cannot be made
publicly available, but will be in the private lhm-testweb soon.
Is it perhaps a oid32 boundary we hit? Or is it something else?
----------------------------------------------------------------------
>Comment By: Peter Boncz (boncz)
Date: 2009-04-07 13:53
Message:
fixed: it gives an error now
----------------------------------------------------------------------
Comment By: Sjoerd Mullender (sjoerd)
Date: 2009-03-20 22:32
Message:
You're using 32 bit oids, and the type which is used to point into the
string heap is based on oid, i.e. 32 bits. Your file is 6 GB in size,
presumably most of it text, so that won't fit into 32 bits.
Try this with 64 bit oid.
This probably shouldn't fail with an assertion, though.
----------------------------------------------------------------------
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=482468&aid=2698327&group_id=56967
------------------------------------------------------------------------------
This SF.net email is sponsored by:
High Quality Requirements in a Collaborative Environment.
Download a free trial of Rational Requirements Composer Now!
http://p.sf.net/sfu/www-ibm-com
_______________________________________________
Monetdb-bugs mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/monetdb-bugs
