Bugs item #2785756, was opened at 2009-05-02 22:04
Message generated for change (Comment added) made by stmane
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=482468&aid=2785756&group_id=56967
Please note that this message will contain a full copy of the comment thread,
including the initial issue submission, for this request,
not just the latest update.
Category: XML
Group: MonetDB4 "stable"
Status: Open
Resolution: None
Priority: 5
Private: No
Submitted By: winston (wwinston)
Assigned to: Nobody/Anonymous (nobody)
Summary: crashes on shredding of large XML 1.2 GB XMark document
Initial Comment:
xquery>pf:add-doc("D:\Projects_Data_2009\data\XMarkStandard\fact8.xml","fact8.xm
l","fact8")
more>
more><>
MAPI = mone...@localhost:50000
QUERY = pf:add-doc("D:\Projects_Data_2009\data\XMarkStandard\fact8.xml","fact8.x
ml","fact8")
ERROR = !↕#GDKmmap(193462272) fails, try to free up space [memory in use=1433139
34,virtual memory in use=1171783680]
#GDKmmap(193462272) result [mem=143313934,vm=1171783680]
MAPI = mone...@localhost:50000
QUERY = pf:add-doc("D:\Projects_Data_2009\data\XMarkStandard\fact8.xml","fact8.x
ml","fact8")
ERROR = !ERROR: [shred_url]: 1 times inserted nil due to errors at tuples
0...@0.
!ERROR: [shred_url]: first error was:
!ERROR: HEAPextend: failed to extend to 193148746 for 10\1001theap
!ERROR: shredBAT_append_str: APPEND-STR[_prop_text](
!ERROR: tale cordelia sick terra wor crutch dates fie slee
p boarded avoid
!ERROR: arbour slippery yet sampson prove within dejected
graze clock
!ERROR: gentleman friendly brass best answering lord front
pitifully
!ERROR: forever expect cool halfpenny very gar post hinge
telling absence
!ERROR: affairs footed murderer author call key bent stran
ger
!ERROR: guildenstern yoke kneeling virtue diadem great cou
nterfeit
!ERROR: bootless cousin honestly councils troyans examinat
ion cruel
!ERROR: fearful chambermaids people prone conspirators lie
until oph
!ERROR: letting abortive appears purposed jour nod souther
ly dearest
!ERROR: vexation affairs theft preventions sparrow opinion
hue two
!ERROR: suddenly year mothers moon majesty tongue mortalit
y thereof
!ERROR: gratify march preventions harmless others intents
awhile alas
!ERROR: tweaks greek weeping renews penny masks shines bat
he pump choke
!ERROR: bawd gerard even beside load fall peeping ), BUNap
pend fails
!ERROR: CMDshred_url: operation failed.
xquery>
----------------------------------------------------------------------
>Comment By: Stefan Manegold (stmane)
Date: 2009-05-03 08:24
Message:
I guess from your previous bug report that you are running on 32-bit
Windows using the Feb2009 release of MonetDB.
I this case (32-bit Windows), you most probably simply hit the 2 GB
(31-bit) address space limitation in combination with address space
fragmentation on Win32: While loading that 1.2 GB document, Mserver grows
to almost 1.2 GB (vm=1171783680) and then needs to allocate (memory map) an
other almost 200 MB (GDKmmap(193462272)) apparently this fails, most
probably because there is no single consecutive free range of 200 MB left
in remaining <= 800 MB of the 2 GB address space, most probably due to
address space fragmentation.
You might want to upgrade to the latest Feb2009-SP2 bug fix release --- we
implemented some fixes in Feb2009-SP1 (and hence Feb2009-SP2) to better
cope with the memory/address space limitations and fragmentation problems
on Win32 --- and start your Mserver freshly only to load that 1.2 GB
document.
If that does not help, either, I see only two solution:
1) Migrate to 32-bit Unix (e.g., Linux)
2) (better) migrate to a 64-bit OS using a 64-bit build of MonetDB
Stefan
----------------------------------------------------------------------
Comment By: Stefan Manegold (stmane)
Date: 2009-05-02 22:19
Message:
The usual questions:
- Which version of MonetDB? (preferably the output of `Mserver
--version`)
- Which OS? (The paths indicate Windows, but which version, and 32-bit or
64-bit?)
- What kind of hardware? (mainly how much main memory?)
- How much free disk space on the partition (or "drive") that your dbfarm
is located on?
----------------------------------------------------------------------
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=482468&aid=2785756&group_id=56967
------------------------------------------------------------------------------
Register Now & Save for Velocity, the Web Performance & Operations
Conference from O'Reilly Media. Velocity features a full day of
expert-led, hands-on workshops and two days of sessions from industry
leaders in dedicated Performance & Operations tracks. Use code vel09scf
and Save an extra 15% before 5/3. http://p.sf.net/sfu/velocityconf
_______________________________________________
Monetdb-bugs mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/monetdb-bugs
