Thomas,
Here is a more elusive issue that I'm wondering if its a bug in
MVMap/MVStore.
I'm currently using MVStore as a large, temporary disk cache, I have a java
program that scans about 10GB of raw CSV-ish files, and for each file,
plucks out a few fields I care about and stores it in a MVMap. At the end,
I merge the data from several MVMaps into a small JSON document which
represents all the data buried in the CSV files for a particular entity. I
then store that JSON document in H2 for my app to use.
Its been working fairly well (and fast!), but there is one weird issue I'm
encountering, that throws the exception below after 6-8M rows have been
processed. Its going to be tough to extrapolate a test case, I was
wondering if you had any insight into this? It seems to go away when I
shorten some key sizes, but I don't know if I'm just delaying the problem
and eventually this would still happen?
I'm using 1.3.173, basically every 50k records or so I call MVstore.store()
to flush to disk and eventually its throwing this:
Caused by: java.nio.BufferOverflowException
at java.nio.HeapByteBuffer.put(HeapByteBuffer.java:183)
at java.nio.ByteBuffer.put(ByteBuffer.java:832)
at
org.h2.mvstore.type.ObjectDataType$SerializedObjectType.write(ObjectDataT
pe.java:1515)
at org.h2.mvstore.type.ObjectDataType.write(ObjectDataType.java:113)
at org.h2.mvstore.Page.write(Page.java:799)
at org.h2.mvstore.Page.writeUnsavedRecursive(Page.java:860)
at org.h2.mvstore.Page.writeUnsavedRecursive(Page.java:855)
at org.h2.mvstore.Page.writeUnsavedRecursive(Page.java:855)
at org.h2.mvstore.Page.writeUnsavedRecursive(Page.java:855)
at org.h2.mvstore.MVStore.store(MVStore.java:921)
at org.h2.mvstore.MVStore.store(MVStore.java:813)
Thanks,
Brian
--
You received this message because you are subscribed to the Google Groups "H2
Database" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to [email protected].
To post to this group, send email to [email protected].
Visit this group at http://groups.google.com/group/h2-database.
For more options, visit https://groups.google.com/groups/opt_out.
