Hi Magnus!
I've had a similar problem with a recent Fuseki SVN snapshot, with
similar small data sets (size is less than 30MB per dataset, each loaded
with s-put into a separate named graph), though I "only" gave Fuseki 3GB
of memory and had only around 20 datasets in total, so much less than
your 11 GB.
When I tried to load more than a couple of them in sequence, I either
got a corrupted TDB database or a Java heap space error (or both). I
ended up spoon-feeding Fuseki one dataset at a time and restarting it in
between every data set, just to be sure it won't blow up. This way I got
all my datasets loaded, but it was obviously a bit cumbersome...
I haven't yet had time to look at the issue in detail though. Based on
earlier messages in the archive I read at the time, it seemed to me that
eating memory (and not releasing it) whenever data comes in through
SPARQL is considered normal behavior for Fuseki. But maybe the situation
is not that dire and this could be considered a bug :)
-Osma
06.09.2012 13:57, Magnus Stuhr kirjoitti:
Hi,
I am encountering a re-occuring Java heap space issue with a Fuseki
TDB database through SPARQL update. I am trying to load 11 GB of data
into a Fuseki triplestore through SPARQL update (s-post) on named
graphs. I have allocated 6 GB of memory to the JVM in the
fuseki-server configuration file, but I still get a "500 Java heap
space" error when trying to load the data. The data I am trying to
load consist of several data files, all of which have a maximum size
of 25 MB seperately. When my TDB database folder (specified in the
fuseki config file) has reached a size of approximately 5 GB I start
getting the Java heap space error.
I try to update the data in this manner:
./s-post <data set URI> <graph-URI> (for instance, ./s-post
http://localhost:3030/dataset/data test.ttl)
Do anyone know how I can work around this?
Best regards, Magnus Stuhr
--
Osma Suominen | [email protected] | +358 40 5255 882
Aalto University, Department of Media Technology, Semantic Computing
Research Group
Room 2541, Otaniementie 17, Espoo, Finland; P.O. Box 15500, FI-00076
Aalto, Finland
