Michael,
What is the update? is it just a
DROP SILENT GRAPH <http://voordijk.eu/foaf.axd>
and if so, how big is the graph <http://voordijk.eu/foaf.axd>?
Being a transactional change, the intermediate size matters. Currently,
rather too much is memory only - it would be nice to spill to disk but
that's not implemented.
Is journal.jrnl of non-zero size?
My guess is that
+ journal.jrnl is zero bytes
+ <http://voordijk.eu/foaf.axd> is very large.
and if so the problem is that a transaction works in-memory until it
needs to commit. How much memory is dependent on the amount of change
but if <http://voordijk.eu/foaf.axd> is large, then it's a lot.
If my guess is right, the reason it takes along time is "just" that the
GC goes mad with increasingly longer full GCs - lots of memory has been
promoted to the long-term tenured area.
Andy
On 13/09/12 16:21, Michael Brunnbauer wrote:
hi all
this may also be important: The TDB is fresh (this is the first SPARQL update)
and has been created with tdbloader2 from a modified apache-jena-2.7.3
(jena-tdb-0.9.3.jar was replaced with jena-tdb-0.9.4-20120829.061613-27.jar).
I was able to tdbdump the TDB with an unmodified apache-jena-2.7.3.
All sorts of SPARQL queries have been tried on this TDB and have not yielded
any problems.
Regards,
Michael Brunnbauer
On Thu, Sep 13, 2012 at 04:59:00PM +0200, Michael Brunnbauer wrote:
hi all
the query that causes the problems seems to be:
DROP SILENT GRAPH <http://voordijk.eu/foaf.axd>
The graph <http://voordijk.eu/foaf.axd> seems to be nonexistent. I did a
select ?s ?p ?o where { graph <http://voordijk.eu/foaf.axd> { ?s ?p ?o }}
before and it yielded an empty result.
Regards,
Michael Brunnbauer
On Thu, Sep 13, 2012 at 04:35:15PM +0200, Michael Brunnbauer wrote:
hi all,
this seems to be more than a heap size issue. I have tried it with -Xmx8192M
and the SPARQL update is running for 50 minutes now. Fuseki was at full load
all the time reading from the TDB and gradually using up more memory:
15:41:07 INFO Fuseki :: [139] POST
http://ts.foaf-search.net:3030/crawl/update
[GC 193216K->29087K(740672K), 0.0585890 secs]
[GC 222303K->27983K(740672K), 0.0381150 secs]
[GC 221199K->28271K(740672K), 0.0239620 secs]
[GC 221487K->28511K(933888K), 0.0309770 secs]
[GC 414943K->29391K(933888K), 0.0296920 secs]
[GC 415823K->31655K(1316096K), 0.0352530 secs]
[GC 802919K->33423K(1317696K), 0.0382550 secs]
[GC 804687K->35047K(2091392K), 0.0193700 secs]
[...]
GC 4398711K->3188095K(5431040K), 2.3680030 secs]
[Full GC 3188095K->1718790K(5669440K), 7.7739740 secs]
16:00:10 INFO Fuseki :: [243] POST
http://ts.foaf-search.net:3030/foaf/query
[...]
16:33:59 INFO Fuseki :: [482] 200 OK
[Full GC 6506869K->5703394K(7456576K), 25.0731150 secs]
Regards,
Michael Brunnbauer
On Thu, Sep 13, 2012 at 02:00:29PM +0200, Michael Brunnbauer wrote:
hi all
I am running into
java.lang.OutOfMemoryError: Java heap space
with fuseki 0.2.4 (-Xmx1200M) when doing a SPARQL update on a 260GB TDB with
more than 1B quads. fuseki serves another TDB of this size (readonly) and
one with 60GB (readonly) and another one with 75MB (readwrite). I guess the
heap size should be increased. Any ideas to what value ?
The OutOfMemoryError seems to have occured before doing any changes to the
TDB. The only current file timestamps in the TDB are these:
-rw-r--r-- 1 java java 0 Sep 13 13:54 nodes.dat-jrnl
-rw-r--r-- 1 java java 0 Sep 13 13:54 prefixes.dat-jrnl
So the TDB should still be intact.
Regards,
Michael Brunnbauer
--
++ Michael Brunnbauer
++ netEstate GmbH
++ Geisenhausener Straße 11a
++ 81379 München
++ Tel +49 89 32 19 77 80
++ Fax +49 89 32 19 77 89
++ E-Mail [email protected]
++ http://www.netestate.de/
++
++ Sitz: München, HRB Nr.142452 (Handelsregister B München)
++ USt-IdNr. DE221033342
++ Geschäftsführer: Michael Brunnbauer, Franz Brunnbauer
++ Prokurist: Dipl. Kfm. (Univ.) Markus Hendel
--
++ Michael Brunnbauer
++ netEstate GmbH
++ Geisenhausener Straße 11a
++ 81379 München
++ Tel +49 89 32 19 77 80
++ Fax +49 89 32 19 77 89
++ E-Mail [email protected]
++ http://www.netestate.de/
++
++ Sitz: München, HRB Nr.142452 (Handelsregister B München)
++ USt-IdNr. DE221033342
++ Geschäftsführer: Michael Brunnbauer, Franz Brunnbauer
++ Prokurist: Dipl. Kfm. (Univ.) Markus Hendel
--
++ Michael Brunnbauer
++ netEstate GmbH
++ Geisenhausener Straße 11a
++ 81379 München
++ Tel +49 89 32 19 77 80
++ Fax +49 89 32 19 77 89
++ E-Mail [email protected]
++ http://www.netestate.de/
++
++ Sitz: München, HRB Nr.142452 (Handelsregister B München)
++ USt-IdNr. DE221033342
++ Geschäftsführer: Michael Brunnbauer, Franz Brunnbauer
++ Prokurist: Dipl. Kfm. (Univ.) Markus Hendel
