Hello Andy, On Tue, Jul 24, 2012 at 01:13:59PM +0200, Michael Brunnbauer wrote: > BTW: Here is some output from tdbloader2 for this TDB which shows that > the tdbloader2 data phase runtime gets quite non-linear for very big datasets. > I called tdbloader2 with JVM_ARGS="-Xmx32768M -server" and it did not seem to > run into memory problems.
I should be more specific here: Whenever I watched it after 10^9 quads it was doing disk IO (i think mostly writes, probably to node2id.dat and nodes.dat). Would it be possible to generate node2id.dat and nodes.dat without random access ? Regards, Michael Brunnbauer -- ++ Michael Brunnbauer ++ netEstate GmbH ++ Geisenhausener Straße 11a ++ 81379 München ++ Tel +49 89 32 19 77 80 ++ Fax +49 89 32 19 77 89 ++ E-Mail [email protected] ++ http://www.netestate.de/ ++ ++ Sitz: München, HRB Nr.142452 (Handelsregister B München) ++ USt-IdNr. DE221033342 ++ Geschäftsführer: Michael Brunnbauer, Franz Brunnbauer ++ Prokurist: Dipl. Kfm. (Univ.) Markus Hendel
