I'm trying to load a freebase dump into a tdb store and I noticed that
it is awfully slow. I tried using tdbloader2 which starts really fast
(at around 300k triples per second) but after a while the rate drops
to under 1000 triples per second.

I tried splitting the dump into several files so I can load them in
chunks and the first file (of around 200M triples) is processed with
no problems, but when we try to process the next one using tdbloader,
it rarely goes over 500 triples per second.

I suppose there might be an I/O bottleneck somewhere, but I was
wondering if anybody has suggestions on how to do this properly.

Thanks in advance,
Agustin

Reply via email to