On 25/11/17 12:08, Laura Morales wrote:
How long does it take to load, using what hardware?
This is "all", and not "truthy"?
Yes this file
https://dumps.wikimedia.org/wikidatawiki/entities/latest-all.ttl.gz
Parsing the data: I got:
latest-truthy.nt.gz
4,736.87 sec : 2,199,382,887 Triples : 464,311.63 per second
latest-all.ttl.gz
8,864.36 sec : 4,787,194,669 Triples : 540,049.73 per second
and 3,284,314 warnings.
Intel Core 2 Duo 8GB 1TB
I have never timed it but it takes hours. Can Jena use more cores to create the
TDB2 store faster?
It can, as in "it could be enhanced to do that", but it doesn't.
Experiment needed - on a normal commodity server or a portable, the
limiting factor may not be the CPU, or just the CPU. The system bus
(moving data around) and the persistent storage may be limitations.
Andy
