On 19/07/2019 08:09, Laura Morales wrote:
tdb2.tdbloader --loader=parallel
but it still becomes random IO (moves disk heads)
I haven't tried it extensively on an HDD - I'd be interested in hearing
what happens.
oh nice! I completely missed it. I've tried it with a 67GB .nt file from
users@jena.apache.org
Subject: Re: About fuseki2 load performance by java API
On 18/07/2019 13:08, Scarlet Remilia wrote:
> Thank you for reply!
>
>
>
> The server storage is HDD on local with RAID 10.
>
> CPU is 4x 14 cores with 28 threads but only one core is used during the load.
>
> tdb2.tdbloader --loader=parallel
>
> but it still becomes random IO (moves disk heads)
>
> I haven't tried it extensively on an HDD - I'd be interested in hearing
> what happens.
oh nice! I completely missed it. I've tried it with a 67GB .nt file from
LinkedGeoData on the same 750GB HDD but
ct: Re: About fuseki2 load performance by java API
That's quite slow. I get maybe 50-70K triples for a 100m load via the
Fuseki UI.
The fastest way is to use the bulk loader directly to setup the
database, then add it to Fuseki.
The hardware of the server makes a big difference. What's the server
storage system. A small matter of finding the time to experiment.
Andy
Sent: Thursday, July 18, 2019 at 2:08 PM
From: "Scarlet Remilia"
To: "users@jena.apache.org"
Subject: RE: About fuseki2 load performance by java API
Thank you for reply!
The server sto
day, July 18, 2019 at 2:08 PM
> From: "Scarlet Remilia"
> To: "users@jena.apache.org"
> Subject: RE: About fuseki2 load performance by java API
>
> Thank you for reply!
>
>
>
> The server storage is HDD on local with RAID 10.
>
> CPU is 4x 1
gt;
>
>
> Sent from Mail<https://go.microsoft.com/fwlink/?LinkId=550986> for Windows 10
>
>
>
> ________
> From: Andy Seaborne
> Sent: Thursday, July 18, 2019 6:41:56 PM
> To: users@jena.apache.org
> Subject: Re: About fuseki2 load performance by java API
>
> Tha
much!
Sent from Mail<https://go.microsoft.com/fwlink/?LinkId=550986> for Windows 10
From: Andy Seaborne
Sent: Thursday, July 18, 2019 6:41:56 PM
To: users@jena.apache.org
Subject: Re: About fuseki2 load performance by java API
That's quite slow. I get ma
That's quite slow. I get maybe 50-70K triples for a 100m load via the
Fuseki UI.
The fastest way is to use the bulk loader directly to setup the
database, then add it to Fuseki.
The hardware of the server makes a big difference. What's the server
setup? Disk/SSD? Local or remote storage?
