Re: TDB2 and bulk loading

2018-03-23 Thread Davide
Hi, Now I'm trying to load 200M triples. With "I don't think it's optimal" I wanted to say that I don't know if it's the optimal approach. Anyway now I try to use TDB2 with Fuseki server. Thanks so much Il 23 mar 2018 2:57 PM, "Andy Seaborne" ha scritto: On 23/03/18 10:32,

Re: TDB2 and bulk loading

2018-03-23 Thread Andy Seaborne
On 23/03/18 10:32, Davide wrote: Well, so what is the best way to do this? I'm trying a lot of ways. Now I load the default model in memory from dataset with getDefaultModel method, and each time, I append triples in another model create with createDefaultModel(). When I obtain 20 triples

Re: TDB2 and bulk loading

2018-03-23 Thread Davide
Well, so what is the best way to do this? I'm trying a lot of ways. Now I load the default model in memory from dataset with getDefaultModel method, and each time, I append triples in another model create with createDefaultModel(). When I obtain 20 triples into the model, I load model in the

Re: TDB2 and bulk loading

2018-03-21 Thread Andy Seaborne
Bulkloading (TDB1) is for working from an empty dataset. The tricks it uses do not work when there is already data in dataset. For TDB1, One of the bulkloaders simply loads triples/qwuads, the other refuses to load. For TDB2, which has no limits on the size of transactions, a batch size of

Re: TDB2 and bulk loading

2018-03-19 Thread Davide
I've about 2 triples to load each time. I load data into models with Jena API, and write data inside a StreamWriter. When the buffer has a certain size, I load data in the dataset with the Bulkloader. But now I'm trying to use TDB2 with Loader.Bulkload method to see if there are improvements,

Re: TDB2 and bulk loading

2018-03-19 Thread ajs6f
What >> hardware? What environment? Are you loading a line based serialization? Are >> you loading from scratch or appending? >> >> D >> >> On Mon, 19 Mar 2018, 10:51 Davide, <kasted...@gmail.com> wrote: >> >>> Hi, >>> What is the best wa

Re: TDB2 and bulk loading

2018-03-19 Thread Davide
erialization? Are > you loading from scratch or appending? > > D > > On Mon, 19 Mar 2018, 10:51 Davide, <kasted...@gmail.com> wrote: > > > Hi, > > What is the best way to perform the bulk loading with TDB2 and Java API? > > Because I used the bulkloader with TDB1, but when I store data, it's too > > slow. > > >

Re: TDB2 and bulk loading

2018-03-19 Thread Dick Murray
y to perform the bulk loading with TDB2 and Java API? > Because I used the bulkloader with TDB1, but when I store data, it's too > slow. >

TDB2 and bulk loading

2018-03-19 Thread Davide
Hi, What is the best way to perform the bulk loading with TDB2 and Java API? Because I used the bulkloader with TDB1, but when I store data, it's too slow.