Re: TDB2 bulk loader - multiple files into different graph per file

2022-08-26 Thread Andy Seaborne
On 26/08/2022 15:03, Lorenz Buehmann wrote: I'm asking because I thought the initial loading is way faster then iterating over multiple (graph, file) pairs and running the TDB2 loader for each pair? Yes. It is faster when loading from empty in a single run of a loader. The loaders do some

Re: TDB2 bulk loader - multiple files into different graph per file

2022-08-26 Thread Dan Brickley
On Fri, 26 Aug 2022 at 16:27, Andy Seaborne wrote: > > > On 26/08/2022 15:03, Lorenz Buehmann wrote: > > I'm asking because I thought the initial loading is way faster then > > iterating over multiple (graph, file) pairs and running the TDB2 loader > > for each pair? > > Yes. It is faster when

TDB2 bulk loader - multiple files into different graph per file

2022-08-26 Thread Lorenz Buehmann
Hi all, is there any option to use TDB2 bulk loader (tdb2.xloader or just tdb2.loader) to load multiple files into multiple different named graphs? Like tdb2.loader --loc ./tdb2/dataset --graph file1 --graph file2 ... I'm asking because I thought the initial loading is way faster then

Re: TDB2 bulk loader - multiple files into different graph per file

2022-08-26 Thread Andy Seaborne
Hi Lorenz, No - there isn't an option. The way to do it is to prepare the load as quads by, for example, wrapping in TriG syntax around the files or adding the G to N-triples. This can be done streaming and piped into the loader (with --syntax= if not N-quads). > By the way, the

Re: TDB2 bulk loader - multiple files into different graph per file

2022-08-26 Thread Andy Seaborne
On 26/08/2022 19:50, Dan Brickley wrote: On Fri, 26 Aug 2022 at 16:27, Andy Seaborne wrote: On 26/08/2022 15:03, Lorenz Buehmann wrote: I'm asking because I thought the initial loading is way faster then iterating over multiple (graph, file) pairs and running the TDB2 loader for each