Re: Jena Model is serializable in Java?

2019-07-11 Thread Siddhesh Rane
s, loading from a single > >> source using internal parallelism, not loading from parallel inputs. > >> (It's 5 threads for triples, more for quads). It load from a StreamRDF. > >> > >> NB - it can consume all the server's I/O bandwidth and a lot of CPU to > >> make the machine unusable for anything else

Re: Jena Model is serializable in Java?

2019-07-02 Thread Lorenz B.
It's 5 threads for triples, more for quads). It load from a StreamRDF. >> >> NB - it can consume all the server's I/O bandwidth and a lot of CPU to >> make the machine unusable for anything else. It is quite hardware dependent. >> >> Andy >> >

Re: Jena Model is serializable in Java?

2019-07-02 Thread Siddhesh Rane
f CPU to > make the machine unusable for anything else. It is quite hardware dependent. > > Andy > > > > > > > > > Thank you very much! > > > > Jason > > > > > > > > Sent from Mail<https://go.microsoft.com/fwlink/?LinkI

Re: Jena Model is serializable in Java?

2019-06-08 Thread Andy Seaborne
Sent: Thursday, June 6, 2019 6:35:41 PM To: users@jena.apache.org Subject: Re: Jena Model is serializable in Java? On 06/06/2019 08:57, Scarlet Remilia wrote: Hello everyone, My use case is a r2rml implementation, which could support millions or billions rows from RDBMS and distributed par

RE: Jena Model is serializable in Java?

2019-06-08 Thread Scarlet Remilia
ows 10 From: Andy Seaborne Sent: Thursday, June 6, 2019 6:35:41 PM To: users@jena.apache.org Subject: Re: Jena Model is serializable in Java? On 06/06/2019 08:57, Scarlet Remilia wrote: > Hello everyone, > > My use case is a r2rml implementation, which could support millions

Re: Jena Model is serializable in Java?

2019-06-06 Thread Andy Seaborne
microsoft.com/fwlink/?LinkId=550986> for Windows 10 From: Lorenz B.<mailto:buehm...@informatik.uni-leipzig.de> Sent: Thursday, June 6, 2019 15:32 To: users@jena.apache.org<mailto:users@jena.apache.org> Subject: Re: Jena Model is serializable in Java? I don't see why one would want t

Re: Jena Model is serializable in Java?

2019-06-06 Thread Andy Seaborne
On 06/06/2019 02:12, Dan Davis wrote: Jason, I would argue that you should exchange a Set of triples, so you can take advantage of Spark's distributed nature. Your logic can materialize that list into a Graph or Model when needed to operate on it. Andy is right about being careful about th

RE: Jena Model is serializable in Java?

2019-06-06 Thread Scarlet Remilia
tps://go.microsoft.com/fwlink/?LinkId=550986> for Windows 10 From: Lorenz B.<mailto:buehm...@informatik.uni-leipzig.de> Sent: Thursday, June 6, 2019 15:32 To: users@jena.apache.org<mailto:users@jena.apache.org> Subject: Re: Jena Model is serializable in Java? I don't see why one wo

Re: Jena Model is serializable in Java?

2019-06-06 Thread Lorenz B.
I don't see why one would want to share Model instances via Spark. I mean, it's possible via wrapping it inside an object which is serializable or some other wrapper method: object ModelWrapper extends Serializable { lazy val model = ... } rdd.map(s => ModelWrapper.model. ... ) This makes the m

Re: Jena Model is serializable in Java?

2019-06-05 Thread Dan Davis
Jason, I would argue that you should exchange a Set of triples, so you can take advantage of Spark's distributed nature. Your logic can materialize that list into a Graph or Model when needed to operate on it. Andy is right about being careful about the size - you may want to build a specialize

Re: Jena Model is serializable in Java?

2019-06-05 Thread Andy Seaborne
Hi Jason, Models aren't serializable, nor are Graphs (the more system oriented view of RDF) through Triples, Quads and Node are serializable. You can send a list of triples. Or use an RDF syntax and write-then-read the RDF. But are the models small? RDF graph aren't always small so moving

Jena Model is serializable in Java?

2019-06-05 Thread Scarlet Remilia
Hello everyone, I get a problem about Jena and Spark. I use Jena Model to handle some RDF models in my spark executor, but I get a error: java.io.NotSerializableException: org.apache.jena.rdf.model.impl.ModelCom Serialization stack: - object not serializable (class: org.apache.jena.rdf.