Re: How to parse huge RDF data in a tar.gz file.

2019-08-07 Thread Yasunori Yamamoto
Thank you very much! Yes, the crash was on the second entry, and I modified the code to use CloseShieldInputStream. It works without any problems. 2019年8月8日(木) 2:32 Andy Seaborne : > > Presumably on the second entry? > > Protect the parser stream from the unwanted close with >

Re: How to parse huge RDF data in a tar.gz file.

2019-08-07 Thread Andy Seaborne
Presumably on the second entry? Protect the parser stream from the unwanted close with CloseShieldInputStream: On 07/08/2019 17:57, Yasunori Yamamoto wrote: Hi Andy, Thank you for your reply. Is the following code what you assume? If so, it crashed with Exception in thread "main"

Re: How to parse huge RDF data in a tar.gz file.

2019-08-07 Thread Yasunori Yamamoto
Hi Andy, Thank you for your reply. Is the following code what you assume? If so, it crashed with Exception in thread "main" java.lang.NullPointerException. TarArchiveInputStream tarInput = new TarArchiveInputStream(new ...); TarArchiveEntry currentEntry; while ((currentEntry =

Re: How to parse huge RDF data in a tar.gz file.

2019-08-07 Thread Andy Seaborne
Yasunori, It should be possible to pass the InputStream for the tar entry contents directly to the RDFParserBuilder.source, no need to convert to a string first. IIRC TarArchiveInputStream is a bit weird - it signals "end of file" at the end of the tar archive entry, the the app moves to

Re: How to parse huge RDF data in a tar.gz file.

2019-08-06 Thread Yasunori Yamamoto
Files in a tar are in RDF/XML or Turtle. Yasunori 2019/08/07 3:11、ajs6f のメール: In what format are these RDF files? ajs6f > On Aug 6, 2019, at 10:05 AM, Yasunori Yamamoto wrote: > > Hello, I'm trying to learn how to parse RDF data archived in a tar.gz > file (e.g., rdfdatasets.tar.gz that

Re: How to parse huge RDF data in a tar.gz file.

2019-08-06 Thread ajs6f
In what format are these RDF files? ajs6f > On Aug 6, 2019, at 10:05 AM, Yasunori Yamamoto wrote: > > Hello, I'm trying to learn how to parse RDF data archived in a tar.gz > file (e.g., rdfdatasets.tar.gz that contains a set of RDF data files) > within my Java program. > The following code

How to parse huge RDF data in a tar.gz file.

2019-08-06 Thread Yasunori Yamamoto
Hello, I'm trying to learn how to parse RDF data archived in a tar.gz file (e.g., rdfdatasets.tar.gz that contains a set of RDF data files) within my Java program. The following code does work properly, but it is inefficient because the process reads and loads the entire RDF data in an entry of