[
https://issues.apache.org/jira/browse/JENA-2217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17464087#comment-17464087
]
Andy Seaborne edited comment on JENA-2217 at 12/22/21, 9:42 PM:
----------------------------------------------------------------
[~oyvind.gjesdal] – thanks. I have a working branch for xloader2 refinement
and I've made your suggested changes there, and also the java process exit if
the sort returns an error code, then the script exits.
The script will check for a writable directory tmpdir as well as for the
commands needed like {{{}jq{}}}.
was (Author: andy.seaborne):
[~oyvind.gjesdal] – thanks. I have a working branch for xloader2 refinement
and I've made the change there and it now also exits the java process.
The script will check for a writable directory tmpdir as well as for the
commands needed like `jq`.
> tdb2.xloader java.io.IOException: Broken pipe
> ---------------------------------------------
>
> Key: JENA-2217
> URL: https://issues.apache.org/jira/browse/JENA-2217
> Project: Apache Jena
> Issue Type: Bug
> Components: Cmd line tools
> Environment: Rocky linux 8
> openjdk 17.0.1 2021-10-19 LTS
> OpenJDK Runtime Environment 21.9 (build 17.0.1+12-LTS)
> OpenJDK 64-Bit Server VM 21.9 (build 17.0.1+12-LTS, mixed mode, sharing)
> Reporter: Øyvind Gjesdal
> Assignee: Andy Seaborne
> Priority: Major
> Attachments: truthy-import.log
>
>
> When running the tdb2.xloader with
> `
> {code:java}
> JVM_ARGS="-Xmx12G -Xms12G -XX:+UseParallelGC" $JENA_HOME/bin/tdb2.xloader
> --loc /var/fuseki/databases/wd-truthy --tmpdir /var/fuseki/databases/tmp
> /var/fuseki/databases/latest-truthy.nt.gz |& tee
> /home/fuseki/truthy-import.log {code}
> `
>
>
>
> The exception also doesn't exit the application, but continues indefinetly
> with a new exception, stream closed.
> This is for a snapshot a day prior to 4.3.1.
> [^truthy-import.log]
>
> {code:java}
> java.io.IOException: Broken pipe
> at java.base/java.io.FileOutputStream.writeBytes(Native Method)
> at java.base/java.io.FileOutputStream.write(FileOutputStream.java:349)
> at
> java.base/java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:81)
> at
> java.base/java.io.BufferedOutputStream.write(BufferedOutputStream.java:95)
> at
> org.apache.jena.tdb2.xloader.ProcNodeTableBuilderX.hexWrite(ProcNodeTableBuilderX.java:331)
> at
> org.apache.jena.tdb2.xloader.ProcNodeTableBuilderX$NodeHashTmpStream.write(ProcNodeTableBuilderX.java:407)
> at
> org.apache.jena.tdb2.xloader.ProcNodeTableBuilderX$NodeHashTmpStream.node(ProcNodeTableBuilderX.java:396)
> at
> org.apache.jena.tdb2.xloader.ProcNodeTableBuilderX$NodeHashTmpStream.triple(ProcNodeTableBuilderX.java:360)
> at
> org.apache.jena.riot.system.StreamRDFWrapper.triple(StreamRDFWrapper.java:40)
> at
> org.apache.jena.system.progress.ProgressStreamRDF.triple(ProgressStreamRDF.java:41)
> at
> org.apache.jena.riot.lang.LangNTriples.runParser(LangNTriples.java:55)
> 11:26:56 ERROR Terms :: Sort RC = 2
> at org.apache.jena.riot.lang.LangBase.parse(LangBase.java:43)
> at
> org.apache.jena.riot.RDFParserRegistry$ReaderRIOTLang.read(RDFParserRegistry.java:186)
> at org.apache.jena.riot.RDFParser.read(RDFParser.java:366)
> at org.apache.jena.riot.RDFParser.parseURI(RDFParser.java:335)
> at org.apache.jena.riot.RDFParser.parse(RDFParser.java:310)
> at
> org.apache.jena.riot.RDFParserBuilder.parse(RDFParserBuilder.java:552)
> at
> org.apache.jena.tdb2.xloader.ProcNodeTableBuilderX.lambda$exec$0(ProcNodeTableBuilderX.java:156)
> at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
> at
> org.apache.jena.tdb2.xloader.ProcNodeTableBuilderX.lambda$exec$1(ProcNodeTableBuilderX.java:152)
> at java.base/java.lang.Thread.run(Thread.java:833)
> java.io.IOException: Stream closed
> at
> java.base/java.lang.ProcessBuilder$NullOutputStream.write(ProcessBuilder.java:445)
> at java.base/java.io.OutputStream.write(OutputStream.java:162)
> at
> java.base/java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:81)
> at
> java.base/java.io.BufferedOutputStream.write(BufferedOutputStream.java:95)
> at
> org.apache.jena.tdb2.xloader.ProcNodeTableBuilderX.hexWrite(ProcNodeTableBuilderX.java:330)
> at
> org.apache.jena.tdb2.xloader.ProcNodeTableBuilderX$NodeHashTmpStream.write(ProcNodeTableBuilderX.java:407)
> at
> org.apache.jena.tdb2.xloader.ProcNodeTableBuilderX$NodeHashTmpStream.node(ProcNodeTableBuilderX.java:394)
> at
> org.apache.jena.tdb2.xloader.ProcNodeTableBuilderX$NodeHashTmpStream.triple(ProcNodeTableBuilderX.java:360)
> at
> org.apache.jena.riot.system.StreamRDFWrapper.triple(StreamRDFWrapper.java:40)
> at
> org.apache.jena.system.progress.ProgressStreamRDF.triple(ProgressStreamRDF.java:41)
> at
> org.apache.jena.riot.lang.LangNTriples.runParser(LangNTriples.java:55)
> at org.apache.jena.riot.lang.LangBase.parse(LangBase.java:43)
> at
> org.apache.jena.riot.RDFParserRegistry$ReaderRIOTLang.read(RDFParserRegistry.java:186)
> at org.apache.jena.riot.RDFParser.read(RDFParser.java:366)
> at org.apache.jena.riot.RDFParser.parseURI(RDFParser.java:335)
> at org.apache.jena.riot.RDFParser.parse(RDFParser.java:310)
> at
> org.apache.jena.riot.RDFParserBuilder.parse(RDFParserBuilder.java:552)
> at
> org.apache.jena.tdb2.xloader.ProcNodeTableBuilderX.lambda$exec$0(ProcNodeTableBuilderX.java:156)
> at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
> at
> org.apache.jena.tdb2.xloader.ProcNodeTableBuilderX.lambda$exec$1(ProcNodeTableBuilderX.java:152)
> at java.base/java.lang.Thread.run(Thread.java:833)
> {code}
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
