[
https://issues.apache.org/jira/browse/JENA-1908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17135556#comment-17135556
]
Wolfgang Fahl commented on JENA-1908:
-------------------------------------
[~yolpsoftware] nice offer - a quick calculation: uploading 2.3 TB at e.g. 10
MB/sec will take 3 days - downloading at 5 MB/sec will take 6 days. Sending a
harddisk by UPS gives you higher bandwidth :)
I have already waited over a month and I would be able to invest in a 4 TB SSD
if it makes sense. Currently i am experimenting with wdumper see
[https://github.com/bennofs/wdumper/issues/15] to get smaller dumps and i have
a fourth import running with a rotating disk. Where some 1 billion triples had
been imported after less than a day. Let's see how the performance degrades
this time.
> TDB2: tdb2.tdbloader crashes
> ----------------------------
>
> Key: JENA-1908
> URL: https://issues.apache.org/jira/browse/JENA-1908
> Project: Apache Jena
> Issue Type: Bug
> Components: TDB2
> Affects Versions: Jena 3.15.0
> Reporter: Wolfgang Fahl
> Priority: Major
> Attachments: tdb2--out.log
>
>
> [http://wiki.bitplan.com/index.php/Get_your_own_copy_of_WikiData#third_attempt_to_load_with_tdb2.tdbloader]
> describes a WikiData import attempt that ran some 14 days before it crashed.
>
> {code:java}
> java.lang.IllegalArgumentException: null at
> java.nio.Buffer.position(Buffer.java:244) ~[?:1.8.0_201] at
> org.apache.jena.dboe.base.record.RecordFactory.lambda$static$0(RecordFactory.java:111)
> ~[jena-dboe-base-3.15.0.jar:3.15.0] at
> org.apache.jena.dboe.base.record.RecordFactory.buildFrom(RecordFactory.java:127)
> ~[jena-dboe-base-3.15.0.jar:3.15.0] at
> org.apache.jena.dboe.base.buffer.RecordBuffer._get(RecordBuffer.java:102)
> ~[jena-dboe-base-3.15.0.jar:3.15.0] at
> org.apache.jena.dboe.base.buffer.RecordBuffer.get(RecordBuffer.java:52)
> ~[jena-dboe-base-3.15.0.jar:3.15.0] at
> org.apache.jena.dboe.trans.bplustree.BPTreeRecords.getSplitKey(BPTreeRecords.java:195)
> ~[jena-dboe-trans-data-3.15.0.jar:3.15.0] at
> org.apache.jena.dboe.trans.bplustree.BPTreeNode.split(BPTreeNode.java:562)
> ~[jena-dboe-trans-data-3.15.0.jar:3.15.0] at
> org.apache.jena.dboe.trans.bplustree.BPTreeNode.internalInsert(BPTreeNode.java:509)
> ~[jena-dboe-trans-data-3.15.0.jar:3.15.0] at
> org.apache.jena.dboe.trans.bplustree.BPTreeNode.internalInsert(BPTreeNode.java:522)
> ~[jena-dboe-trans-data-3.15.0.jar:3.15.0] at
> org.apache.jena.dboe.trans.bplustree.BPTreeNode.internalInsert(BPTreeNode.java:522)
> ~[jena-dboe-trans-data-3.15.0.jar:3.15.0] at
> org.apache.jena.dboe.trans.bplustree.BPTreeNode.internalInsert(BPTreeNode.java:522)
> ~[jena-dboe-trans-data-3.15.0.jar:3.15.0] at
> org.apache.jena.dboe.trans.bplustree.BPTreeNode.insert(BPTreeNode.java:203)
> ~[jena-dboe-trans-data-3.15.0.jar:3.15.0] at
> org.apache.jena.dboe.trans.bplustree.BPlusTree.insertAndReturnOld(BPlusTree.java:278)
> ~[jena-dboe-trans-data-3.15.0.jar:3.15.0] at
> org.apache.jena.dboe.trans.bplustree.BPlusTree.insert(BPlusTree.java:271)
> ~[jena-dboe-trans-data-3.15.0.jar:3.15.0] at
> org.apache.jena.tdb2.store.tupletable.TupleIndexRecord.performAdd(TupleIndexRecord.java:94)
> ~[jena-tdb2-3.15.0.jar:3.15.0] at
> org.apache.jena.tdb2.store.tupletable.TupleIndexBase.add(TupleIndexBase.java:66)
> ~[jena-tdb2-3.15.0.jar:3.15.0] at
> org.apache.jena.tdb2.loader.main.Indexer.lambda$loadTuples$1(Indexer.java:133)
> ~[jena-tdb2-3.15.0.jar:3.15.0] at
> org.apache.jena.tdb2.loader.main.Indexer.stageIndex(Indexer.java:115)
> ~[jena-tdb2-3.15.0.jar:3.15.0] at
> org.apache.jena.tdb2.loader.main.Indexer.lambda$startBulk$0(Indexer.java:92)
> ~[jena-tdb2-3.15.0.jar:3.15.0] at java.lang.Thread.run(Thread.java:748)
> [?:1.8.0_201] 14:58:42 ERROR Indexer :: Interrupted
>
> {code}
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
