Dear OrientDB community - Thank you Luigi for your valuable inputs - I am loading millions of triples but at some points the system stucks. The load process uses JAVA SAIL interface.
One (reduced) file has e.g. two triples: <http://dbpedia.org/resource/Aristotle> <http://xmlns.com/foaf/0.1/name> "Aristotle"@en . <http://dbpedia.org/resource/Aristotle> <http://www.w3.org/1999/02/22-rdf-syntax-ns#type> <http://xmlns.com/foaf/0.1/Person> . The loading code is: /*INIT*/ graph = new OrientGraph("plocal:"+graphdbpath); lgraph.setUseClassForEdgeLabel(false); sail = new GraphSail((KeyIndexableGraph) lgraph); sail.initialize(); vf = sail.getValueFactory(); sc = sail.getConnection(); /* LOAD */ SPO spo = extract_triple(line); if (spo.o.substring(spo.o.length()-3, spo.o.length()-2).equals("@") || spo.o.contains("^^")) ouri=vf.createLiteral(tokenfromuri(spo.o)); else ouri=vf.createURI(spo.o); sc.addStatement( vf.createURI(spo.s), vf.createURI(spo.p), ouri, importgraphurl ); sc.commit(); The second file line ("o" translated to an URI) throws stably the following exception (See below). Enough memory and enough disk space. What can be wrong here please? How can I solve this ? Thank you very much in advance. Regards Fabio PS: The exception com.orientechnologies.orient.core.index.OIndexException: Error during insertion of key in index at com.orientechnologies.orient.core.index.OIndexMultiValues.put(OIndexMultiValues.java:141) at com.orientechnologies.orient.core.index.OIndexMultiValues.put(OIndexMultiValues.java:52) at com.orientechnologies.orient.core.index.OIndexAbstract.putInSnapshot(OIndexAbstract.java:871) at com.orientechnologies.orient.core.index.OIndexAbstract.applyIndexTxEntry(OIndexAbstract.java:1051) at com.orientechnologies.orient.core.index.OIndexAbstract.addTxOperation(OIndexAbstract.java:685) at com.orientechnologies.orient.core.tx.OTransactionOptimistic$CommitIndexesCallback.run(OTransactionOptimistic.java:99) at com.orientechnologies.orient.core.storage.impl.local.OAbstractPaginatedStorage.commit(OAbstractPaginatedStorage.java:927) at com.orientechnologies.orient.core.tx.OTransactionOptimistic.doCommit(OTransactionOptimistic.java:491) at com.orientechnologies.orient.core.tx.OTransactionOptimistic.commit(OTransactionOptimistic.java:148) at com.orientechnologies.orient.core.db.document.ODatabaseDocumentTx.commit(ODatabaseDocumentTx.java:2412) at com.orientechnologies.orient.core.db.document.ODatabaseDocumentTx.commit(ODatabaseDocumentTx.java:2382) at com.tinkerpop.blueprints.impls.orient.OrientTransactionalGraph.commit(OrientTransactionalGraph.java:161) at com.tinkerpop.blueprints.oupls.sail.GraphSailConnection.commitInternal(GraphSailConnection.java:74) at org.openrdf.sail.helpers.SailConnectionBase.commit(SailConnectionBase.java:305) at com.semweb.load.OrientDBLoader.load_nt_file(OrientDBLoader.java:360) at com.semweb.load.OrientDBLoader.traverse_dir(OrientDBLoader.java:518) at com.semweb.load.OrientDBLoader.main(OrientDBLoader.java:177) Caused by: com.orientechnologies.orient.core.index.sbtree.local.OSBTreeException: Error during index update with key #10:19428727 and value true at com.orientechnologies.orient.core.index.sbtreebonsai.local.OSBTreeBonsaiLocal.put(OSBTreeBonsaiLocal.java:308) at com.orientechnologies.orient.core.db.record.ridbag.sbtree.OIndexRIDContainerSBTree.add(OIndexRIDContainerSBTree.java:137) at com.orientechnologies.orient.core.db.record.ridbag.sbtree.OIndexRIDContainerSBTree.add(OIndexRIDContainerSBTree.java:47) at com.orientechnologies.orient.core.db.record.ridbag.sbtree.OIndexRIDContainer.add(OIndexRIDContainer.java:146) at com.orientechnologies.orient.core.db.record.ridbag.sbtree.OIndexRIDContainer.add(OIndexRIDContainer.java:44) at com.orientechnologies.orient.core.index.OIndexMultiValues.put(OIndexMultiValues.java:133) ... 16 more Caused by: java.lang.NullPointerException at com.orientechnologies.orient.core.storage.impl.local.paginated.atomicoperations.OAtomicOperation.releasePage(OAtomicOperation.java:151) at com.orientechnologies.orient.core.storage.impl.local.paginated.base.ODurableComponent.releasePage(ODurableComponent.java:128) at com.orientechnologies.orient.core.index.sbtreebonsai.local.OSBTreeBonsaiLocal.findBucket(OSBTreeBonsaiLocal.java:1241) at com.orientechnologies.orient.core.index.sbtreebonsai.local.OSBTreeBonsaiLocal.put(OSBTreeBonsaiLocal.java:262) ... 21 more -- --- You received this message because you are subscribed to the Google Groups "OrientDB" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. For more options, visit https://groups.google.com/d/optout.
signature.asc
Description: OpenPGP digital signature
