Hi all,

Since upgrading neo4j 1.4.1 to 1.5.M02 I get a InvalidRecordException
while importing data in a new store using BatchInserter (never seen this
exception with 1.4.1).

For identical program executions the exceptions occur at different
moments. The problem only occurs after inserting millions of
nodes/relations, but occurs in each run. The data is inserted in a
single thread. Properties are not necessarily added to a node right
after node creation.

I've included configuration details below, including the exception
output during three identical runs. 

Is this a known issue in 1.5.M02? Anyone encountered the same exception?
Any suggestions how to tackle this problem?

Greetings,
Dennis

*** java
java version "1.6.0_27"
Java(TM) SE Runtime Environment (build 1.6.0_27-b07)
Java HotSpot(TM) 64-Bit Server VM (build 20.2-b06, mixed mode)

java -Xmx9g (not using any additional flags)

*** neo4j
Physical mem: 9991MB, Heap size: 8192MB
use_memory_mapped_buffers=false
neostore.propertystore.db.index.keys.mapped_memory=1M
neostore.propertystore.db.strings.mapped_memory=426M
neostore.propertystore.db.arrays.mapped_memory=483M
neostore.propertystore.db.strings=2000M
neostore.propertystore.db=1600M
neo_store=/tmp/neostore
neostore.relationshipstore.db.mapped_memory=3400M
neostore.propertystore.db.index.mapped_memory=1M
neostore.propertystore.db.mapped_memory=501M
dump_configuration=true
cache_type=weak
neostore.nodestore.db.mapped_memory=150M

*** run #1
parsed 6100000 pages (2157 pages/sec)
parsed 6150000 pages (1014 pages/sec)
Exception in thread "main"
org.neo4j.kernel.impl.nioneo.store.InvalidRecordException: Not in use,
blockId[2397918]
org.neo4j.kernel.impl.nioneo.store.AbstractDynamicStore.getRecord(AbstractDynamicStore.java:388)
 
org.neo4j.kernel.impl.nioneo.store.AbstractDynamicStore.getLightRecords(AbstractDynamicStore.java:333)
 
org.neo4j.kernel.impl.nioneo.store.PropertyStore.getRecord(PropertyStore.java:376)
 
org.neo4j.kernel.impl.batchinsert.BatchInserterImpl.deletePropertyChain(BatchInserterImpl.java:476)
 
org.neo4j.kernel.impl.batchinsert.BatchInserterImpl.setNodeProperties(BatchInserterImpl.java:244)
...
shutting down graph databases

*** run #2
parsed 5550000 pages (927 pages/sec)
parsed 5600000 pages (761 pages/sec)
Exception in thread "main"
org.neo4j.kernel.impl.nioneo.store.InvalidRecordException: Not in use,
blockId[8198653]
org.neo4j.kernel.impl.nioneo.store.AbstractDynamicStore.getRecord(AbstractDynamicStore.java:388)
 
org.neo4j.kernel.impl.nioneo.store.AbstractDynamicStore.getLightRecords(AbstractDynamicStore.java:333)
 
org.neo4j.kernel.impl.nioneo.store.PropertyStore.getRecord(PropertyStore.java:376)
 
org.neo4j.kernel.impl.batchinsert.BatchInserterImpl.deletePropertyChain(BatchInserterImpl.java:476)
 
org.neo4j.kernel.impl.batchinsert.BatchInserterImpl.setNodeProperties(BatchInserterImpl.java:244)
...
shutting down graph databases

*** run #3
parsed 6250000 pages (562 pages/sec)
parsed 6300000 pages (575 pages/sec)
Exception in thread "main"
org.neo4j.kernel.impl.nioneo.store.InvalidRecordException: Not in use,
blockId[9378804]
org.neo4j.kernel.impl.nioneo.store.AbstractDynamicStore.getRecord(AbstractDynamicStore.java:388)
 
org.neo4j.kernel.impl.nioneo.store.AbstractDynamicStore.getLightRecords(AbstractDynamicStore.java:333)
 
org.neo4j.kernel.impl.nioneo.store.PropertyStore.getRecord(PropertyStore.java:376)
 
org.neo4j.kernel.impl.batchinsert.BatchInserterImpl.deletePropertyChain(BatchInserterImpl.java:476)
 
org.neo4j.kernel.impl.batchinsert.BatchInserterImpl.setNodeProperties(BatchInserterImpl.java:244)
...
11/10/14 12:50:50 INFO neo4j.Neo4jStore: shutting down graph databases



_______________________________________________
Neo4j mailing list
User@lists.neo4j.org
https://lists.neo4j.org/mailman/listinfo/user

Reply via email to