If you saw an exception then please share it. Not sure in which problem you ran, best share you full import code for feedback
In your mmio config you should probably assign 1GB to nodes and 5GB to rels And possibly use unix/mac and not windows Sent from mobile device Am 16.08.2014 um 17:01 schrieb Alex winter <[email protected]>: > > > On Saturday, August 16, 2014 4:09:49 PM UTC+2, Michael Hunger wrote: >> >> >> >> Sent from mobile device >> >> Am 02.08.2014 um 08:53 schrieb Alex winter <[email protected]>: >> >>> Thanks. >>> I found that: >>> - there is timeout for batch inserter( but i didn't find any information >>> about how to set time out for this) >> No there is none >> >>> - another problem is because my data is quite big and the storage is not >>> enough for batch inserter use to insert >> >> Could you elaborate > > I have 91 million nodes, 180 million relationships. My computer has only 8gb > ram. I think I didn't set enough memory as configuration(jvm setting) so If I > debug, after 7 hours, I saw that the property of object batch inserter : > closed. It is a reason why after importing 1-2 million from my data (around > 9-10 million nodes in graph). It is fines if I did this. >>> >>> Anyway, I have questions: >>> - As I found on Internet, we can't update data with batchinserter? Is this >>> right? >> >> No you can >> >>> (My situation is when I create a node I didn't have enough information for >>> this node but after that I look up from other thing so I have more >>> information for this node) >>> - in the example: >>> docs.neo4j.org/chunked/stable/batchinsert-examples.html >>> " >>> Map<String, Object> properties = new HashMap<>(); >>> properties.put( "name", "Mattias" ); >>> long mattiasNode = inserter.createNode( properties, personLabel ); >>> properties.put( "name", "Chris" ); >>> long chrisNode = inserter.createNode( properties, personLabel ); >>> " >>> I test this example and it is ok but I don't understand why you don't need >>> create new instance of Properties, and inserter put only the last value? >>> Could I do this for big hashmap? >> >> Does this mean you have many properties per node? Perhaps you should revisit >> your model! >> >> As mentioned before, it only overrides the name entry in the hashmap >> >> >>> >>> Thanks in advance >>> >>> >>> On Thursday, July 31, 2014 4:49:40 PM UTC+2, Michael Hunger wrote: >>>> >>>> Seems that your store is not ok. >>>> >>>> Can you try to run the consistency checker on your store? >>>> >>>> Download Neo4j Enterprise, and see >>>> http://www.markhneedham.com/blog/2014/01/22/neo4j-backup-store-copy-and-consistency-check >>>> >>>> You can run >>>> >>>> java -cp 'lib/*:system/lib/*' org.neo4j.consistency.ConsistencyCheckTool >>>> data/graph.db >>>> >>>> >>>> >>>> On Thu, Jul 31, 2014 at 3:36 PM, Alex winter <[email protected]> wrote: >>>>> Thanks >>>>> But I didn't find data/log or data/graph.db/message.log. >>>>> I only see file message.log in the neo4j database directory. >>>>> When I run create index on command, I found that a new folder is created >>>>> in schema/index/lucene. >>>>> And I found file "failure-message". And that is the content: >>>>> org.neo4j.kernel.impl.nioneo.store.InvalidRecordException: >>>>> PropertyRecord[136728222] not in use >>>>> at >>>>> org.neo4j.kernel.impl.nioneo.store.PropertyStore.getRecord(PropertyStore.java:423) >>>>> at >>>>> org.neo4j.kernel.impl.nioneo.store.PropertyStore.getLightRecord(PropertyStore.java:289) >>>>> at >>>>> org.neo4j.kernel.impl.nioneo.store.PropertyStore.getPropertyRecordChain(PropertyStore.java:728) >>>>> at >>>>> org.neo4j.kernel.impl.nioneo.xa.NeoStoreIndexStoreView$PropertyBlockIterator.<init>(NeoStoreIndexStoreView.java:286) >>>>> at >>>>> org.neo4j.kernel.impl.nioneo.xa.NeoStoreIndexStoreView$3.iterator(NeoStoreIndexStoreView.java:221) >>>>> at >>>>> org.neo4j.kernel.impl.nioneo.xa.NeoStoreIndexStoreView$1.read(NeoStoreIndexStoreView.java:89) >>>>> at >>>>> org.neo4j.kernel.impl.nioneo.xa.NeoStoreIndexStoreView$1.read(NeoStoreIndexStoreView.java:80) >>>>> at >>>>> org.neo4j.kernel.impl.nioneo.xa.NeoStoreIndexStoreView$NodeStoreScan.run(NeoStoreIndexStoreView.java:330) >>>>> at >>>>> org.neo4j.kernel.impl.api.index.IndexPopulationJob.indexAllNodes(IndexPopulationJob.java:212) >>>>> at >>>>> org.neo4j.kernel.impl.api.index.IndexPopulationJob.run(IndexPopulationJob.java:107) >>>>> at java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) >>>>> at java.util.concurrent.FutureTask$Sync.innerRun(Unknown Source) >>>>> at java.util.concurrent.FutureTask.run(Unknown Source) >>>>> at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) >>>>> at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) >>>>> at java.lang.Thread.run(Unknown Source) >>>>> Nul Nul.................. >>>>> >>>>> Do you know why I can't create index from this log file? >>>>> Thanks >>>>> >>>>> >>>>> On Wednesday, July 30, 2014 4:27:18 AM UTC+2, Michael Hunger wrote: >>>>>> Legacy indexes can be listed in the neo4j-shell or in the >>>>>> localhost:7474/webadmin console with index --list (see help index) >>>>>> Schema indexes with :schema in the browser or "schema" in the shell >>>>>> >>>>>> Logs are in data/log/* or data/graph.db/messages.log >>>>>> >>>>>> >>>>>> On Tue, Jul 29, 2014 at 8:26 AM, Alex winter <[email protected]> wrote: >>>>>>> >>>>>>> Hi. >>>>>>> I have some problem relates to index: >>>>>>> >>>>>>> - When I use the statement " create index on .. " I got error: " >>>>>>> "Index entered a FAILED state. Please see database logs." >>>>>>> So what is a database logs in neo4j database? So I could know why I >>>>>>> can't create index. >>>>>>> >>>>>>> - When I imported data to neo4j, i setup the property: auto >>>>>>> relationship index is true. So I know that it is created or not?The >>>>>>> same question for other legacy index. >>>>>>> >>>>>>> Thanks >>>>>>> >>>>>>> >>>>>>> >>>>>>> -- >>>>>>> You received this message because you are subscribed to the Google >>>>>>> Groups "Neo4j" group. >>>>>>> To unsubscribe from this group and stop receiving emails from it, send >>>>>>> an email to [email protected]. >>>>>>> >>>>>>> For more options, visit https://groups.google.com/d/optout. >>>>> -- >>>>> You received this message because you are subscribed to the Google Groups >>>>> "Neo4j" group. >>>>> To unsubscribe from this group and stop receiving emails from it, send an >>>>> email to [email protected]. >>>>> For more options, visit https://groups.google.com/d/optout. >>> >>> -- >>> You received this message because you are subscribed to the Google Groups >>> "Neo4j" group. >>> To unsubscribe from this group and stop receiving emails from it, send an >>> email to [email protected]. >>> For more options, visit https://groups.google.com/d/optout. > > -- > You received this message because you are subscribed to the Google Groups > "Neo4j" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [email protected]. > For more options, visit https://groups.google.com/d/optout. -- You received this message because you are subscribed to the Google Groups "Neo4j" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. For more options, visit https://groups.google.com/d/optout.
