There are no timeouts in the batch inserter And after you shut down you have to create a new instance of the batch-inserter
Sent from mobile device Am 15.08.2014 um 22:40 schrieb Alex winter <[email protected]>: > > > On Saturday, August 2, 2014 9:07:33 AM UTC+2, Michael Hunger wrote: >> >> >> >> Sent from mobile device >> >> Am 02.08.2014 um 08:53 schrieb Alex winter <[email protected]>: >> >>> Thanks. >>> I found that: >>> - there is timeout for batch inserter( but i didn't find any information >>> about how to set time out for this) >> >> There is no timeout >> >>> - another problem is because my data is quite big and the storage is not >>> enough for batch inserter use to insert. >> >> How big? You can do hundreds of millions of inserts > It is only near 100 millions of nodes. But I found that if I didn't create > new batch insert, it has error: batch inserter is closed. So I think it is > because of time out. >>> >>> Anyway, I have questions: >>> - As I found on Internet, we can't update data with batchinserter? Is this >>> right? >> >> No batch inserter has api for updates >> >>> (My situation is when I create a node I didn't have enough information for >>> this node but after that I look up from other thing so I have more >>> information for this node) >>> - in the example: >>> docs.neo4j.org/chunked/stable/batchinsert-examples.html >>> " >>> Map<String, Object> properties = new HashMap<>(); >>> properties.put( "name", "Mattias" ); >>> long mattiasNode = inserter.createNode( properties, personLabel ); >>> properties.put( "name", "Chris" ); >>> long chrisNode = inserter.createNode( properties, personLabel ); >>> " >>> I test this example and it is ok but I don't understand why you don't need >>> create new instance of Properties, and inserter put only the last value? >>> Could I do this for big hashmap? >> >> It overrides the name value and reuses the map >>> >>> Thanks in advance >>> >>> >>> On Thursday, July 31, 2014 4:49:40 PM UTC+2, Michael Hunger wrote: >>>> >>>> Seems that your store is not ok. >>>> >>>> Can you try to run the consistency checker on your store? >>>> >>>> Download Neo4j Enterprise, and see >>>> http://www.markhneedham.com/blog/2014/01/22/neo4j-backup-store-copy-and-consistency-check >>>> >>>> You can run >>>> >>>> java -cp 'lib/*:system/lib/*' org.neo4j.consistency.ConsistencyCheckTool >>>> data/graph.db >>>> >>>> >>>> >>>> On Thu, Jul 31, 2014 at 3:36 PM, Alex winter <[email protected]> wrote: >>>>> Thanks >>>>> But I didn't find data/log or data/graph.db/message.log. >>>>> I only see file message.log in the neo4j database directory. >>>>> When I run create index on command, I found that a new folder is created >>>>> in schema/index/lucene. >>>>> And I found file "failure-message". And that is the content: >>>>> org.neo4j.kernel.impl.nioneo.store.InvalidRecordException: >>>>> PropertyRecord[136728222] not in use >>>>> at >>>>> org.neo4j.kernel.impl.nioneo.store.PropertyStore.getRecord(PropertyStore.java:423) >>>>> at >>>>> org.neo4j.kernel.impl.nioneo.store.PropertyStore.getLightRecord(PropertyStore.java:289) >>>>> at >>>>> org.neo4j.kernel.impl.nioneo.store.PropertyStore.getPropertyRecordChain(PropertyStore.java:728) >>>>> at >>>>> org.neo4j.kernel.impl.nioneo.xa.NeoStoreIndexStoreView$PropertyBlockIterator.<init>(NeoStoreIndexStoreView.java:286) >>>>> at >>>>> org.neo4j.kernel.impl.nioneo.xa.NeoStoreIndexStoreView$3.iterator(NeoStoreIndexStoreView.java:221) >>>>> at >>>>> org.neo4j.kernel.impl.nioneo.xa.NeoStoreIndexStoreView$1.read(NeoStoreIndexStoreView.java:89) >>>>> at >>>>> org.neo4j.kernel.impl.nioneo.xa.NeoStoreIndexStoreView$1.read(NeoStoreIndexStoreView.java:80) >>>>> at >>>>> org.neo4j.kernel.impl.nioneo.xa.NeoStoreIndexStoreView$NodeStoreScan.run(NeoStoreIndexStoreView.java:330) >>>>> at >>>>> org.neo4j.kernel.impl.api.index.IndexPopulationJob.indexAllNodes(IndexPopulationJob.java:212) >>>>> at >>>>> org.neo4j.kernel.impl.api.index.IndexPopulationJob.run(IndexPopulationJob.java:107) >>>>> at java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) >>>>> at java.util.concurrent.FutureTask$Sync.innerRun(Unknown Source) >>>>> at java.util.concurrent.FutureTask.run(Unknown Source) >>>>> at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) >>>>> at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) >>>>> at java.lang.Thread.run(Unknown Source) >>>>> Nul Nul.................. >>>>> >>>>> Do you know why I can't create index from this log file? >>>>> Thanks >>>>> >>>>> >>>>> On Wednesday, July 30, 2014 4:27:18 AM UTC+2, Michael Hunger wrote: >>>>>> Legacy indexes can be listed in the neo4j-shell or in the >>>>>> localhost:7474/webadmin console with index --list (see help index) >>>>>> Schema indexes with :schema in the browser or "schema" in the shell >>>>>> >>>>>> Logs are in data/log/* or data/graph.db/messages.log >>>>>> >>>>>> >>>>>> On Tue, Jul 29, 2014 at 8:26 AM, Alex winter <[email protected]> wrote: >>>>>>> >>>>>>> Hi. >>>>>>> I have some problem relates to index: >>>>>>> >>>>>>> - When I use the statement " create index on .. " I got error: " >>>>>>> "Index entered a FAILED state. Please see database logs." >>>>>>> So what is a database logs in neo4j database? So I could know why I >>>>>>> can't create index. >>>>>>> >>>>>>> - When I imported data to neo4j, i setup the property: auto >>>>>>> relationship index is true. So I know that it is created or not?The >>>>>>> same question for other legacy index. >>>>>>> >>>>>>> Thanks >>>>>>> >>>>>>> >>>>>>> >>>>>>> -- >>>>>>> You received this message because you are subscribed to the Google >>>>>>> Groups "Neo4j" group. >>>>>>> To unsubscribe from this group and stop receiving emails from it, send >>>>>>> an email to [email protected]. >>>>>>> >>>>>>> For more options, visit https://groups.google.com/d/optout. >>>>> -- >>>>> You received this message because you are subscribed to the Google Groups >>>>> "Neo4j" group. >>>>> To unsubscribe from this group and stop receiving emails from it, send an >>>>> email to [email protected]. >>>>> For more options, visit https://groups.google.com/d/optout. >>> >>> -- >>> You received this message because you are subscribed to the Google Groups >>> "Neo4j" group. >>> To unsubscribe from this group and stop receiving emails from it, send an >>> email to [email protected]. >>> For more options, visit https://groups.google.com/d/optout. > > -- > You received this message because you are subscribed to the Google Groups > "Neo4j" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [email protected]. > For more options, visit https://groups.google.com/d/optout. -- You received this message because you are subscribed to the Google Groups "Neo4j" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. For more options, visit https://groups.google.com/d/optout.
