Just send it to the master or single machine only Don't send writes to slaves
Von meinem iPhone gesendet > Am 23.03.2015 um 20:45 schrieb cui r <[email protected]>: > > Hi Michael, > > I was using M04. I just tried RC01 as you suggested, it worked. > > However, it still does not solve my real problem. (Sorry for asking more, > :-)). > > I have 5.3 million records that I need to load into Neo4j (a cluster of 3 in > dev and 6 in prod). With one single file, it's too much. So I chunk it into > half-million-record files, 11 files. > > Cluster node has 24G memory. > > With or without periodic commit, load csv uses total memory quickly and > breaks down near 7th or 8th files. > > > If I reboot the cluster after 6th file, the rest works fine. (On startup, > neo4j uses around 3G mem) > > At first sight, looks like there is a memory leak? > > Also, once it goes back, the db is kind of corrupted - after reboot, if I do > another load csv, the error is: > > Unable to begin transaction. > Neo.DatabaseError.Statement.ExecutionFailure > > From the log, it seems that the server thinks the data is out of sync and > then does a copying from the master. > > Any suggestions? > > Thanks in advance. > Rick > > >> On Friday, March 20, 2015 at 8:43:19 AM UTC-4, Michael Hunger wrote: >> Hey Rick, which version did you use for this? >> >> I think it was fixed after that version you have. >> >> Michael >> >>> Am 19.03.2015 um 15:46 schrieb cui r <[email protected]>: >>> >>> Hi, >>> >>> I am trying to use USING PERIODIC COMMIT to load a csv with 0.5 million >>> rows, but never get it work. The error is: >>> >>> USING PERIODIC COMMIT 1000 load csv with headers from >>> "file:///.../data.csv" as csvline >>> merge (h:Holding{holdingId:csvline.holdingId}) set ... >>> >>> The statement has been closed. >>> Neo.DatabaseError.Statement.ExecutionFailure >>> >>> I couldn't find any error in the logs (message.log, std err/out, or http). >>> I do see this statement in the http log with return code 200. >>> >>> Without using periodic commit, it takes about 50 seconds to load the file. >>> With the periodic commit, the error returns within 10 seconds. >>> >>> Thanks. >>> Rick >>> >>> -- >>> You received this message because you are subscribed to the Google Groups >>> "Neo4j" group. >>> To unsubscribe from this group and stop receiving emails from it, send an >>> email to [email protected]. >>> For more options, visit https://groups.google.com/d/optout. > > -- > You received this message because you are subscribed to the Google Groups > "Neo4j" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [email protected]. > For more options, visit https://groups.google.com/d/optout. -- You received this message because you are subscribed to the Google Groups "Neo4j" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. For more options, visit https://groups.google.com/d/optout.
