Hi Michael,
I was using M04. I just tried RC01 as you suggested, it worked.
However, it still does not solve my real problem. (Sorry for asking more,
:-)).
I have 5.3 million records that I need to load into Neo4j (a cluster of 3
in dev and 6 in prod). With one single file, it's too much. So I chunk it
into half-million-record files, 11 files.
Cluster node has 24G memory.
With or without periodic commit, load csv uses total memory quickly and
breaks down near 7th or 8th files.
If I reboot the cluster after 6th file, the rest works fine. (On startup,
neo4j uses around 3G mem)
At first sight, looks like there is a memory leak?
Also, once it goes back, the db is kind of corrupted - after reboot, if I
do another load csv, the error is:
Unable to begin transaction.
Neo.DatabaseError.Statement.ExecutionFailure
>From the log, it seems that the server thinks the data is out of sync and then
>does a copying from the master.
Any suggestions?
Thanks in advance.
Rick
On Friday, March 20, 2015 at 8:43:19 AM UTC-4, Michael Hunger wrote:
>
> Hey Rick, which version did you use for this?
>
> I think it was fixed after that version you have.
>
> Michael
>
> Am 19.03.2015 um 15:46 schrieb cui r <[email protected] <javascript:>>:
>
> Hi,
>
> I am trying to use USING PERIODIC COMMIT to load a csv with 0.5 million
> rows, but never get it work. The error is:
>
> USING PERIODIC COMMIT 1000 load csv with headers from "
> file:///.../data.csv" as csvline
> merge (h:Holding{holdingId:csvline.holdingId}) set ...
>
> The statement has been closed.
>
> Neo.DatabaseError.Statement.ExecutionFailure
>
>
> I couldn't find any error in the logs (message.log, std err/out, or http). I
> do see this statement in the http log with return code 200.
>
>
> Without using periodic commit, it takes about 50 seconds to load the file.
> With the periodic commit, the error returns within 10 seconds.
>
>
> Thanks.
>
> Rick
>
>
> --
> You received this message because you are subscribed to the Google Groups
> "Neo4j" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to [email protected] <javascript:>.
> For more options, visit https://groups.google.com/d/optout.
>
>
>
--
You received this message because you are subscribed to the Google Groups
"Neo4j" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to [email protected].
For more options, visit https://groups.google.com/d/optout.
