As you see in all lines above there is actually already a comma? What do you mean with comma after CREATE, Michael?
Am Donnerstag, 28. August 2014 16:11:13 UTC+2 schrieb Michael Hunger: > > Nope no semicolon after 10000 > > Only after the create > > Sent from mobile device > > Am 28.08.2014 um 16:01 schrieb "'Curtis Mosters' via Neo4j" < > [email protected] <javascript:>>: > > That was it. Now I have: > > USING PERIODIC COMMIT 10000; > LOAD CSV WITH HEADERS FROM "file:C:/test/tls206_part01.txt" AS csvLine > CREATE (p:Person { person_id: toInt(csvLine.person_id), doc_std_name_id: > csvLine.doc_std_name_id , person_name: csvLine.person_name }); > > Well it seems to do something. My CPU is at 100%. But looking into the > graph folder. There isn't happening anything. > > What's going on? > > Btw here the state: > > neo4j-sh (?)$ USING PERIODIC COMMIT 10000; > SyntaxException: Unexpected end of input: expected an identifier character > , whit > espace or LoadCSVQuery (line 1, column 28) > "USING PERIODIC COMMIT 10000" > ^ > neo4j-sh (?)$ LOAD CSV WITH HEADERS FROM "file:C:/test/tls206_part01.txt" > AS csv > Line > > CREATE (p:Person { person_id: toInt(csvLine.person_id), doc_std_name_id: > csvLi > ne.doc_std_name_id , person_name: csvLine.person_name }); > > > > Am Donnerstag, 28. August 2014 15:37:44 UTC+2 schrieb Rik Van Bruggen: >> >> Did you forget a semi-colon at the end? >> >> In the shell all commands need to end with ; ... >> >> Rik >> >> On Thursday, August 28, 2014 2:04:22 PM UTC+1, Curtis Mosters wrote: >>> >>> Well it works under Browser Cypher. So it should be fin. But I changed >>> it: >>> >>> USING PERIODIC COMMIT 10000 >>> LOAD CSV WITH HEADERS FROM "file:///C:/test/tls206_part01.txt" AS >>> csvLine >>> CREATE (p:Person { person_id: toInt(csvLine.person_id), doc_std_name_id: >>> csvLine.doc_std_name_id , person_name: csvLine.person_name }) >>> >>> >>> >>> And still nothing happening. Another idea? >>> >>> Am Donnerstag, 28. August 2014 14:37:15 UTC+2 schrieb Aru Sahni: >>>> >>>> Your file URI seems to be malformed. Here's the correct syntax for >>>> Windows: >>>> http://blogs.msdn.com/b/ie/archive/2006/12/06/file-uris-in-windows.aspx >>>> >>>> ~A >>>> >>>> >>>> On Thu, Aug 28, 2014 at 8:34 AM, 'Curtis Mosters' via Neo4j < >>>> [email protected]> wrote: >>>> >>>>> Well I will definitily test this. But I don't know how to start this >>>>> command with the shell: >>>>> >>>>> http://i.imgur.com/uiYbq0O.png >>>>> >>>>> Any tips for windows user? Nothing happening. >>>>> >>>>> Am Donnerstag, 28. August 2014 11:39:59 UTC+2 schrieb Michael Hunger: >>>>>> >>>>>> Hi Curtis, >>>>>> >>>>>> if you do this: >>>>>> >>>>>> USING PERIODIC COMMIT 10000 >>>>>> LOAD CSV WITH HEADERS FROM "file:C:/test.txt" AS csvLine >>>>>> CREATE (:Person { person_id: toInt(csvLine.person_id), name: >>>>>> csvLine.name }); >>>>>> >>>>>> It should do between 10k-30k nodes per second. >>>>>> It will be slower if you have a unique constraint in place. >>>>>> >>>>>> Please run it in the Neo4j-Shell, it is much easier to handle there. >>>>>> >>>>>> As you are running on windows, with 4GB in total, please also make >>>>>> sure that your mmio config in neo4j.properties is not too large. >>>>>> >>>>>> Perhaps 100MB for nodes and 500MB for rels and another 250MB for >>>>>> properties. >>>>>> >>>>>> On windows the memory mapping memory is taken from the heap. >>>>>> >>>>>> You should see some info about that in in your graph.db/messages.log >>>>>> files after the startup, feel free to share that file with us then we >>>>>> can >>>>>> help you to set up your config. >>>>>> >>>>>> Michael >>>>>> >>>>>> Am 28.08.2014 um 11:11 schrieb 'Curtis Mosters' via Neo4j < >>>>>> [email protected]>: >>>>>> >>>>>> Yesterday evening I was running it 52 minutes. And then I got an >>>>>> "Unknown Error". >>>>>> >>>>>> So now I tested it now with the "USING PERIODIC COMMIT 10000" and >>>>>> now its about 60 minutes. Then the same error. >>>>>> >>>>>> I now looked into the graph.db folder and its overall 1,75 GB big. >>>>>> The propertystore file ist 370 mb e.g. >>>>>> >>>>>> So what else can I do do get it running in the browser? Or could I >>>>>> run this task in the Neo4jShell? >>>>>> >>>>>> Am Donnerstag, 28. August 2014 00:16:07 UTC+2 schrieb Chris Vest: >>>>>>> >>>>>>> All transaction state is currently kept in memory on the java heap, >>>>>>> and 20+ mio. changes is too much to fit in a 4 GB heap. >>>>>>> When you have too much stuff on the heap, it will manifest with >>>>>>> those “GC overhead limit exceeded” and the database will run slow, >>>>>>> though >>>>>>> there are other things that can produce similar symptoms. >>>>>>> >>>>>>> Try putting USING PERIODIC COMMIT 10000 in front of your LOAD CSV >>>>>>> query. This will periodically commit the transaction, thus limiting the >>>>>>> transaction state kept in memory. Unfortunately it will also break the >>>>>>> atomicity of the transaction. >>>>>>> >>>>>>> -- >>>>>>> Chris Vest >>>>>>> System Engineer, Neo Technology >>>>>>> [ skype: mr.chrisvest, twitter: chvest ] >>>>>>> >>>>>>> >>>>>>> On 27 Aug 2014, at 22:31, 'Curtis Mosters' via Neo4j < >>>>>>> [email protected]> wrote: >>>>>>> >>>>>>> Let's say I have: >>>>>>> >>>>>>> LOAD CSV WITH HEADERS FROM "file:C:/test.txt" AS csvLine >>>>>>> CREATE (p:Person { person_id: toInt(csvLine.person_id), name: >>>>>>> csvLine.name }) >>>>>>> >>>>>>> I run this query in the browser. I know that it's not the fastest >>>>>>> way and I should think about using the batch importer. But I really >>>>>>> like >>>>>>> that way somehow and want to speed it up. >>>>>>> >>>>>>> So when I ran this the first time, after like 2 or 3 minutes I got >>>>>>> an erro saying "GC overhead limit exceeded". So It set >>>>>>> >>>>>>> wrapper.java.initmemory=4096 >>>>>>> wrapper.java.maxmemory=4096 >>>>>>> >>>>>>> Now the error does not come up. But it's still slow and I can't see >>>>>>> how much time is still needed. So if you have tips on doing this, I >>>>>>> would >>>>>>> be very thankful. =) >>>>>>> >>>>>>> PS: the file is 2 gb big and has like 20 mio entries >>>>>>> >>>>>>> -- >>>>>>> You received this message because you are subscribed to the Google >>>>>>> Groups "Neo4j" group. >>>>>>> To unsubscribe from this group and stop receiving emails from it, >>>>>>> send an email to [email protected]. >>>>>>> For more options, visit https://groups.google.com/d/optout. >>>>>>> >>>>>>> >>>>>>> >>>>>> -- >>>>>> You received this message because you are subscribed to the Google >>>>>> Groups "Neo4j" group. >>>>>> To unsubscribe from this group and stop receiving emails from it, >>>>>> send an email to [email protected]. >>>>>> For more options, visit https://groups.google.com/d/optout. >>>>>> >>>>>> >>>>>> -- >>>>> You received this message because you are subscribed to the Google >>>>> Groups "Neo4j" group. >>>>> To unsubscribe from this group and stop receiving emails from it, send >>>>> an email to [email protected]. >>>>> For more options, visit https://groups.google.com/d/optout. >>>>> >>>> >>>> -- > You received this message because you are subscribed to the Google Groups > "Neo4j" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [email protected] <javascript:>. > For more options, visit https://groups.google.com/d/optout. > > -- You received this message because you are subscribed to the Google Groups "Neo4j" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. For more options, visit https://groups.google.com/d/optout.
