On Wed, Sep 24, 2014 at 2:33 PM, 'Curtis Mosters' via Neo4j <
neo4j@googlegroups.com> wrote:
> Well I downloaded the 2.1.4 and used the standard configs.
>
> The only things I edited were:
>
> - # Enable auto-indexing for nodes, default is false
> node_auto_indexing=true
> - # The node property keys to be auto-indexed, if enabled
> node_keys_indexable=ID,title
>
>
why? you don't need that. Just create the normal schema index:
create index on :Appln(:ID)
create index on :Title(title)
>
> -
>
> I did not touch anything else.
>
> And another big problem is: after this Heap Stack Error thing, I'm not
> able to open the Shell. I always get:
> ERROR (-v for expanded information):
> Connection refused
>
> I need to restart the server several times to get in again. Really strange
> things happening after that error.
>
> This is from the opening of the Shell.bat then:
> 2014-09-24 12:31:42.067+0000 INFO [API] Setting startup timeout to:
> 120000ms ba
> sed on -1
>
> C:\neo4j-2.1.4\mapegy-scripts>
>
> I'm available now in Skype. Hope to hear from you.
>
> Am Mittwoch, 24. September 2014 11:29:02 UTC+2 schrieb Michael Hunger:
>>
>> Try "schema"
>>
>> Von meinem iPhone gesendet
>>
>> Am 23.09.2014 um 09:25 schrieb 'Curtis Mosters' via Neo4j <
>> ne...@googlegroups.com>:
>>
>> I think I have the reason.
>>
>> Somehow my Neo4j does not want to index anything anymore. Look this:
>>
>> Define Index...
>> +--------------------------------------------+
>> | No data returned, and nothing was changed. |
>> +--------------------------------------------+
>> 1341 ms
>> +--------------------------------------------+
>> | No data returned, and nothing was changed. |
>> +--------------------------------------------+
>> 0 ms
>> +--------------------------------------------+
>> | No data returned, and nothing was changed. |
>> +--------------------------------------------+
>> 15 ms
>> +--------------------------------------------+
>> | No data returned, and nothing was changed. |
>> +--------------------------------------------+
>> 0 ms
>> Press any key to continue . . .
>>
>>
>>
>> After the try to add 4 indexes. Very strange. I can remember that it
>> worked for me in 2.1.3.
>>
>> And before you ask. I did not change anything in the config. It's a fresh
>> 2.1.4 that you gave me here. Database created when server started. So yeah
>> that should be the reason for my issues.
>> But the strange thing is, even with LIMIT 1 he never finishes. I think I
>> have some real trouble.
>>
>> When will you be available today?
>>
>> If you want to add me on skype it is "kwoxer" (gelbe Glühbirne)
>>
>> Bd
>>
>> Am Montag, 22. September 2014 15:56:30 UTC+2 schrieb Curtis Mosters:
>>
>> Alright I splitted it now as I said.
>>
>> The first part of simply inserting the Titles is like the Appln's I
>> already have in there.
>>
>> So with
>>
>> USING PERIODIC COMMIT 4000
>> LOAD CSV WITH HEADERS FROM "file:///C:/data/tls202_part01.txt" AS
>> csvLine WITH csvLine LIMIT 1000
>> MATCH (appln:Appln {ID: csvLine.appln_id})
>> MATCH (title:Title {title: csvLine.appln_title})
>> CREATE (appln)-[:HAS_TITLE]->(title);
>>
>> it's already needing minutes. That's surely buggy. I also checked the
>> indexes:
>>
>> CREATE INDEX ON :Appln(ID);
>> CREATE INDEX ON :Title(title);
>> CREATE INDEX ON :Person(ID);
>>
>> It seems all fine. There must be an issue with the matches.
>>
>> Am Montag, 22. September 2014 14:46:02 UTC+2 schrieb Curtis Mosters:
>>
>> Alright now testing with new version and splitted Title. Thanks.
>>
>> Am Montag, 22. September 2014 12:16:24 UTC+2 schrieb Michael Hunger:
>>
>> *sigh*, this should work: http://neo4j.com/artifact.php?name=neo4j-
>> community-2.1.4-windows.zip
>>
>> On Mon, Sep 22, 2014 at 11:58 AM, 'Curtis Mosters' via Neo4j <
>> ne...@googlegroups.com> wrote:
>>
>> Yeah that site seems new. And there is nowhere the *Older Version* thing.
>>
>> I think the updater just forget that section...
>>
>> Or can you give me the direct download link for the latest binary zip
>> please?
>>
>> Am Montag, 22. September 2014 08:22:36 UTC+2 schrieb Michael Hunger:
>>
>> Can you check neo4j.com/download?
>>
>> Von meinem iPhone gesendet
>>
>> Am 22.09.2014 um 06:48 schrieb 'Curtis Mosters' via Neo4j <
>> ne...@googlegroups.com>:
>>
>> Sure Michael! I'll be available then.
>>
>> Well but there are more things broken. And I still have the 2.1.3 version
>> because I'm not able to download the 2.1.4 via
>> http://www.neo4j.org/download/other_versions
>> I always get the download page but not any download.
>>
>> So could you please fix the download and then I can try the separeted
>> import. Maybe that's it already! Would be great.
>>
>> Am Sonntag, 21. September 2014 21:22:46 UTC+2 schrieb Michael Hunger:
>>
>> Ok, it's the two create statements in a row if you split it up it will
>> not happen:
>>
>> // *!! Eager Loading kills your import, everything is pulled from the
>> file into memory after the first create!*
>>
>> profile
>> LOAD CSV
>> WITH HEADERS FROM "https://gist.githubusercontent.com/jexp/
>> 909e92c65e715ea91062/raw/cbe617cdf551ef51111fff349f1b18
>> 26a7a52d3d/appln.txt" AS csvLine
>> WITH csvLine
>> LIMIT 1
>> MATCH (appln:Appln)
>> WHERE appln.ID = toInt(csvLine.appln_id)
>> CREATE (title:Title { title:csvLine.appln_title })
>> CREATE (appln)-[:HAS_TITLE]->(title);
>>
>> +-------------+------+--------+---------------------+-------
>> ------------------------------------------------+
>> | Operator | Rows | DbHits | Identifiers |
>> Other |
>> +-------------+------+--------+---------------------+-------
>> ------------------------------------------------+
>> | EmptyResult | 0 | 0 | |
>> |
>> | UpdateGraph | 0 | 0 | title, UNNAMED304 |
>> CreateNode; CreateRelationship |
>> *| Eager | 0 | 0 | |
>> |*
>> | SchemaIndex | 0 | 1 | appln, appln |
>> ToIntFunction(Property(csvLine,appln_id)); :Appln(ID) |
>> | Slice | 1 | 0 | |
>> { AUTOINT0} |
>> | LoadCSV | 1 | 0 | csvLine |
>> |
>> +-------------+------+--------+---------------------+-------
>> ------------------------------------------------+
>>
>>
>> *// Do it like this:*
>>
>> CREATE INDEX ON :Appln(ID);
>> CREATE INDEX ON :Title(title);
>>
>> profile
>> LOAD CSV
>> WITH HEADERS FROM "https://gist.githubusercontent.com/jexp/
>> 909e92c65e715ea91062/raw/cbe617cdf551ef51111fff349f1b18
>> 26a7a52d3d/appln.txt" AS csvLine
>> WITH csvLine
>> LIMIT 1
>> CREATE (title:Title { title:csvLine.appln_title });
>>
>> +-------------+------+--------+-------------+--------------+
>> | Operator | Rows | DbHits | Identifiers | Other |
>> +-------------+------+--------+-------------+--------------+
>> | EmptyResult | 0 | 0 | | |
>> | UpdateGraph | 1 | 5 | title | CreateNode |
>> | Slice | 1 | 0 | | { AUTOINT0} |
>> | LoadCSV | 1 | 0 | csvLine | |
>> +-------------+------+--------+-------------+--------------+
>>
>> profile
>> LOAD CSV
>> WITH HEADERS FROM "https://gist.githubusercontent.com/jexp/
>> 909e92c65e715ea91062/raw/cbe617cdf551ef51111fff349f1b18
>> 26a7a52d3d/appln.txt" AS csvLine
>> WITH csvLine
>> LIMIT 1
>> MATCH (appln:Appln {ID: csvLine.appln_id})
>> MATCH (title:Title { title:csvLine.appln_title })
>> CREATE (appln)-[:HAS_TITLE]->(title);
>>
>> +----------------+------+--------+--------------+-----------
>> -----------------------------------+
>> | Operator | Rows | DbHits | Identifiers |
>> Other |
>> +----------------+------+--------+--------------+-----------
>> -----------------------------------+
>> | EmptyResult | 0 | 0 | |
>> |
>> | UpdateGraph | 0 | 0 | UNNAMED285 |
>> CreateRelationship |
>> | SchemaIndex(0) | 0 | 0 | title, title |
>> Property(csvLine,appln_title); :Title(title) |
>> | SchemaIndex(1) | 0 | 1 | appln, appln |
>> Property(csvLine,appln_id); :Appln(ID) |
>> | Slice | 1 | 0 | |
>> { AUTOINT0} |
>> | LoadCSV | 1 | 0 | csvLine |
>> |
>> +----------------+------+--------+--------------+-----------
>> -----------------------------------+
>>
>>
>> On Sun, Sep 21, 2014 at 9:03 PM, Michael Hunger <
>> michael...@neotechnology.com> wrote:
>>
>> Ah, cool, then we can do a call this week, perhaps tomorrow or on Thu.
>>
>> That's really weird. It shouldn't build up memory in 2.1.4 as the team
>> changed the eagerness requirement for queries where we determine
>> independence.
>>
>> Can you do a a limit 10 and prefix your query with profile? There should
>> be no "Eager"-pipe in between the match and merge.
>>
>>
>> On Sun, Sep 21, 2014 at 8:31 PM, 'Curtis Mosters' via Neo4j <
>> ne...@googlegroups.com> wrote:
>>
>> Sure y. And testing with LIMIT 1000000 works and needs 1 min or so.
>>
>> So this is just a Heap Stack thingi.
>>
>> I'm from Germany like you ;)
>>
>> Am Sonntag, 21. September 2014 19:25:15 UTC+2 schrieb Michael Hunger:
>>
>> In what Timezone are you located? Perhaps someone can help you and have a
>> look at your setup? via Skype
>>
>> But you have an index or constraint on the thing you match?
>>
>> CREATE INDEX ON :Appln(ID);
>>
>>
>>
>> On Sun, Sep 21, 2014 at 4:08 PM, 'Curtis Mosters' via Neo4j <
>> ne...@googlegroups.com> wrote:
>>
>> Jup, same issue with
>>
>> *-Xmx512M*So you have any other tips? Observing the IO values, it seems
>> to idle =/
>>
>> Am Samstag, 20. September 2014 12:58:33 UTC+2 schrieb Curtis Mosters:
>>
>> Well I tried it with
>>
>> *-Xms4096m -Xmx15000m*
>>
>> but the import did not finish in now 16 hours.
>>
>> Now I try your
>>
>> *-Xmx512M*
>>
>> Am Freitag, 19. September 2014 16:08:42 UTC+2 schrieb Michael Hunger:
>>
>> If you specifiy it I'd keep it to a few MB (e.g. -Xmx512M) as the shell
>> against a running server is just a terminal.
>> It's different if when you run the shell against a on-disk directory then
>> it fires up the database itself.
>>
>> Your memory config looks ok otherwise, I'd only swap mapped memory
>> settings for nodes (to 50MB) and rels (to 500MB)
>>
>> I think there was one memory issue in 2.1.3 could you try it with 2.1.4 ?
>>
>> Michael
>>
>>
>> On Fri, Sep 19, 2014 at 4:00 PM, 'Curtis Mosters' via Neo4j <
>> ne...@googlegroups.com> wrote:
>>
>> Here is the complete file, well I still don't know which settings are the
>> best in my case.
>>
>> Should I delete the Xmx thing? Is it better to not specify it?
>>
>> Am Donnerstag, 18. September 2014 23:14:09 UTC+2 schrieb Michael Hunger:
>>
>> If you connect to the server it uses the servers RAM
>> The shell then needs much less like 512m
>>
>> Can you check the server's graph.db/messages.log for the root cause error?
>>
>> Which version?
>>
>> Sent from mobile device
>>
>> Am 18.09.2014 um 14:28 schrieb "'Curtis Mosters' via Neo4j" <
>> ne...@googlegroups.com>:
>>
>> Well I was thinking that the Xmx is the heap and it should be not above 4
>> GB, so far I have learned.
>>
>> I currently let the import run with "COMMIT 100" so every 100 lines, and
>> it's still running.
>>
>> But looking on the IO it seems to idle...
>>
>> I don't know, but could you tell me exactly where to set which setting?
>>
>> As I said I have 30 GB RAM. To avoid more complications let's maybe set
>> the Heap 4 GB and the maximum RAM to 20 GB.
>>
>> And again I use the Neo4jShell for the import. It's loading a file
>> containing LOAD CSV.
>>
>> Thanks.
>>
>> Am Donnerstag, 18. September 2014 13:42:34 UTC+2 schrieb Clark Richey:
>>
>> According to the screenshot you don't give it 30G of ram. You only
>> provide 3G. Is that your intent?
>>
>> Sent from my iPhone
>>
>> On Sep 18, 2014, at 02:51, 'Curtis Mosters' via Neo4j <
>> ne...@googlegroups.com> wrote:
>>
>> Well somehow the behaviour of the Shell is odd.
>>
>> I imported 76 Mio lines without any problems. But now I have started a
>> new import over night and now I watched the process and it said Java Heap
>> Space Error.
>>
>> But that cannot be. I have set the Neo4jShell.bat like this:
>>
>> %JAVACMD% -Xmx3G *-Dstorage.diskCache.bufferSize=20000* %JAVA_OPTS% %
>> EXTRA_JVM_ARGUMENTS% -classpath %CLASSPATH_PREFIX%;%CLASSPATH% -Dapp.name
>> ="neo4j-shell" -Dapp.repo="%REPO%" -Dbasedir="%BASEDIR%" org.neo4j.shell.
>> StartClient %CMD_LINE_ARGS%
>>
>> That is a great ratio of heap. But yeah why did I get this error? I have
>> 30 GB RAM. This happens so random that a productive import is nearly
>> impossible.
>>
>> So my question is, what have I done wrong? Where do I need to set the
>> Java Settings correctly? Were my edited settings active?
>>
>> Here the first file or let's say script i'm loading in and where this
>> error happens:
>>
>> USING PERIODIC COMMIT 2000
>> LOAD CSV WITH HEADERS FROM "file:///C:/data/tls202_part01.txt" AS
>> csvLine WITH csvLine LIMIT 1000
>> MATCH (appln:Appln)
>> WHERE appln.ID = toInt(csvLine.appln_id)
>> CREATE (title:Title { title:csvLine.appln_title })
>> CREATE (appln)-[:HAS_TITLE]->(title);
>>
>>
>> --
>> You received this message because you are subscribed to the Google Groups
>> "Neo4j" group.
>> To unsubscribe from this group and stop receiving emails from it, send an
>> email to neo4j+un...@googlegroups.com.
>> For more options, visit https://groups.google.com/d/optout.
>>
>> --
>> You received this message because you are subscribed to the Google Groups
>> "Neo4j" group.
>> To unsubscribe from this group and stop receiving emails from it, send an
>> email to neo4j+un...@googlegroups.com.
>> For more options, visit https://groups.google.com/d/optout.
>>
>> --
>> You received this message because you are subscribed to the Google Groups
>> "Neo4j" group.
>> To unsubscribe from this group and stop receiving emails from it, send an
>> email to neo4j+un...@googlegroups.com.
>> For more options, visit https://groups.google.com/d/optout.
>>
>>
>> --
>> You received this message because you are subscribed to the Google Groups
>> "Neo4j" group.
>> To unsubscribe from this group and stop receiving emails from it, send an
>> email to neo4j+un...@googlegroups.com.
>> For more options, visit https://groups.google.com/d/optout.
>>
>>
>> --
>> You received this message because you are subscribed to the Google Groups
>> "Neo4j" group.
>> To unsubscribe from this group and stop receiving emails from it, send an
>> email to neo4j+un...@googlegroups.com.
>> For more options, visit https://groups.google.com/d/optout.
>>
>>
>>
>> --
>> You received this message because you are subscribed to the Google Groups
>> "Neo4j" group.
>> To unsubscribe from this group and stop receiving emails from it, send an
>> email to neo4j+un...@googlegroups.com.
>> For more options, visit <a href="https://groups.google
>>
>> ...
>
> --
> You received this message because you are subscribed to the Google Groups
> "Neo4j" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to neo4j+unsubscr...@googlegroups.com.
> For more options, visit https://groups.google.com/d/optout.
>
--
You received this message because you are subscribed to the Google Groups
"Neo4j" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to neo4j+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
