Re: [Neo4j] Can I keep files as a Property?
You could store the file contents as byte array or something. While there's no limitation on size I'd say that neo4j isn't optimized for those kinds of data and you would get bad performance. Also doing that over REST doesn't sound great. What's your use case? 2011/11/10 musa musa.basb...@gmail.com Hi Can I keep a file as a property in my graph? If so , 1.Is there a limitation on file size? 2.How can I implement it using REST technology? muhamad. -- View this message in context: http://neo4j-community-discussions.438527.n3.nabble.com/Can-I-keep-files-as-a-Property-tp3495949p3495949.html Sent from the Neo4j Community Discussions mailing list archive at Nabble.com. ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user -- Mattias Persson, [matt...@neotechnology.com] Hacker, Neo Technology www.neotechnology.com ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user
Re: [Neo4j] Can't install server as a service on Amazon EC2 Linux
The linux service scripts aren't great in supporting multiple distros. I hope support for amazon/redhat/centos will be available in 1.6.M01 or similar. 2011/11/10 Aseem Kishore aseem.kish...@gmail.com Sorry, should have mentioned that I made sure to do sudo, and sudo works for other commands just fine. Aseem On Wed, Nov 9, 2011 at 11:06 PM, Aseem Kishore aseem.kish...@gmail.com wrote: I'm new to Amazon EC2. I launched a new Amazon Linux (the basic, default image) instance, installed Neo4j on it, and tried to follow the instructions here: http://docs.neo4j.org/chunked/stable/server-installation.html#_linux_service Unfortunately, running `neo4j install` (as well as `neo4j remove`, and regardless of which user I specify or whether that user already exists or not) always results in this error: *update-rc.d: Command not found.* I'm looking into some ways to run startup scripts on EC2, but I'm not sure what the pros/cons are to starting Neo4j manually via a script vs. as a formal service. But just FYI -- can't install Neo4j as a service following the official instructions on EC2 Amazon Linux. Help appreciated. Thanks! Aseem ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user -- Mattias Persson, [matt...@neotechnology.com] Hacker, Neo Technology www.neotechnology.com ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user
Re: [Neo4j] id problem on createNode
Wow, never seen this before, do you have a full testcase to reproduce this? Cheers, /peter neubauer GTalk: neubauer.peter Skype peter.neubauer Phone +46 704 106975 LinkedIn http://www.linkedin.com/in/neubauer Twitter http://twitter.com/peterneubauer http://www.neo4j.org - NOSQL for the Enterprise. http://startupbootcamp.org/ - Öresund - Innovation happens HERE. On Thu, Nov 10, 2011 at 9:18 AM, itoskov itos...@gmail.com wrote: I have this snippet of code while using neo4j embedded 1.4.2: Node newlyCreatedNode = db.createNode(); log.debug(NEWLY GENERATED NODE : + newlyCreatedNode.getId()); Node newlyCreatedNode1 = db.createNode(); log.debug(NEWLY GENERATED NODE 1: + newlyCreatedNode1.getId()); In most cases, this returns two different ids, but my problem is that I'm getting two same id values in two consecutive calls. For example: 2011-11-09 19:15:07,236 DEBUG - NEWLY GENERATED NODE : 122766 2011-11-09 19:15:07,236 DEBUG - NEWLY GENERATED NODE 1: 122766 Can you tell me reason for this, or how to prevent this from happening -- View this message in context: http://neo4j-community-discussions.438527.n3.nabble.com/id-problem-on-createNode-tp3496067p3496067.html Sent from the Neo4j Community Discussions mailing list archive at Nabble.com. ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user
Re: [Neo4j] Sampling a Neo4j instance?
Answers inline. 2011/11/9 Anders Lindström andli...@hotmail.com: Thanks to the both of you. I am very grateful that you took your time to put this into code -- how's that for community! I presume this way of getting 'highId' is constant in time? It looks rather messy though -- is it really the most straightforward way to do it? This is the safest way to do it, that takes into consideration crashes and HA cluster membership. Another way to do it is long highId = db.getConfig().getIdGeneratorFactory().get( IdType.NODE ).getHighId(); which can return the same value with the first, if some conditions are met. It is shorter and cast-free but i'd still use the first way. getHighId() is a constant time operation for both ways described - it is just a field access, with an additional long comparison for the first case. I am thinking about how efficient this will be. As I understand it, the sampling misses come from deleted nodes that once was there. But if I remember correctly, Neo4j tries to reuse these unused node indices when new nodes are added. But is an unused node index _guaranteed_ to be used given that there is one, or could inserting another node result in increasing 'highId' even though some indices below it are not used? During the lifetime of a Neo4j instance there is no id reuse for Nodes and Relationships - deleted ids are saved however and will be reused the next time Neo4j starts. This means that if during run A you deleted nodes 3 and 5, the first two nodes returned by createNode() on the next run will have ids 3 and 5 - so highId will not change. Additionally, during run A, after deleting nodes 3 and 5, no new nodes would have the id 3 or 5. A crash (or improper shutdown) of the database will break this however, since the ids-to-recycle will probably not make it to disk. So, in short, it is guaranteed that ids *won't* be reused in the same run but not guaranteed to be reused between runs. My conclusion is that the sampling misses will increase with index usage sparseness and that we will have a high rate of sampling misses when we had many deletes and few insertions recently. Would you agree? Yes, that is true, especially given the cost of the wasted I/O and of handling the exception. However, this cost can go down significantly if you keep a hash set for the ids of nodes you have deleted and check that before asking for the node by id, instead of catching an exception. Persisting that between runs would move you away from encapsulated Neo4j constructs and would also be more efficient. Thanks again. Regards,Anders Date: Wed, 9 Nov 2011 19:30:36 +0200 From: chris.gio...@neotechnology.com To: user@lists.neo4j.org Subject: Re: [Neo4j] Sampling a Neo4j instance? Hi, Backing Jim's algorithm with some code: public static void main( String[] args ) { long SAMPLE_SIZE = 1; EmbeddedGraphDatabase db = new EmbeddedGraphDatabase( path/to/db/ ); // Determine the highest possible id for the node store long highId = ( (NeoStoreXaDataSource) db.getConfig().getTxModule().getXaDataSourceManager().getXaDataSource( Config.DEFAULT_DATA_SOURCE_NAME ) ).getNeoStore().getNodeStore().getHighId(); System.out.println( highId + is the highest id ); long i = 0; long nextId; // Do the sampling Random random = new Random(); while ( i SAMPLE_SIZE ) { nextId = Math.abs( random.nextLong() ) % highId; try { db.getNodeById( nextId ); i++; System.out.println( id + nextId + is there ); } catch ( NotFoundException e ) { // NotFoundException is thrown when the node asked is not in use System.out.println( id + nextId + not in use ); } } db.shutdown(); } Like already mentioned, this will be slow. Random jumps around the graph are not something caches can keep up with - unless your whole db fits in memory. But accessing random pieces of an on-disk file cannot be done much faster. cheers, CG On Wed, Nov 9, 2011 at 6:08 PM, Jim Webber j...@neotechnology.com wrote: Hi Anders, When you do getAllNodes, you're getting back an iterable so as you point out the sample isn't random (unless it was written randomly to disk). If you're prepared to take a scattergun approach and tolerate being disk-bound, then you can ask for getNodeById using a made-up ID and deal with the times when your ID's don't resolve. It'll be slow (since the chances of having the nodes in cache are low) but as random as your random ID generator. Jim ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user ___
Re: [Neo4j] Sampling a Neo4j instance?
Probably using an index for your nodes (could be an auto-index). And then using an random shuffling of the results? You can pass in a lucene query object or query string to index.query(queryOrQueryObject). Sth like this http://stackoverflow.com/questions/7201638/lucene-2-9-2-how-to-show-results-in-random-order perhaps there is also some string based lucene query/sort syntax for it. Michael Am 10.11.2011 um 11:01 schrieb Chris Gioran: Answers inline. 2011/11/9 Anders Lindström andli...@hotmail.com: Thanks to the both of you. I am very grateful that you took your time to put this into code -- how's that for community! I presume this way of getting 'highId' is constant in time? It looks rather messy though -- is it really the most straightforward way to do it? This is the safest way to do it, that takes into consideration crashes and HA cluster membership. Another way to do it is long highId = db.getConfig().getIdGeneratorFactory().get( IdType.NODE ).getHighId(); which can return the same value with the first, if some conditions are met. It is shorter and cast-free but i'd still use the first way. getHighId() is a constant time operation for both ways described - it is just a field access, with an additional long comparison for the first case. I am thinking about how efficient this will be. As I understand it, the sampling misses come from deleted nodes that once was there. But if I remember correctly, Neo4j tries to reuse these unused node indices when new nodes are added. But is an unused node index _guaranteed_ to be used given that there is one, or could inserting another node result in increasing 'highId' even though some indices below it are not used? During the lifetime of a Neo4j instance there is no id reuse for Nodes and Relationships - deleted ids are saved however and will be reused the next time Neo4j starts. This means that if during run A you deleted nodes 3 and 5, the first two nodes returned by createNode() on the next run will have ids 3 and 5 - so highId will not change. Additionally, during run A, after deleting nodes 3 and 5, no new nodes would have the id 3 or 5. A crash (or improper shutdown) of the database will break this however, since the ids-to-recycle will probably not make it to disk. So, in short, it is guaranteed that ids *won't* be reused in the same run but not guaranteed to be reused between runs. My conclusion is that the sampling misses will increase with index usage sparseness and that we will have a high rate of sampling misses when we had many deletes and few insertions recently. Would you agree? Yes, that is true, especially given the cost of the wasted I/O and of handling the exception. However, this cost can go down significantly if you keep a hash set for the ids of nodes you have deleted and check that before asking for the node by id, instead of catching an exception. Persisting that between runs would move you away from encapsulated Neo4j constructs and would also be more efficient. Thanks again. Regards,Anders Date: Wed, 9 Nov 2011 19:30:36 +0200 From: chris.gio...@neotechnology.com To: user@lists.neo4j.org Subject: Re: [Neo4j] Sampling a Neo4j instance? Hi, Backing Jim's algorithm with some code: public static void main( String[] args ) { long SAMPLE_SIZE = 1; EmbeddedGraphDatabase db = new EmbeddedGraphDatabase( path/to/db/ ); // Determine the highest possible id for the node store long highId = ( (NeoStoreXaDataSource) db.getConfig().getTxModule().getXaDataSourceManager().getXaDataSource( Config.DEFAULT_DATA_SOURCE_NAME ) ).getNeoStore().getNodeStore().getHighId(); System.out.println( highId + is the highest id ); long i = 0; long nextId; // Do the sampling Random random = new Random(); while ( i SAMPLE_SIZE ) { nextId = Math.abs( random.nextLong() ) % highId; try { db.getNodeById( nextId ); i++; System.out.println( id + nextId + is there ); } catch ( NotFoundException e ) { // NotFoundException is thrown when the node asked is not in use System.out.println( id + nextId + not in use ); } } db.shutdown(); } Like already mentioned, this will be slow. Random jumps around the graph are not something caches can keep up with - unless your whole db fits in memory. But accessing random pieces of an on-disk file cannot be done much faster. cheers, CG On Wed, Nov 9, 2011 at 6:08 PM, Jim Webber j...@neotechnology.com wrote: Hi Anders, When you do getAllNodes, you're getting back an iterable so as you point out the sample isn't random (unless it was written randomly to disk). If you're prepared to
[Neo4j] Neo4j 1.5 Boden Bord Released!
Hello graphistas! After a successful Milestone 2 release of Neo4j 1.5 Boden Bord and excellent community and customer feedback, we've been busy at work putting the finishing touches to the Neo4j 1.5 GA release which is now available on our downloads page. Since the last milestone you'll find we've smoothed a few rough edges and the documentation has been made really spick-and-span. We think this is our best release yet, but you can be the judge of that considering the splendid set of features and improvements that have gone into it. The full announcement is available on the Neo4j blog here http://blog.neo4j.org/2011/10/announcing-neo4j-boden-bord-15-ga.html and Neo4j 1.5 GA is ready for download from our web site here http://neo4j.org/download/ and is deployed into the maven repository, A big thanks to you, our community, for driving so many of these features forward and for helping to make Neo4j the product you want it to be. Jim Webber Chief Scientist @ Neo Technology ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user
[Neo4j] How to stop returnable evaluator
Dear All, I am writing traverser as follows. i want to stop the returnable evaluator once my condition matching node found , rather evaluating until end of the graph. How i can ask returnable evaluator to stop the traverse and return the nodes. group.traverse(Order.BREADTH_FIRST, StopEvaluator.END_OF_GRAPH, new TopicHasViewPermissionEvaluator(group,user), RelTypes.TOPIC,Direction.OUTGOING).iterator(); Thanks a lot Emil Dombagolla, ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user
Re: [Neo4j] How to stop returnable evaluator
ReturnableEvaluator returns the things you tell it to return when they are encountered (not at the end of the traversal). The StopEvaluator tells the traverser when to stop traversing a given branch. So if you for example would write a StopEvaluator like: StopEvaluator { public boolean isStopNode( TraversalPosition position ) { return position.depth() = 3; } } The traverser would stop traversing branches deeper or as deep as 3, so that all nodes at maximum depth 3 is returned. You could also look at TraversalDescription (gotten from org.neo4j.kernel.Traversal.description()) which is a more low-level and powerful traversal API. In that you work with paths instead of nodes and you can configure it more. 2011/11/10 Emil Dombagolla em...@hsenidoutsourcing.com Dear All, I am writing traverser as follows. i want to stop the returnable evaluator once my condition matching node found , rather evaluating until end of the graph. How i can ask returnable evaluator to stop the traverse and return the nodes. group.traverse(Order.BREADTH_FIRST, StopEvaluator.END_OF_GRAPH, new TopicHasViewPermissionEvaluator(group,user), RelTypes.TOPIC,Direction.OUTGOING).iterator(); Thanks a lot Emil Dombagolla, ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user -- Mattias Persson, [matt...@neotechnology.com] Hacker, Neo Technology www.neotechnology.com ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user
Re: [Neo4j] osm_import.rb
I ended up trying again with just java (but still running with batchInserter), adjusting my memory settings and max heap, it's currently working on the americas.osm file from cloudmade - http://downloads.cloudmade.com/americas#downloads_breadcrumbs. The file is about 99 GB when assembled. I'm running on ubuntu 11.10 Core 2 Duo 2.Ghz with 4G ram (not very fast, but what I have available right now), Java Heap -- -Xmx=3072M config settings: neostore.nodestore.db.mapped_memory=1000M neostore.relationshipstore.db.mapped_memory=300M neostore.propertystore.db.mapped_memory=400M neostore.propertystore.db.strings.mapped_memory=800M neostore.propertystore.db.arrays.mapped_memory=100M My code is essentially from the test suite that you suggested but I am using the batchImporter instead. I'm about 1/3 of the way through and don't want to interrupt the process, but when it's done I'll try it without the batch importer. It runs at about 4500 nodes/second. Is that reasonable? I haven't looked at performance numbers from anyone else. Would the non batch performance be better? Is is better to 'includePoints' or not? One questions I had was, once I get this imported via this method ( neo4j embedded ), is it possible to move the imported db to a neo4j server? I'm hoping it is. If so, what would that process be? -- View this message in context: http://neo4j-community-discussions.438527.n3.nabble.com/osm-import-rb-tp3493463p3496760.html Sent from the Neo4j Community Discussions mailing list archive at Nabble.com. ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user
[Neo4j] How to show all nodes and relationships in Neo4j web admin data browser?
Is there a way to show all nodes and relationship in Neo4j's web admin data browser? -- View this message in context: http://neo4j-community-discussions.438527.n3.nabble.com/How-to-show-all-nodes-and-relationships-in-Neo4j-web-admin-data-browser-tp3496815p3496815.html Sent from the Neo4j Community Discussions mailing list archive at Nabble.com. ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user
[Neo4j] How to get results from web admin console?
This is kinda a noob issue :) I wanna try out web admin console using Cypher. But this is what I get: cypher START a = node(10) cypher RETURN a cypher == `' expected but `n' found How do you get the results? -- View this message in context: http://neo4j-community-discussions.438527.n3.nabble.com/How-to-get-results-from-web-admin-console-tp3496848p3496848.html Sent from the Neo4j Community Discussions mailing list archive at Nabble.com. ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user
Re: [Neo4j] Gremlin - how to flatten a tree, and sort
hi again I've been trying that query out (slightly modified now to return all nodes of a different kind, but attached to a node in the first set), on a data set of around 100K, and I'm getting an OutOfMemoryError: { message : GC overhead limit exceeded, exception : java.lang.OutOfMemoryError: GC overhead limit exceeded, stacktrace : [ ] } My request (for gremlin over REST) is: script: m = [:]; g.v(id).in('R_PartOf').loop(1){m.put(it.object, it.loops); true} -1; m.sort{a,b - a.value = b.value}.keySet()._().in('R_OtherEdge'), params: { id: 284 } Any thoughts? -- View this message in context: http://neo4j-community-discussions.438527.n3.nabble.com/Gremlin-how-to-flatten-a-tree-and-sort-tp3480586p3496857.html Sent from the Neo4j Community Discussions mailing list archive at Nabble.com. ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user
Re: [Neo4j] How to get results from web admin console?
Which version of neo4j are you running? Am 10.11.2011 um 15:32 schrieb yobi: This is kinda a noob issue :) I wanna try out web admin console using Cypher. But this is what I get: cypher START a = node(10) cypher RETURN a cypher == `' expected but `n' found How do you get the results? -- View this message in context: http://neo4j-community-discussions.438527.n3.nabble.com/How-to-get-results-from-web-admin-console-tp3496848p3496848.html Sent from the Neo4j Community Discussions mailing list archive at Nabble.com. ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user
[Neo4j] Travers using curl
Dear All, I am trying to travers neo4j using curl and got errors: curl -X POST -H Accept:application/json -H Content-Type:application/json -d {'order:breadth_first , uniqueness:node_global , return_filter:{body:position.endNode().getProperty('name').toLowerCase().contains('pepsi') , language:javascript} , max_depth:1 }' http://localhost:7474/db/data/node/0/traverse/node ERROR:Error 500 javax.script.ScriptException: sun.org.mozilla.javascript.internal.EcmaError: ReferenceError: name is not defined. (lt;Unknown Sourcegt;#1) Also I set default value for name property: curl -X POST -H Accept:application/json -H Content-Type:application/json -d {'order:breadth_first , uniqueness:node_global , return_filter:{body:position.endNode().getProperty('name', '').toLowerCase().contains('pepsi') , language:javascript} , max_depth:1 }' http://localhost:7474/db/data/node/0/traverse/node ERROR:Error 500 javax.script.ScriptException: sun.org.mozilla.javascript.internal.EvaluatorException: syntax error (lt;Unknown Sourcegt;#1) I am using neo4j 1.4.2 rest api. any idea? thx. Francois. ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user
Re: [Neo4j] Travers using curl
you forgot the first single quote after -d and you have single quotes in your string which you have to replace by double quotes Am 10.11.2011 um 15:46 schrieb Passpart0ut: Dear All, I am trying to travers neo4j using curl and got errors: curl -X POST -H Accept:application/json -H Content-Type:application/json -d {'order:breadth_first , uniqueness:node_global , return_filter:{body:position.endNode().getProperty('name').toLowerCase().contains('pepsi') , language:javascript} , max_depth:1 }' http://localhost:7474/db/data/node/0/traverse/node ERROR:Error 500 javax.script.ScriptException: sun.org.mozilla.javascript.internal.EcmaError: ReferenceError: name is not defined. (lt;Unknown Sourcegt;#1) Also I set default value for name property: curl -X POST -H Accept:application/json -H Content-Type:application/json -d {'order:breadth_first , uniqueness:node_global , return_filter:{body:position.endNode().getProperty('name', '').toLowerCase().contains('pepsi') , language:javascript} , max_depth:1 }' http://localhost:7474/db/data/node/0/traverse/node ERROR:Error 500 javax.script.ScriptException: sun.org.mozilla.javascript.internal.EvaluatorException: syntax error (lt;Unknown Sourcegt;#1) I am using neo4j 1.4.2 rest api. any idea? thx. Francois. ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user
[Neo4j] START a = node(10) vs START a = (10)
In the hosted neo4j (through Heroku) I get an error when running: START a = node(10) RETURN a == `' expected but `n' found But it works when I run: START a = (10) RETURN a According to the documentation the first one should work. Could someone explain why I get the error? -- View this message in context: http://neo4j-community-discussions.438527.n3.nabble.com/START-a-node-10-vs-START-a-10-tp3497036p3497036.html Sent from the Neo4j Community Discussions mailing list archive at Nabble.com. ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user
Re: [Neo4j] START a = node(10) vs START a = (10)
Ah, ok. We running the stable releases on heroku so it is still running 1.4.2 It will be updated to 1.5 today or tomorrow. That's why it is still the old syntax. Thanks for letting us know. Michael Am 10.11.2011 um 16:35 schrieb yobi: In the hosted neo4j (through Heroku) I get an error when running: START a = node(10) RETURN a == `' expected but `n' found But it works when I run: START a = (10) RETURN a According to the documentation the first one should work. Could someone explain why I get the error? -- View this message in context: http://neo4j-community-discussions.438527.n3.nabble.com/START-a-node-10-vs-START-a-10-tp3497036p3497036.html Sent from the Neo4j Community Discussions mailing list archive at Nabble.com. ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user
Re: [Neo4j] START a = node(10) vs START a = (10)
How could you have missed that. Didn't people complain that it wasn't working? :) -- View this message in context: http://neo4j-community-discussions.438527.n3.nabble.com/START-a-node-10-vs-START-a-10-tp3497036p3497120.html Sent from the Neo4j Community Discussions mailing list archive at Nabble.com. ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user
Re: [Neo4j] START a = node(10) vs START a = (10)
The didn't assume that an 1.5 version was running there :) Am 10.11.2011 um 17:04 schrieb yobi: How could you have missed that. Didn't people complain that it wasn't working? :) -- View this message in context: http://neo4j-community-discussions.438527.n3.nabble.com/START-a-node-10-vs-START-a-10-tp3497036p3497120.html Sent from the Neo4j Community Discussions mailing list archive at Nabble.com. ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user
Re: [Neo4j] Neo4j REST server's log files
Hi David, Thank you for getting back to me! Finally I can make it work by changing the log level from INFO (by default) to FINEST in the logging.property. I have a question for you though. Currently my project have a problem with uploading data to the store. I created only 1 index for the whole application and the node name as the key. Several nodes in different ontologies have the same names. So when an ontology is uploaded to the store and has a node that its name has been already in the index (by previous ontologies) this node is not created in the graph of this ontology. My app can upload a number of ontologies and graphs are created successfully for each ontology in the store. However when the process uploads the 9th ontology the store does not respond and it seems busy with some internal process like looking up the node in the index or something else. I'm stuck and don't know the cause of the problem. Do you have any clue or suggestions? Appreciate your help! Regards, From: David Montag david.mon...@neotechnology.com To: Peter Neubauer peter.neuba...@neotechnology.com Cc: Neo4j user discussions user@lists.neo4j.org Sent: Wednesday, November 9, 2011 10:07 PM Subject: Re: [Neo4j] Neo4j REST server's log files Hi Andrew, Let's connect during the day tomorrow for a higher-bandwidth discussion. Do you have Skype? Thanks, David On Wed, Nov 9, 2011 at 1:23 PM, Peter Neubauer peter.neuba...@neotechnology.com wrote: Andrew, this sounds like the RRD database in the server got broken. Could you delete data/rrd and start up again? Also, David is in your timezone and maybe can connect with you directly to look into this? Cheers, /peter neubauer GTalk: neubauer.peter Skype peter.neubauer Phone +46 704 106975 LinkedIn http://www.linkedin.com/in/neubauer Twitter http://twitter.com/peterneubauer http://www.neo4j.org - NOSQL for the Enterprise. http://startupbootcamp.org/ - Öresund - Innovation happens HERE. On Wed, Nov 9, 2011 at 10:07 PM, andrew ton andrewt...@yahoo.com wrote: Hi Peter, I don't understand much your question. However, in my Restlet application I have a logging service using Java log to record all processes in my app. My problem is that I upload 20 ontologies and after serveral ontologies the Neo4J stops responding my REST request. It seems busy with some index lookup process. Consequently my app throws a NoHttpResponseException: The target server failed to respond. I'd like to see what causes the problem inside Neo4J. Unfortunately both messages.log and neo4j.x.x.log do not show run time processes. BTW, when I start up the server the neo4j.x.x.log shows INFO: Server started on [http://localhost:7474/] Nov 9, 2011 10:22:22 AM org.neo4j.server.logging.Logger log WARNING: java.lang.IllegalArgumentException: Bad sample time: 1320862942. Last update time was 1320862942, at least one second step is required at org.rrd4j.core.RrdDb.store(RrdDb.java:553) at org.rrd4j.core.Sample.update(Sample.java:197) at org.neo4j.server.rrd.RrdSamplerImpl.updateSample(RrdSamplerImpl.java:62) at org.neo4j.server.rrd.RrdFactory$1.updateSample(RrdFactory.java:109) at org.neo4j.server.rrd.RrdJob.run(RrdJob.java:43) at org.neo4j.server.rrd.ScheduledJob$1.run(ScheduledJob.java:41) at java.util.TimerThread.mainLoop(Timer.java:512) at java.util.TimerThread.run(Timer.java:462) Nov 9, 2011 12:43:44 PM com.sun.jersey.api.core.PackagesResourceConfig init INFO: Scanning for root resource and provider classes in the packages: org.neo4j.server.webadmin.rest Nov 9, 2011 12:43:44 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses INFO: Root resource classes found: class org.neo4j.server.webadmin.rest.MonitorService class org.neo4j.server.webadmin.rest.RootService class org.neo4j.server.webadmin.rest.JmxService class org.neo4j.server.webadmin.rest.ConsoleService Nov 9, 2011 12:43:44 PM com.sun.jersey.api.core.ScanningResourceConfig init INFO: No provider classes found. Nov 9, 2011 12:43:44 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' Nov 9, 2011 12:43:45 PM com.sun.jersey.api.core.PackagesResourceConfig init INFO: Scanning for root resource and provider classes in the packages: org.neo4j.server.rest.web Nov 9, 2011 12:43:45 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses INFO: Root resource classes found: class org.neo4j.server.rest.web.ResourcesService class org.neo4j.server.rest.web.BatchOperationService class org.neo4j.server.rest.web.RestfulGraphDatabase class org.neo4j.server.rest.web.DatabaseMetadataService class org.neo4j.server.rest.web.ExtensionService Nov 9, 2011 12:43:45 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses INFO: Provider
[Neo4j] Using 'Spatial' IndexProvider from Within Webadmin
I want to be able to use the spatial index provider from within Webadmin's Power Tool console. Using this provider works fine in Embedded mode, but what do I need to do to get it installed and usable from within Webadmin? I tried copying the spatial jar and it's dependencies into the serverRoot/lib and the serverRoot/plugins directories, but didn't seem to work. ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user
Re: [Neo4j] Gremlin - how to flatten a tree, and sort
Hi, I've been trying that query out (slightly modified now to return all nodes of a different kind, but attached to a node in the first set), on a data set of around 100K, and I'm getting an OutOfMemoryError: { message : GC overhead limit exceeded, exception : java.lang.OutOfMemoryError: GC overhead limit exceeded, stacktrace : [ ] } My request (for gremlin over REST) is: script: m = [:]; g.v(id).in('R_PartOf').loop(1){m.put(it.object, it.loops); true} -1; m.sort{a,b - a.value = b.value}.keySet()._().in('R_OtherEdge'), params: { id: 284 } You have the following data structures consuming memory: 1. m 2. m sorted 3. the keyset of m Perhaps those are sufficiently large to blow our your memory. Perhaps test by, for example, not getting keySet or not sorting. When I do large Map-based computations in Gremlin, I use JDBM2 as my map data structure as its persistent and when it overflows memory, its written to disk. http://code.google.com/p/jdbm2/ HTH, Marko. http://markorodriguez.com ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user
[Neo4j] persist() undefined
Hello I'm having trouble getting STS to acknowledge that the method persist() on an nodeentity is valid. I'm using STS 2.8 which to my knowledge has the newest AJDT plugin. I don't know much about Neo4j yet, and I'm also a beginner with Spring, so maybe I forgot something. My project is controlled by maven, and is setup like so: Dependency: dependency groupIdorg.springframework.data/groupId artifactIdspring-data-neo4j/artifactId version2.0.0.M1/version /dependency Plugin: plugin groupIdorg.codehaus.mojo/groupId artifactIdaspectj-maven-plugin/artifactId version1.4/version configuration outxmltrue/outxml aspectLibraries aspectLibrary groupIdorg.springframework/groupId artifactIdspring-aspects/artifactId /aspectLibrary aspectLibrary groupIdorg.springframework.data/groupId artifactIdspring-data-neo4j/artifactId /aspectLibrary /aspectLibraries source1.6/source target1.6/target /configuration executions execution goals goalcompile/goal goaltest-compile/goal /goals /execution /executions dependencies dependency groupIdorg.aspectj/groupId artifactIdaspectjrt/artifactId version1.6.12.M1/version /dependency dependency groupIdorg.aspectj/groupId artifactIdaspectjtools/artifactId version1.6.12.M1/version /dependency /dependencies /plugin My entities are of course flagged with @NodeEntity Can anyone help me out? -- View this message in context: http://neo4j-community-discussions.438527.n3.nabble.com/persist-undefined-tp3497682p3497682.html Sent from the Neo4j Community Discussions mailing list archive at Nabble.com. ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user
Re: [Neo4j] Neo4j REST server's log files
Hi Andrew, Good to hear that you got the logging sorted out. Regarding the actual issues, it sounds like you're describing two different things. One is that you index ontology nodes in one global index and therefore run into conflicts. The other is that the upload appears to stall for some reason. Regarding the global index, did you intend to design the system that way, or do you really want a separate index for each ontology? It sounds like that would be reasonable. As for the stalled upload, a thread dump during the slow processing would be most helpful. On a Linux system, you can capture that by doing kill -3 pid on the Java process. It should then go to console.log. Thanks, David On Thu, Nov 10, 2011 at 8:21 AM, andrew ton andrewt...@yahoo.com wrote: Hi David, Thank you for getting back to me! Finally I can make it work by changing the log level from INFO (by default) to FINEST in the logging.property. I have a question for you though. Currently my project have a problem with uploading data to the store. I created only 1 index for the whole application and the node name as the key. Several nodes in different ontologies have the same names. So when an ontology is uploaded to the store and has a node that its name has been already in the index (by previous ontologies) this node is not created in the graph of this ontology. My app can upload a number of ontologies and graphs are created successfully for each ontology in the store. However when the process uploads the 9th ontology the store does not respond and it seems busy with some internal process like looking up the node in the index or something else. I'm stuck and don't know the cause of the problem. Do you have any clue or suggestions? Appreciate your help! Regards, From: David Montag david.mon...@neotechnology.com To: Peter Neubauer peter.neuba...@neotechnology.com Cc: Neo4j user discussions user@lists.neo4j.org Sent: Wednesday, November 9, 2011 10:07 PM Subject: Re: [Neo4j] Neo4j REST server's log files Hi Andrew, Let's connect during the day tomorrow for a higher-bandwidth discussion. Do you have Skype? Thanks, David On Wed, Nov 9, 2011 at 1:23 PM, Peter Neubauer peter.neuba...@neotechnology.com wrote: Andrew, this sounds like the RRD database in the server got broken. Could you delete data/rrd and start up again? Also, David is in your timezone and maybe can connect with you directly to look into this? Cheers, /peter neubauer GTalk: neubauer.peter Skype peter.neubauer Phone +46 704 106975 LinkedIn http://www.linkedin.com/in/neubauer Twitter http://twitter.com/peterneubauer http://www.neo4j.org - NOSQL for the Enterprise. http://startupbootcamp.org/- Öresund - Innovation happens HERE. On Wed, Nov 9, 2011 at 10:07 PM, andrew ton andrewt...@yahoo.com wrote: Hi Peter, I don't understand much your question. However, in my Restlet application I have a logging service using Java log to record all processes in my app. My problem is that I upload 20 ontologies and after serveral ontologies the Neo4J stops responding my REST request. It seems busy with some index lookup process. Consequently my app throws a NoHttpResponseException: The target server failed to respond. I'd like to see what causes the problem inside Neo4J. Unfortunately both messages.log and neo4j.x.x.log do not show run time processes. BTW, when I start up the server the neo4j.x.x.log shows INFO: Server started on [http://localhost:7474/] Nov 9, 2011 10:22:22 AM org.neo4j.server.logging.Logger log WARNING: java.lang.IllegalArgumentException: Bad sample time: 1320862942. Last update time was 1320862942, at least one second step is required at org.rrd4j.core.RrdDb.store(RrdDb.java:553) at org.rrd4j.core.Sample.update(Sample.java:197) at org.neo4j.server.rrd.RrdSamplerImpl.updateSample(RrdSamplerImpl.java:62) at org.neo4j.server.rrd.RrdFactory$1.updateSample(RrdFactory.java:109) at org.neo4j.server.rrd.RrdJob.run(RrdJob.java:43) at org.neo4j.server.rrd.ScheduledJob$1.run(ScheduledJob.java:41) at java.util.TimerThread.mainLoop(Timer.java:512) at java.util.TimerThread.run(Timer.java:462) Nov 9, 2011 12:43:44 PM com.sun.jersey.api.core.PackagesResourceConfig init INFO: Scanning for root resource and provider classes in the packages: org.neo4j.server.webadmin.rest Nov 9, 2011 12:43:44 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses INFO: Root resource classes found: class org.neo4j.server.webadmin.rest.MonitorService class org.neo4j.server.webadmin.rest.RootService class org.neo4j.server.webadmin.rest.JmxService class org.neo4j.server.webadmin.rest.ConsoleService Nov 9, 2011 12:43:44 PM com.sun.jersey.api.core.ScanningResourceConfig init INFO: No provider classes found. Nov
Re: [Neo4j] Neo4j REST server's log files
Hi David, Please read my answers inline below. From: David Montag david.mon...@neotechnology.com To: Neo4j user discussions user@lists.neo4j.org Sent: Thursday, November 10, 2011 11:39 AM Subject: Re: [Neo4j] Neo4j REST server's log files Hi Andrew, Good to hear that you got the logging sorted out. Regarding the actual issues, it sounds like you're describing two different things. One is that you index ontology nodes in one global index and therefore run into conflicts. The other is that the upload appears to stall for some reason. Regarding the global index, did you intend to design the system that way, or do you really want a separate index for each ontology? It sounds like that would be reasonable. Since the application requirements have changed I think it is better to create an index for each ontology. As for the stalled upload, a thread dump during the slow processing would be most helpful. On a Linux system, you can capture that by doing kill -3 pid on the Java process. It should then go to console.log. I'll try it. Thanks! Thanks, David On Thu, Nov 10, 2011 at 8:21 AM, andrew ton andrewt...@yahoo.com wrote: Hi David, Thank you for getting back to me! Finally I can make it work by changing the log level from INFO (by default) to FINEST in the logging.property. I have a question for you though. Currently my project have a problem with uploading data to the store. I created only 1 index for the whole application and the node name as the key. Several nodes in different ontologies have the same names. So when an ontology is uploaded to the store and has a node that its name has been already in the index (by previous ontologies) this node is not created in the graph of this ontology. My app can upload a number of ontologies and graphs are created successfully for each ontology in the store. However when the process uploads the 9th ontology the store does not respond and it seems busy with some internal process like looking up the node in the index or something else. I'm stuck and don't know the cause of the problem. Do you have any clue or suggestions? Appreciate your help! Regards, From: David Montag david.mon...@neotechnology.com To: Peter Neubauer peter.neuba...@neotechnology.com Cc: Neo4j user discussions user@lists.neo4j.org Sent: Wednesday, November 9, 2011 10:07 PM Subject: Re: [Neo4j] Neo4j REST server's log files Hi Andrew, Let's connect during the day tomorrow for a higher-bandwidth discussion. Do you have Skype? Thanks, David On Wed, Nov 9, 2011 at 1:23 PM, Peter Neubauer peter.neuba...@neotechnology.com wrote: Andrew, this sounds like the RRD database in the server got broken. Could you delete data/rrd and start up again? Also, David is in your timezone and maybe can connect with you directly to look into this? Cheers, /peter neubauer GTalk: neubauer.peter Skype peter.neubauer Phone +46 704 106975 LinkedIn http://www.linkedin.com/in/neubauer Twitter http://twitter.com/peterneubauer http://www.neo4j.org - NOSQL for the Enterprise. http://startupbootcamp.org/ - Öresund - Innovation happens HERE. On Wed, Nov 9, 2011 at 10:07 PM, andrew ton andrewt...@yahoo.com wrote: Hi Peter, I don't understand much your question. However, in my Restlet application I have a logging service using Java log to record all processes in my app. My problem is that I upload 20 ontologies and after serveral ontologies the Neo4J stops responding my REST request. It seems busy with some index lookup process. Consequently my app throws a NoHttpResponseException: The target server failed to respond. I'd like to see what causes the problem inside Neo4J. Unfortunately both messages.log and neo4j.x.x.log do not show run time processes. BTW, when I start up the server the neo4j.x.x.log shows INFO: Server started on [http://localhost:7474/] Nov 9, 2011 10:22:22 AM org.neo4j.server.logging.Logger log WARNING: java.lang.IllegalArgumentException: Bad sample time: 1320862942. Last update time was 1320862942, at least one second step is required at org.rrd4j.core.RrdDb.store(RrdDb.java:553) at org.rrd4j.core.Sample.update(Sample.java:197) at org.neo4j.server.rrd.RrdSamplerImpl.updateSample(RrdSamplerImpl.java:62) at org.neo4j.server.rrd.RrdFactory$1.updateSample(RrdFactory.java:109) at org.neo4j.server.rrd.RrdJob.run(RrdJob.java:43) at org.neo4j.server.rrd.ScheduledJob$1.run(ScheduledJob.java:41) at java.util.TimerThread.mainLoop(Timer.java:512) at java.util.TimerThread.run(Timer.java:462) Nov 9, 2011 12:43:44 PM com.sun.jersey.api.core.PackagesResourceConfig init INFO: Scanning for root resource and provider classes in the packages: org.neo4j.server.webadmin.rest Nov 9, 2011 12:43:44 PM
Re: [Neo4j] How to get results from web admin console?
I was using the hosted Neo4j through Heroku. But someone told me that it was using a previous version and will be updated soon. I think that will solve the problem. On Thu, Nov 10, 2011 at 3:42 PM, Michael Hunger michael.hun...@neotechnology.com wrote: Which version of neo4j are you running? Am 10.11.2011 um 15:32 schrieb yobi: This is kinda a noob issue :) I wanna try out web admin console using Cypher. But this is what I get: cypher START a = node(10) cypher RETURN a cypher == `' expected but `n' found How do you get the results? -- View this message in context: http://neo4j-community-discussions.438527.n3.nabble.com/How-to-get-results-from-web-admin-console-tp3496848p3496848.html Sent from the Neo4j Community Discussions mailing list archive at Nabble.com. ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user
Re: [Neo4j] START a = node(10) vs START a = (10)
Oh. All docs in http://docs.neo4j.org/ is for 1.5 so I assumed they were all using the 1.5 syntax =) -- View this message in context: http://neo4j-community-discussions.438527.n3.nabble.com/START-a-node-10-vs-START-a-10-tp3497036p3497963.html Sent from the Neo4j Community Discussions mailing list archive at Nabble.com. ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user
Re: [Neo4j] How to get results from web admin console?
Oh that someone was you haha :) -- View this message in context: http://neo4j-community-discussions.438527.n3.nabble.com/Re-Neo4j-How-to-get-results-from-web-admin-console-tp3496875p3497966.html Sent from the Neo4j Community Discussions mailing list archive at Nabble.com. ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user
[Neo4j] Use Cases - Please tell your story
All Neo4J users out there. Can you provide a few sentences on your application/use-case? Some generic examples might include: 1. We use Neo4J to traverse a social graph, calculating degree of separation, centrality, who's connected to whom, who you should know / recommendations, influencers, etc. in our social network. 2. We use Neo4J to analyze spatial information for telecom call records...clusters, social connections, influencers, etc. 3. We perform LBS analysis for wireless carrier's customers usage patterns (over time and place) 4. We analyze ACH information for our bank...for fraud detection 5. We have a transportation/delivery application = routing optimization 6. Our implementation is part of a datacenter management/provisioning system 7. Network topology analysis/optimization 8. Cell tower utilization/optimization What's your killer application? Please elaborate ;-) Why am I asking? I'd like to present/blog/evangelize the successful use-cases of Neo4j ;-) Thanks! Jim -- View this message in context: http://neo4j-community-discussions.438527.n3.nabble.com/Use-Cases-Please-tell-your-story-tp3498155p3498155.html Sent from the Neo4j Community Discussions mailing list archive at Nabble.com. ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user
Re: [Neo4j] Neo4j REST server's log files
Hi David, I increased the memory settings in neo4j-wrapper.conf as below # Initial Java Heap Size (in MB) wrapper.java.initmemory=30 # Maximum Java Heap Size (in MB) wrapper.java.maxmemory=1024 However the same problem is still happening. I attach the thread dump to this mail. I appreciate it if you tell me what's wrong based on the thread dump. Thank you! From: David Montag david.mon...@neotechnology.com To: Neo4j user discussions user@lists.neo4j.org Sent: Thursday, November 10, 2011 11:39 AM Subject: Re: [Neo4j] Neo4j REST server's log files Hi Andrew, Good to hear that you got the logging sorted out. Regarding the actual issues, it sounds like you're describing two different things. One is that you index ontology nodes in one global index and therefore run into conflicts. The other is that the upload appears to stall for some reason. Regarding the global index, did you intend to design the system that way, or do you really want a separate index for each ontology? It sounds like that would be reasonable. As for the stalled upload, a thread dump during the slow processing would be most helpful. On a Linux system, you can capture that by doing kill -3 pid on the Java process. It should then go to console.log. Thanks, David On Thu, Nov 10, 2011 at 8:21 AM, andrew ton andrewt...@yahoo.com wrote: Hi David, Thank you for getting back to me! Finally I can make it work by changing the log level from INFO (by default) to FINEST in the logging.property. I have a question for you though. Currently my project have a problem with uploading data to the store. I created only 1 index for the whole application and the node name as the key. Several nodes in different ontologies have the same names. So when an ontology is uploaded to the store and has a node that its name has been already in the index (by previous ontologies) this node is not created in the graph of this ontology. My app can upload a number of ontologies and graphs are created successfully for each ontology in the store. However when the process uploads the 9th ontology the store does not respond and it seems busy with some internal process like looking up the node in the index or something else. I'm stuck and don't know the cause of the problem. Do you have any clue or suggestions? Appreciate your help! Regards, From: David Montag david.mon...@neotechnology.com To: Peter Neubauer peter.neuba...@neotechnology.com Cc: Neo4j user discussions user@lists.neo4j.org Sent: Wednesday, November 9, 2011 10:07 PM Subject: Re: [Neo4j] Neo4j REST server's log files Hi Andrew, Let's connect during the day tomorrow for a higher-bandwidth discussion. Do you have Skype? Thanks, David On Wed, Nov 9, 2011 at 1:23 PM, Peter Neubauer peter.neuba...@neotechnology.com wrote: Andrew, this sounds like the RRD database in the server got broken. Could you delete data/rrd and start up again? Also, David is in your timezone and maybe can connect with you directly to look into this? Cheers, /peter neubauer GTalk: neubauer.peter Skype peter.neubauer Phone +46 704 106975 LinkedIn http://www.linkedin.com/in/neubauer Twitter http://twitter.com/peterneubauer http://www.neo4j.org - NOSQL for the Enterprise. http://startupbootcamp.org/ - Öresund - Innovation happens HERE. On Wed, Nov 9, 2011 at 10:07 PM, andrew ton andrewt...@yahoo.com wrote: Hi Peter, I don't understand much your question. However, in my Restlet application I have a logging service using Java log to record all processes in my app. My problem is that I upload 20 ontologies and after serveral ontologies the Neo4J stops responding my REST request. It seems busy with some index lookup process. Consequently my app throws a NoHttpResponseException: The target server failed to respond. I'd like to see what causes the problem inside Neo4J. Unfortunately both messages.log and neo4j.x.x.log do not show run time processes. BTW, when I start up the server the neo4j.x.x.log shows INFO: Server started on [http://localhost:7474/] Nov 9, 2011 10:22:22 AM org.neo4j.server.logging.Logger log WARNING: java.lang.IllegalArgumentException: Bad sample time: 1320862942. Last update time was 1320862942, at least one second step is required at org.rrd4j.core.RrdDb.store(RrdDb.java:553) at org.rrd4j.core.Sample.update(Sample.java:197) at org.neo4j.server.rrd.RrdSamplerImpl.updateSample(RrdSamplerImpl.java:62) at org.neo4j.server.rrd.RrdFactory$1.updateSample(RrdFactory.java:109) at org.neo4j.server.rrd.RrdJob.run(RrdJob.java:43) at org.neo4j.server.rrd.ScheduledJob$1.run(ScheduledJob.java:41) at java.util.TimerThread.mainLoop(Timer.java:512) at java.util.TimerThread.run(Timer.java:462) Nov 9, 2011 12:43:44 PM
Re: [Neo4j] Neo4j REST server's log files
Hi Andrew, I don't see anything running in that thread dump. No threads are processing requests. Are you sure it's taking a long time, or is it maybe finished? Try capturing the thread dump exactly when you experience slowness. I'd also suggest bumping the initial heap to at least 512MB or something like that. How much RAM do you have? How much data are you inserting? Thanks, David On Thu, Nov 10, 2011 at 2:56 PM, andrew ton andrewt...@yahoo.com wrote: Hi David, I increased the memory settings in neo4j-wrapper.conf as below # Initial Java Heap Size (in MB) wrapper.java.initmemory=30 # Maximum Java Heap Size (in MB) wrapper.java.maxmemory=1024 However the same problem is still happening. I attach the thread dump to this mail. I appreciate it if you tell me what's wrong based on the thread dump. Thank you! From: David Montag david.mon...@neotechnology.com To: Neo4j user discussions user@lists.neo4j.org Sent: Thursday, November 10, 2011 11:39 AM Subject: Re: [Neo4j] Neo4j REST server's log files Hi Andrew, Good to hear that you got the logging sorted out. Regarding the actual issues, it sounds like you're describing two different things. One is that you index ontology nodes in one global index and therefore run into conflicts. The other is that the upload appears to stall for some reason. Regarding the global index, did you intend to design the system that way, or do you really want a separate index for each ontology? It sounds like that would be reasonable. As for the stalled upload, a thread dump during the slow processing would be most helpful. On a Linux system, you can capture that by doing kill -3 pid on the Java process. It should then go to console.log. Thanks, David On Thu, Nov 10, 2011 at 8:21 AM, andrew ton andrewt...@yahoo.com wrote: Hi David, Thank you for getting back to me! Finally I can make it work by changing the log level from INFO (by default) to FINEST in the logging.property. I have a question for you though. Currently my project have a problem with uploading data to the store. I created only 1 index for the whole application and the node name as the key. Several nodes in different ontologies have the same names. So when an ontology is uploaded to the store and has a node that its name has been already in the index (by previous ontologies) this node is not created in the graph of this ontology. My app can upload a number of ontologies and graphs are created successfully for each ontology in the store. However when the process uploads the 9th ontology the store does not respond and it seems busy with some internal process like looking up the node in the index or something else. I'm stuck and don't know the cause of the problem. Do you have any clue or suggestions? Appreciate your help! Regards, From: David Montag david.mon...@neotechnology.com To: Peter Neubauer peter.neuba...@neotechnology.com Cc: Neo4j user discussions user@lists.neo4j.org Sent: Wednesday, November 9, 2011 10:07 PM Subject: Re: [Neo4j] Neo4j REST server's log files Hi Andrew, Let's connect during the day tomorrow for a higher-bandwidth discussion. Do you have Skype? Thanks, David On Wed, Nov 9, 2011 at 1:23 PM, Peter Neubauer peter.neuba...@neotechnology.com wrote: Andrew, this sounds like the RRD database in the server got broken. Could you delete data/rrd and start up again? Also, David is in your timezone and maybe can connect with you directly to look into this? Cheers, /peter neubauer GTalk: neubauer.peter Skype peter.neubauer Phone +46 704 106975 LinkedIn http://www.linkedin.com/in/neubauer Twitter http://twitter.com/peterneubauer http://www.neo4j.org - NOSQL for the Enterprise. http://startupbootcamp.org/- Öresund - Innovation happens HERE. On Wed, Nov 9, 2011 at 10:07 PM, andrew ton andrewt...@yahoo.com wrote: Hi Peter, I don't understand much your question. However, in my Restlet application I have a logging service using Java log to record all processes in my app. My problem is that I upload 20 ontologies and after serveral ontologies the Neo4J stops responding my REST request. It seems busy with some index lookup process. Consequently my app throws a NoHttpResponseException: The target server failed to respond. I'd like to see what causes the problem inside Neo4J. Unfortunately both messages.log and neo4j.x.x.log do not show run time processes. BTW, when I start up the server the neo4j.x.x.log shows INFO: Server started on [http://localhost:7474/] Nov 9, 2011 10:22:22 AM org.neo4j.server.logging.Logger log WARNING: java.lang.IllegalArgumentException: Bad sample time: 1320862942. Last update time was 1320862942, at least one
Re: [Neo4j] Neo4j REST server's log files
Hi David, The total size of files stored into the db when the problem happened was only 800KB. My RAM is 4G. I ran the kill command when the problem happened because it just stopped and I did not notice slowness. I will increase the heap to 512MB and test again. Thanks, Andrew From: David Montag david.mon...@neotechnology.com To: Neo4j user discussions user@lists.neo4j.org Sent: Thursday, November 10, 2011 3:00 PM Subject: Re: [Neo4j] Neo4j REST server's log files Hi Andrew, I don't see anything running in that thread dump. No threads are processing requests. Are you sure it's taking a long time, or is it maybe finished? Try capturing the thread dump exactly when you experience slowness. I'd also suggest bumping the initial heap to at least 512MB or something like that. How much RAM do you have? How much data are you inserting? Thanks, David On Thu, Nov 10, 2011 at 2:56 PM, andrew ton andrewt...@yahoo.com wrote: Hi David, I increased the memory settings in neo4j-wrapper.conf as below # Initial Java Heap Size (in MB) wrapper.java.initmemory=30 # Maximum Java Heap Size (in MB) wrapper.java.maxmemory=1024 However the same problem is still happening. I attach the thread dump to this mail. I appreciate it if you tell me what's wrong based on the thread dump. Thank you! From: David Montag david.mon...@neotechnology.com To: Neo4j user discussions user@lists.neo4j.org Sent: Thursday, November 10, 2011 11:39 AM Subject: Re: [Neo4j] Neo4j REST server's log files Hi Andrew, Good to hear that you got the logging sorted out. Regarding the actual issues, it sounds like you're describing two different things. One is that you index ontology nodes in one global index and therefore run into conflicts. The other is that the upload appears to stall for some reason. Regarding the global index, did you intend to design the system that way, or do you really want a separate index for each ontology? It sounds like that would be reasonable. As for the stalled upload, a thread dump during the slow processing would be most helpful. On a Linux system, you can capture that by doing kill -3 pid on the Java process. It should then go to console.log. Thanks, David On Thu, Nov 10, 2011 at 8:21 AM, andrew ton andrewt...@yahoo.com wrote: Hi David, Thank you for getting back to me! Finally I can make it work by changing the log level from INFO (by default) to FINEST in the logging.property. I have a question for you though. Currently my project have a problem with uploading data to the store. I created only 1 index for the whole application and the node name as the key. Several nodes in different ontologies have the same names. So when an ontology is uploaded to the store and has a node that its name has been already in the index (by previous ontologies) this node is not created in the graph of this ontology. My app can upload a number of ontologies and graphs are created successfully for each ontology in the store. However when the process uploads the 9th ontology the store does not respond and it seems busy with some internal process like looking up the node in the index or something else. I'm stuck and don't know the cause of the problem. Do you have any clue or suggestions? Appreciate your help! Regards, From: David Montag david.mon...@neotechnology.com To: Peter Neubauer peter.neuba...@neotechnology.com Cc: Neo4j user discussions user@lists.neo4j.org Sent: Wednesday, November 9, 2011 10:07 PM Subject: Re: [Neo4j] Neo4j REST server's log files Hi Andrew, Let's connect during the day tomorrow for a higher-bandwidth discussion. Do you have Skype? Thanks, David On Wed, Nov 9, 2011 at 1:23 PM, Peter Neubauer peter.neuba...@neotechnology.com wrote: Andrew, this sounds like the RRD database in the server got broken. Could you delete data/rrd and start up again? Also, David is in your timezone and maybe can connect with you directly to look into this? Cheers, /peter neubauer GTalk: neubauer.peter Skype peter.neubauer Phone +46 704 106975 LinkedIn http://www.linkedin.com/in/neubauer Twitter http://twitter.com/peterneubauer http://www.neo4j.org - NOSQL for the Enterprise. http://startupbootcamp.org/ - Öresund - Innovation happens HERE. On Wed, Nov 9, 2011 at 10:07 PM, andrew ton andrewt...@yahoo.com wrote: Hi Peter, I don't understand much your question. However, in my Restlet application I have a logging service using Java log to record all processes in my app. My problem is that I upload 20 ontologies and after serveral ontologies the Neo4J stops responding my REST request. It seems busy with some index lookup process. Consequently my app throws a
Re: [Neo4j] Neo4j REST server's log files
Can you describe how you see that it stops? Because the thread dump isn't showing anything of significance running. David On Thu, Nov 10, 2011 at 3:28 PM, andrew ton andrewt...@yahoo.com wrote: Hi David, The total size of files stored into the db when the problem happened was only 800KB. My RAM is 4G. I ran the kill command when the problem happened because it just stopped and I did not notice slowness. I will increase the heap to 512MB and test again. Thanks, Andrew From: David Montag david.mon...@neotechnology.com To: Neo4j user discussions user@lists.neo4j.org Sent: Thursday, November 10, 2011 3:00 PM Subject: Re: [Neo4j] Neo4j REST server's log files Hi Andrew, I don't see anything running in that thread dump. No threads are processing requests. Are you sure it's taking a long time, or is it maybe finished? Try capturing the thread dump exactly when you experience slowness. I'd also suggest bumping the initial heap to at least 512MB or something like that. How much RAM do you have? How much data are you inserting? Thanks, David On Thu, Nov 10, 2011 at 2:56 PM, andrew ton andrewt...@yahoo.com wrote: Hi David, I increased the memory settings in neo4j-wrapper.conf as below # Initial Java Heap Size (in MB) wrapper.java.initmemory=30 # Maximum Java Heap Size (in MB) wrapper.java.maxmemory=1024 However the same problem is still happening. I attach the thread dump to this mail. I appreciate it if you tell me what's wrong based on the thread dump. Thank you! From: David Montag david.mon...@neotechnology.com To: Neo4j user discussions user@lists.neo4j.org Sent: Thursday, November 10, 2011 11:39 AM Subject: Re: [Neo4j] Neo4j REST server's log files Hi Andrew, Good to hear that you got the logging sorted out. Regarding the actual issues, it sounds like you're describing two different things. One is that you index ontology nodes in one global index and therefore run into conflicts. The other is that the upload appears to stall for some reason. Regarding the global index, did you intend to design the system that way, or do you really want a separate index for each ontology? It sounds like that would be reasonable. As for the stalled upload, a thread dump during the slow processing would be most helpful. On a Linux system, you can capture that by doing kill -3 pid on the Java process. It should then go to console.log. Thanks, David On Thu, Nov 10, 2011 at 8:21 AM, andrew ton andrewt...@yahoo.com wrote: Hi David, Thank you for getting back to me! Finally I can make it work by changing the log level from INFO (by default) to FINEST in the logging.property. I have a question for you though. Currently my project have a problem with uploading data to the store. I created only 1 index for the whole application and the node name as the key. Several nodes in different ontologies have the same names. So when an ontology is uploaded to the store and has a node that its name has been already in the index (by previous ontologies) this node is not created in the graph of this ontology. My app can upload a number of ontologies and graphs are created successfully for each ontology in the store. However when the process uploads the 9th ontology the store does not respond and it seems busy with some internal process like looking up the node in the index or something else. I'm stuck and don't know the cause of the problem. Do you have any clue or suggestions? Appreciate your help! Regards, From: David Montag david.mon...@neotechnology.com To: Peter Neubauer peter.neuba...@neotechnology.com Cc: Neo4j user discussions user@lists.neo4j.org Sent: Wednesday, November 9, 2011 10:07 PM Subject: Re: [Neo4j] Neo4j REST server's log files Hi Andrew, Let's connect during the day tomorrow for a higher-bandwidth discussion. Do you have Skype? Thanks, David On Wed, Nov 9, 2011 at 1:23 PM, Peter Neubauer peter.neuba...@neotechnology.com wrote: Andrew, this sounds like the RRD database in the server got broken. Could you delete data/rrd and start up again? Also, David is in your timezone and maybe can connect with you directly to look into this? Cheers, /peter neubauer GTalk: neubauer.peter Skype peter.neubauer Phone +46 704 106975 LinkedIn http://www.linkedin.com/in/neubauer Twitter http://twitter.com/peterneubauer http://www.neo4j.org - NOSQL for the Enterprise. http://startupbootcamp.org/- Öresund - Innovation happens HERE. On Wed, Nov 9, 2011 at 10:07 PM, andrew ton andrewt...@yahoo.com wrote: Hi Peter, I don't understand
[Neo4j] Save files?
Is it possible to save files in Neo4j like CouchDB? Haven't read about it anywhere but wanted to be sure. -- View this message in context: http://neo4j-community-discussions.438527.n3.nabble.com/Save-files-tp3498358p3498358.html Sent from the Neo4j Community Discussions mailing list archive at Nabble.com. ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user
Re: [Neo4j] Neo4j REST server's log files
What I meant the server stops responding to my application's request was my application received a NoHttpResponseException. This is the output in the Eclipse console: -Uploading /doc/test/ont/Ontology1320789957941.owl to Neo4J... Nov 10, 2011 3:46:52 PM org.restlet.ext.httpclient.HttpClientHelper start INFO: Starting the Apache HTTP client Root node of ontology Ontology1320789957941.owl: http://localhost:7474/db/data/index/node/my_index/name/Ontology1320789957941 Find node: http://localhost:7474/db/data/index/node/my_index/name/super_node Processing triple -http://localhost:7474/db/data/node/1,CONTAINS,http://localhost:7474/db/data/node/147 Find node: http://localhost:7474/db/data/index/node/my_index/name/lowEnergy Nov 10, 2011 3:47:22 PM org.restlet.ext.httpclient.internal.HttpMethodCall sendRequest WARNING: An error occurred during the communication with the remote HTTP server. org.apache.http.NoHttpResponseException: The target server failed to respond at org.apache.http.impl.conn.DefaultResponseParser.parseHead(DefaultResponseParser.java:101) If I upload only a few ontologies (no problems) and the log/neo4j.x.x.log showed the server processed the lowEnergy node : Nov 10, 2011 3:46:52 PM org.mortbay.log.Slf4jLog debug FINE: REQUEST /db/data/node/1/relationships/out/CONTAINS on org.mortbay.jetty.HttpConnection@237dc815 Nov 10, 2011 3:46:52 PM org.mortbay.log.Slf4jLog debug FINE: sessionManager=org.mortbay.jetty.servlet.HashSessionManager@375e293a Nov 10, 2011 3:46:52 PM org.mortbay.log.Slf4jLog debug FINE: session=null Nov 10, 2011 3:46:52 PM org.mortbay.log.Slf4jLog debug FINE: servlet=org.neo4j.server.web.NeoServletContainer-1130213695 Nov 10, 2011 3:46:52 PM org.mortbay.log.Slf4jLog debug FINE: chain=org.neo4j.server.statistic.StatisticFilter-org.neo4j.server.web.NeoServletContainer-1130213695 Nov 10, 2011 3:46:52 PM org.mortbay.log.Slf4jLog debug FINE: servlet holder=org.neo4j.server.web.NeoServletContainer-1130213695 Nov 10, 2011 3:46:52 PM org.mortbay.log.Slf4jLog debug FINE: call filter org.neo4j.server.statistic.StatisticFilter Nov 10, 2011 3:46:52 PM org.mortbay.log.Slf4jLog debug FINE: call servlet org.neo4j.server.web.NeoServletContainer-1130213695 Nov 10, 2011 3:46:52 PM org.mortbay.log.Slf4jLog debug FINE: RESPONSE /db/data/node/1/relationships/out/CONTAINS 200] Nov 10, 2011 3:46:52 PM org.mortbay.log.Slf4jLog debug FINE: REQUEST /db/data/node/1/relationships on org.mortbay.jetty.HttpConnection@237dc815 Nov 10, 2011 3:46:52 PM org.mortbay.log.Slf4jLog debug FINE: sessionManager=org.mortbay.jetty.servlet.HashSessionManager@375e293a Nov 10, 2011 3:46:52 PM org.mortbay.log.Slf4jLog debug FINE: session=null Nov 10, 2011 3:46:52 PM org.mortbay.log.Slf4jLog debug FINE: servlet=org.neo4j.server.web.NeoServletContainer-1130213695 Nov 10, 2011 3:46:52 PM org.mortbay.log.Slf4jLog debug FINE: chain=org.neo4j.server.statistic.StatisticFilter-org.neo4j.server.web.NeoServletContainer-1130213695 Nov 10, 2011 3:46:52 PM org.mortbay.log.Slf4jLog debug FINE: servlet holder=org.neo4j.server.web.NeoServletContainer-1130213695 Nov 10, 2011 3:46:52 PM org.mortbay.log.Slf4jLog debug FINE: call filter org.neo4j.server.statistic.StatisticFilter Nov 10, 2011 3:46:52 PM org.mortbay.log.Slf4jLog debug FINE: call servlet org.neo4j.server.web.NeoServletContainer-1130213695 Nov 10, 2011 3:46:52 PM org.mortbay.log.Slf4jLog debug FINE: RESPONSE /db/data/node/1/relationships 201 Nov 10, 2011 3:46:52 PM org.mortbay.log.Slf4jLog debug FINE: REQUEST /db/manage/server/monitor/fetch/1320942809 on org.mortbay.jetty.HttpConnection@66e90097 Nov 10, 2011 3:46:52 PM org.mortbay.log.Slf4jLog debug FINE: Got Session ID 9fdtr96dq71c1iqw1b8416rpc from cookie Nov 10, 2011 3:46:52 PM org.mortbay.log.Slf4jLog debug FINE: sessionManager=org.mortbay.jetty.servlet.HashSessionManager@375e293a Nov 10, 2011 3:46:52 PM org.mortbay.log.Slf4jLog debug FINE: session=null Nov 10, 2011 3:46:52 PM org.mortbay.log.Slf4jLog debug FINE: servlet=org.neo4j.server.web.NeoServletContainer-1301864188 Nov 10, 2011 3:46:52 PM org.mortbay.log.Slf4jLog debug FINE: chain=org.neo4j.server.statistic.StatisticFilter-org.neo4j.server.web.NeoServletContainer-1301864188 Nov 10, 2011 3:46:52 PM org.mortbay.log.Slf4jLog debug FINE: servlet holder=org.neo4j.server.web.NeoServletContainer-1301864188 Nov 10, 2011 3:46:52 PM org.mortbay.log.Slf4jLog debug FINE: call filter org.neo4j.server.statistic.StatisticFilter Nov 10, 2011 3:46:52 PM org.mortbay.log.Slf4jLog debug FINE: call servlet org.neo4j.server.web.NeoServletContainer-1301864188 Nov 10, 2011 3:46:52 PM org.mortbay.log.Slf4jLog debug FINE: RESPONSE /db/manage/server/monitor/fetch/1320942809 200 Nov 10, 2011 3:46:52 PM DefaultMBeanServerInterceptor getAttribute FINER: Attribute= HeapMemoryUsage, obj= java.lang:type=Memory Nov 10, 2011 3:46:52 PM Repository retrieve FINER: name=java.lang:type=Memory Nov 10, 2011 3:46:53 PM org.mortbay.log.Slf4jLog debug FINE: REQUEST
Re: [Neo4j] Save files?
Neo4j don't have that feature, but we build extension. You can see main part of code here https://github.com/animotron/core/blob/master/src/main/java/org/animotron/expression/BinaryExpression.java On Fri, Nov 11, 2011 at 5:06 AM, yobi johnny@yobistore.com wrote: Is it possible to save files in Neo4j like CouchDB? Haven't read about it anywhere but wanted to be sure. -- Dmitriy Shabanov ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user
Re: [Neo4j] Gremlin - how to flatten a tree, and sort
hi, thanks for the quick reply. I need to add some more info (some I left out, some I discovered later) This only happens when I use that gremlin over REST. Executing the gremlin in the webadmin console is pretty quick, and I don't see any memory spikes or anything. What I did (after posting the previous question) was to increase the heap memory for neo4j (I saw a post about this earlier), which removed the OutOfMemoryError, but now I simply get a timeout on the rest execution... -- View this message in context: http://neo4j-community-discussions.438527.n3.nabble.com/Gremlin-how-to-flatten-a-tree-and-sort-tp3480586p3498820.html Sent from the Neo4j Community Discussions mailing list archive at Nabble.com. ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user
Re: [Neo4j] Neo4j REST server's log files
Hi Andrew, Would you like to do a screen sharing session with me Friday PST? That way, I could assess your problem better. Thanks, David On Thu, Nov 10, 2011 at 4:23 PM, andrew ton andrewt...@yahoo.com wrote: What I meant the server stops responding to my application's request was my application received a NoHttpResponseException. This is the output in the Eclipse console: -Uploading /doc/test/ont/Ontology1320789957941.owl to Neo4J... Nov 10, 2011 3:46:52 PM org.restlet.ext.httpclient.HttpClientHelper start INFO: Starting the Apache HTTP client Root node of ontology Ontology1320789957941.owl: http://localhost:7474/db/data/index/node/my_index/name/Ontology1320789957941 Find node: http://localhost:7474/db/data/index/node/my_index/name/super_node Processing triple - http://localhost:7474/db/data/node/1,CONTAINS,http://localhost:7474/db/data/node/147 Find node: http://localhost:7474/db/data/index/node/my_index/name/lowEnergy Nov 10, 2011 3:47:22 PM org.restlet.ext.httpclient.internal.HttpMethodCall sendRequest WARNING: An error occurred during the communication with the remote HTTP server. org.apache.http.NoHttpResponseException: The target server failed to respond at org.apache.http.impl.conn.DefaultResponseParser.parseHead(DefaultResponseParser.java:101) If I upload only a few ontologies (no problems) and the log/neo4j.x.x.log showed the server processed the lowEnergy node : Nov 10, 2011 3:46:52 PM org.mortbay.log.Slf4jLog debug FINE: REQUEST /db/data/node/1/relationships/out/CONTAINS on org.mortbay.jetty.HttpConnection@237dc815 Nov 10, 2011 3:46:52 PM org.mortbay.log.Slf4jLog debug FINE: sessionManager=org.mortbay.jetty.servlet.HashSessionManager@375e293a Nov 10, 2011 3:46:52 PM org.mortbay.log.Slf4jLog debug FINE: session=null Nov 10, 2011 3:46:52 PM org.mortbay.log.Slf4jLog debug FINE: servlet=org.neo4j.server.web.NeoServletContainer-1130213695 Nov 10, 2011 3:46:52 PM org.mortbay.log.Slf4jLog debug FINE: chain=org.neo4j.server.statistic.StatisticFilter-org.neo4j.server.web.NeoServletContainer-1130213695 Nov 10, 2011 3:46:52 PM org.mortbay.log.Slf4jLog debug FINE: servlet holder=org.neo4j.server.web.NeoServletContainer-1130213695 Nov 10, 2011 3:46:52 PM org.mortbay.log.Slf4jLog debug FINE: call filter org.neo4j.server.statistic.StatisticFilter Nov 10, 2011 3:46:52 PM org.mortbay.log.Slf4jLog debug FINE: call servlet org.neo4j.server.web.NeoServletContainer-1130213695 Nov 10, 2011 3:46:52 PM org.mortbay.log.Slf4jLog debug FINE: RESPONSE /db/data/node/1/relationships/out/CONTAINS 200] Nov 10, 2011 3:46:52 PM org.mortbay.log.Slf4jLog debug FINE: REQUEST /db/data/node/1/relationships on org.mortbay.jetty.HttpConnection@237dc815 Nov 10, 2011 3:46:52 PM org.mortbay.log.Slf4jLog debug FINE: sessionManager=org.mortbay.jetty.servlet.HashSessionManager@375e293a Nov 10, 2011 3:46:52 PM org.mortbay.log.Slf4jLog debug FINE: session=null Nov 10, 2011 3:46:52 PM org.mortbay.log.Slf4jLog debug FINE: servlet=org.neo4j.server.web.NeoServletContainer-1130213695 Nov 10, 2011 3:46:52 PM org.mortbay.log.Slf4jLog debug FINE: chain=org.neo4j.server.statistic.StatisticFilter-org.neo4j.server.web.NeoServletContainer-1130213695 Nov 10, 2011 3:46:52 PM org.mortbay.log.Slf4jLog debug FINE: servlet holder=org.neo4j.server.web.NeoServletContainer-1130213695 Nov 10, 2011 3:46:52 PM org.mortbay.log.Slf4jLog debug FINE: call filter org.neo4j.server.statistic.StatisticFilter Nov 10, 2011 3:46:52 PM org.mortbay.log.Slf4jLog debug FINE: call servlet org.neo4j.server.web.NeoServletContainer-1130213695 Nov 10, 2011 3:46:52 PM org.mortbay.log.Slf4jLog debug FINE: RESPONSE /db/data/node/1/relationships 201 Nov 10, 2011 3:46:52 PM org.mortbay.log.Slf4jLog debug FINE: REQUEST /db/manage/server/monitor/fetch/1320942809 on org.mortbay.jetty.HttpConnection@66e90097 Nov 10, 2011 3:46:52 PM org.mortbay.log.Slf4jLog debug FINE: Got Session ID 9fdtr96dq71c1iqw1b8416rpc from cookie Nov 10, 2011 3:46:52 PM org.mortbay.log.Slf4jLog debug FINE: sessionManager=org.mortbay.jetty.servlet.HashSessionManager@375e293a Nov 10, 2011 3:46:52 PM org.mortbay.log.Slf4jLog debug FINE: session=null Nov 10, 2011 3:46:52 PM org.mortbay.log.Slf4jLog debug FINE: servlet=org.neo4j.server.web.NeoServletContainer-1301864188 Nov 10, 2011 3:46:52 PM org.mortbay.log.Slf4jLog debug FINE: chain=org.neo4j.server.statistic.StatisticFilter-org.neo4j.server.web.NeoServletContainer-1301864188 Nov 10, 2011 3:46:52 PM org.mortbay.log.Slf4jLog debug FINE: servlet holder=org.neo4j.server.web.NeoServletContainer-1301864188 Nov 10, 2011 3:46:52 PM org.mortbay.log.Slf4jLog debug FINE: call filter org.neo4j.server.statistic.StatisticFilter Nov 10, 2011 3:46:52 PM org.mortbay.log.Slf4jLog debug FINE: call servlet org.neo4j.server.web.NeoServletContainer-1301864188 Nov 10, 2011 3:46:52 PM org.mortbay.log.Slf4jLog debug FINE: RESPONSE /db/manage/server/monitor/fetch/1320942809 200 Nov 10, 2011
Re: [Neo4j] Gremlin - how to flatten a tree, and sort
furthermore, I tried a simple query, that returns about the same number of rows (still around 100K), and increased the timeout of my REST call (to several minutes) - and got my OutOfMemoryError again :) latest query is just g.v(293).in('R_Bought'). Running it through the webadmin console is quick, and my memory usage stays low, etc (all as expected). It's only when going through the REST interface that I start getting memory and/or timeout issues... -- View this message in context: http://neo4j-community-discussions.438527.n3.nabble.com/Gremlin-how-to-flatten-a-tree-and-sort-tp3480586p3498879.html Sent from the Neo4j Community Discussions mailing list archive at Nabble.com. ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user
Re: [Neo4j] Travers using curl
oops, sorry for the typo and thank you for the reply. I used the below syntax: curl -X POST -H Accept:application/json -H Content-Type:application/json -d '{order:breadth_first , uniqueness:node_global , return_filter:{body:position.endNode().getProperty('name').toLowerCase().contains('pepsi') , language:javascript} , max_depth:1 }' http://localhost:7474/db/data/node/0/traverse/node and curl -X POST -H Accept:application/json -H Content-Type:application/json -d '{order:breadth_first , uniqueness:node_global , return_filter:{body:position.endNode().getProperty('name', '').toLowerCase().contains('pepsi') , language:javascript} , max_depth:1 }' http://localhost:7474/db/data/node/0/traverse/node and both are producing same errors mentioned in original post. - Regards, Francois Kassis. -- View this message in context: http://neo4j-community-discussions.438527.n3.nabble.com/Neo4j-Travers-using-curl-tp3496892p3498909.html Sent from the Neo4j Community Discussions mailing list archive at Nabble.com. ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user
Re: [Neo4j] Gremlin - how to flatten a tree, and sort
Hi Kevin, That is unfortunate. Peter is the man to track down such things in Neo4j REST. Hopefully it's something obvious. Glad the REPL and WebAdmin is speedy. Good luck, Marko. http://markorodriguez.com On Nov 10, 2011, at 10:42 PM, Kevin Versfeld kevin.versf...@gmail.com wrote: furthermore, I tried a simple query, that returns about the same number of rows (still around 100K), and increased the timeout of my REST call (to several minutes) - and got my OutOfMemoryError again :) latest query is just g.v(293).in('R_Bought'). Running it through the webadmin console is quick, and my memory usage stays low, etc (all as expected). It's only when going through the REST interface that I start getting memory and/or timeout issues... -- View this message in context: http://neo4j-community-discussions.438527.n3.nabble.com/Gremlin-how-to-flatten-a-tree-and-sort-tp3480586p3498879.html Sent from the Neo4j Community Discussions mailing list archive at Nabble.com. ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user
Re: [Neo4j] Gremlin - how to flatten a tree, and sort
Kevin, So the webadmin console is displaying the 100k nodes ok, men but rest barfs? On Nov 11, 2011 6:42 AM, Kevin Versfeld kevin.versf...@gmail.com wrote: furthermore, I tried a simple query, that returns about the same number of rows (still around 100K), and increased the timeout of my REST call (to several minutes) - and got my OutOfMemoryError again :) latest query is just g.v(293).in('R_Bought'). Running it through the webadmin console is quick, and my memory usage stays low, etc (all as expected). It's only when going through the REST interface that I start getting memory and/or timeout issues... -- View this message in context: http://neo4j-community-discussions.438527.n3.nabble.com/Gremlin-how-to-flatten-a-tree-and-sort-tp3480586p3498879.html Sent from the Neo4j Community Discussions mailing list archive at Nabble.com. ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user
Re: [Neo4j] Gremlin - how to flatten a tree, and sort
Kevin, how large is the dataset that is build up? I'm not sure but the REST Plugin and the Webadmin use different implementations where webadmin streams the results with ajax and the REST plugin builds up a full string result. Do you need all of the data? Or would it be possible to page it? Or to add some code to pre-process the data and just return the minimum that is needed. Adding streaming to the cypher + gremlin pluings would be also a nice option, perhaps you'd like to add an github issue for that. Cheers Michael Am 11.11.2011 um 06:42 schrieb Kevin Versfeld: furthermore, I tried a simple query, that returns about the same number of rows (still around 100K), and increased the timeout of my REST call (to several minutes) - and got my OutOfMemoryError again :) latest query is just g.v(293).in('R_Bought'). Running it through the webadmin console is quick, and my memory usage stays low, etc (all as expected). It's only when going through the REST interface that I start getting memory and/or timeout issues... -- View this message in context: http://neo4j-community-discussions.438527.n3.nabble.com/Gremlin-how-to-flatten-a-tree-and-sort-tp3480586p3498879.html Sent from the Neo4j Community Discussions mailing list archive at Nabble.com. ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user
Re: [Neo4j] Save files?
Oh, that's cool! Got some docs on the usage? This would be a gerat input to a discussion about more data types, especially JSON/subgraphs, binary and DATE. Cheers, /peter neubauer GTalk: neubauer.peter Skype peter.neubauer Phone +46 704 106975 LinkedIn http://www.linkedin.com/in/neubauer Twitter http://twitter.com/peterneubauer http://www.neo4j.org - NOSQL for the Enterprise. http://startupbootcamp.org/ - Öresund - Innovation happens HERE. On Fri, Nov 11, 2011 at 5:47 AM, Dmitriy Shabanov shaban...@gmail.com wrote: Neo4j don't have that feature, but we build extension. You can see main part of code here https://github.com/animotron/core/blob/master/src/main/java/org/animotron/expression/BinaryExpression.java On Fri, Nov 11, 2011 at 5:06 AM, yobi johnny@yobistore.com wrote: Is it possible to save files in Neo4j like CouchDB? Haven't read about it anywhere but wanted to be sure. -- Dmitriy Shabanov ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user