Re: [Neo] Neo framework documentations...

2007-06-28 Thread Johan Svensson
On 6/28/07, Tobias Ivarsson [EMAIL PROTECTED] wrote: From the neo4j.org website: ... Neo provides: ... - an event framework with proactive and reactive events on modification of the node space. Actually, we haven't exposed the event framework yet in the new API. But we'll try to get

Re: [Neo] Neo Design Guide

2007-10-17 Thread Johan Svensson
On 10/16/07, Klas Ehnrot [EMAIL PROTECTED] wrote: On 10/15/07, Björn Granvik [EMAIL PROTECTED] wrote: ** Repeated iterables *In the chapter Coding Relationships there is a private static class OrderIterable extends AbstractCollectionIOrder Should probably be parameterized using

Re: [Neo] Design example for transactions usage

2007-11-08 Thread Johan Svensson
Two nodes will be added, this might be counter intuitive if you don't know that we do not support real nested transactions (this needs to be made more clear in the documentation). The semantics of our transactions is as follows: o a nested transaction will not start a new transaction,

Re: [Neo] Multiple Neo not starting?

2008-01-25 Thread Johan Svensson
mentioned on neo4j.org. /peter On Jan 25, 2008 1:50 PM, Johan Svensson [EMAIL PROTECTED] wrote: Multiple instances are supported. The exception thrown is just a check from back when we had a start method. I'll change it to an assert or ISE. Peter what version of Neo are you running

Re: [Neo] (no subject)

2008-03-14 Thread Johan Svensson
The stacktrace says to me that it is a threading problem. Two threads enter relationship delete at the same time, one of them wins the lock on the relationships deleting it. Upon commit the lock is released and the other thread tries to load the relationship from store since it can't find it

Re: [Neo] Deploy to dist.neo4j.org

2008-05-05 Thread Johan Svensson
The dist site only contains releases. You need to deploy a shell fix for neo-1.0-b6? If so mail me the jar and I'll put it there. -Johan On Mon, May 5, 2008 at 1:54 PM, Mattias Persson [EMAIL PROTECTED] wrote: Hi I need to deploy the latest neo/shell version to dist.neo4j.org since those

Re: [Neo] Best practices for fragile typing?

2008-05-06 Thread Johan Svensson
On Tue, May 6, 2008 at 10:02 AM, Philip Jägenstedt [EMAIL PROTECTED] wrote: Hi again, I was going to hear with you all about best practices for dealing with what can be described as fragile typing: Given the relationship REMIXED going out from an artist, it's possible that the target node

Re: [Neo] Re: Transactions in IndexService?

2008-05-10 Thread Johan Svensson
On Sat, May 10, 2008 at 9:04 PM, Philip Jägenstedt [EMAIL PROTECTED] wrote: Perhaps my question could also be phrased as: What happens if tx.finish() is never called? I don't know what tomcat does when it times out, but I expect it might kill the running servlet quite brutally. If

Re: [Neo] JRuby API ?

2008-05-13 Thread Johan Svensson
Hi, Please read and follow instructions here: http://wiki.neo4j.org/content/About_Contributor_License_Agreement We will then create accounts for you. Also check: http://wiki.neo4j.org/content/Code_Contributor's_Guide -Johan On Tue, May 13, 2008 at 4:17 PM, Andreas Ronge [EMAIL PROTECTED]

Re: [Neo] Node retrieval failing in OSGi environment

2008-06-01 Thread Johan Svensson
Looks like the transaction log has been closed via call to NeoService.shutdown(). -Johan On Sun, Jun 1, 2008 at 1:09 PM, Peter Neubauer [EMAIL PROTECTED] wrote: Thanks! Upgraded Neo4j to 1.0-RC1-SNAPSHOT, now the exception is: ls 0 got id: 0 java.nio.channels.ClosedChannelException

Re: [Neo] coding standard

2008-06-04 Thread Johan Svensson
Hi, I couldn't figure out how to upload non-image files in the media wiki (anyone knows?) so I uploaded it to http://dist.neo4j.org/neo-coding-conventions.xml -Johan On Wed, Jun 4, 2008 at 5:29 PM, Anders Nawroth [EMAIL PROTECTED] wrote: hi! This page:

Re: [Neo] Transactions and Locks ?

2008-06-06 Thread Johan Svensson
Hi, In beta 6 it blocks but in the trunk we have fixed this so a read never blocks waiting for some other transaction. Instead the committed or locally modified value is read and any other concurrent modifying transaction will have its own copy. Also in the next few days we will merge in the

Re: [Neo] design question

2008-06-22 Thread Johan Svensson
Both nodes and relationships should implement the PropertyContainer interface so no need to duplicate code. PropertyContainer interface has been added to trunk (see org.neo4j.api.core package) and will be included in the next release. -Johan On Sat, Jun 21, 2008 at 10:42 AM, Anders Nawroth

Re: [Neo] Storage overhead

2008-06-23 Thread Johan Svensson
Did you shutdown Neo so logical log got removed? Check the Neo store directory for a nioneo_logical.log*. If that file exist you didn't perform a proper shutdown so a lot of information about how to recover is also stored not reflecting the real overhead. Default configuration of Neo is not

Re: [Neo] how to get an specific node

2008-07-29 Thread Johan Svensson
Hi Andreas, As you say IndexService is very simple and only supports exact lookup at the moment. Use the index service to position yourself somewhere in the graph (or if you can get away with using Neo's native ids since getNodeById is lightning fast) . Once you have a position you start

Re: [Neo] how to get an specific node

2008-07-30 Thread Johan Svensson
Hi Anders, On Tue, Jul 29, 2008 at 5:06 PM, Anders Nawroth [EMAIL PROTECTED] wrote: hi Johan! Johan Svensson wrote: As you say IndexService is very simple and only supports exact lookup at the moment. Use the index service to position yourself somewhere in the graph (or if you can get away

Re: [Neo] code formatting

2008-08-04 Thread Johan Svensson
None. If you can get the code formatter not to touch existing blank lines please do so. -Johan On Mon, Aug 4, 2008 at 12:19 PM, Anders Nawroth [EMAIL PROTECTED] wrote: Hi! Just out of curiosity, what's rationale for not allowing any blank lines inside of methods in the code formatter?

Re: [Neo] how to get an specific node

2008-08-08 Thread Johan Svensson
On Fri, Aug 8, 2008 at 12:34 PM, Anders Nawroth [EMAIL PROTECTED] wrote: hi! Johan Svensson wrote: anders.nawroth wrote: As I'm currently looking into the IMDB Workshop stuff, it would be helpful to hear your idea on a graph layout to make searches for actor names and movie titles

Re: [Neo] Neo4j for personal information database

2008-08-09 Thread Johan Svensson
Hi Nils, - support an extendible data model (plugins can add fields / relationships to exisiting objects). From what I've read this is supported. Everything is dynamic, you can create new nodes/relationships/relationship types and add properties at will. A node can have any combination of

Re: [Neo] how to get an specific node

2008-08-09 Thread Johan Svensson
[EMAIL PROTECTED] wrote: Hi! Johan Svensson skrev: One way would be to do a traversal from the word-node with the least number for relationships. OK, I implemented this. But I *do* have to iterate over the relationships to get the count? At the moment I only want the search to return one

Re: [Neo] Neo4j as a XA source

2008-08-14 Thread Johan Svensson
On Thu, Aug 14, 2008 at 5:02 PM, Jonas Bergvall [EMAIL PROTECTED] wrote: Do you have an estimate when that would be? Sometime next week. Currently I'm looking into using Neo's TM and injecting XA resources into it instead. Is there any example of how to do that? You need to setup a branch

Re: [Neo] Remote access

2008-08-27 Thread Johan Svensson
Hi, On Wed, Aug 27, 2008 at 5:57 AM, Jonny Wray [EMAIL PROTECTED] wrote: ii) I have the need for querying node properties. I've been using sparql but it isn't scaling and I'm going to have to go to an indexing solution. I've seen a brief mention of an index service with neo but no more details

Re: [Neo] Remote access

2008-08-28 Thread Johan Svensson
On Wed, Aug 27, 2008 at 8:17 PM, Jonny Wray [EMAIL PROTECTED] wrote: Thanks Johan, I have a question, or maybe request, along the lines of the second thread link you sent me. I have a use case much like a google search - the user specifies a search string and the application brings back all

Re: [Neo] NEO Performance

2008-12-12 Thread Johan Svensson
Hi Jürgen, I will try to answer some of your questions. On Thu, Dec 11, 2008 at 10:17 PM, Jürgen Umbrich juergen.umbr...@deri.org wrote: first off all, I am very fascinated about neo and the neo4j library. I work as part of my PhD in the domain of web crawling and thus, I thought about using

Re: [Neo] NEO Performance

2008-12-13 Thread Johan Svensson
On Fri, Dec 12, 2008 at 6:28 PM, Jürgen Umbrich juergen.umbr...@deri.org wrote: Hi Single value index is currently pretty slow. If you just create 1 node, 1 relationship, 1 property for each link and no index you should get about 10-30 inserts/ms depending on hardware (would translate to

Re: [Neo] are nodes reached inside a transaction accessible outside a transaction?

2008-12-29 Thread Johan Svensson
Hi, Mwanji Your observations about transactions are correct. A while ago I removed the transaction check for read operations (as a performance optimization). Reading may however throw an exception depending on what state the object being read is in. Currently all node, relationship and property

Re: [Neo] are nodes reached inside a transaction accessible outside a transaction?

2008-12-29 Thread Johan Svensson
use. On Mon, Dec 29, 2008 at 2:51 PM, Mwanji Ezana mwa...@gmail.com wrote: Hi Johan, Thanks for the clarification. On Mon, Dec 29, 2008 at 11:34 AM, Johan Svensson jo...@neotechnology.comwrote: Reading may however throw an exception depending on what state the object being read

Re: [Neo] In-memory Neo

2009-02-01 Thread Johan Svensson
Hi David, Currently there is no in-memory implementation. It would be fairly easy to implement the org.neo4j.impl.persistence.ResourceConnection/PersistenceSource interfaces but you would still have the global transaction manager that would keep a transaction log on disk. The easiest way would

Re: [Neo] Neo api and the future...

2009-02-05 Thread Johan Svensson
Hello Jeff, Thanks for your interest in Neo4j, your project sounds very interesting. On Thu, Feb 5, 2009 at 5:50 PM, Jeff Rose ros...@gmail.com wrote: Is there a way to get an iterator over all nodes? Also for all relations? It seems that disconnected nodes can be easily lost right now,

Re: [Neo] Are Neo4j transactions local to thread?

2009-02-12 Thread Johan Svensson
Hello, Emil is right and to further clarify: Transactions are by default tied to the thread that calls NeoService.beginTx(). They are also by default marked as rollback so the success() call will cause finish() to commit instead of rollback. See

Re: [Neo] db recovery

2009-02-19 Thread Johan Svensson
On Thu, Feb 19, 2009 at 12:49 AM, Emil Eifrem e...@neotechnology.com wrote: On Thu, Feb 19, 2009 at 00:39, Lyudmila L. Balakireva lu...@lanl.gov wrote: But I worry how it going to recover with billions nodes in it . It should be able to recover with the same memory used to write the indexes?

Re: [Neo] neo4j on .NET

2009-05-03 Thread Johan Svensson
Hi Antonello, Have a look at the neo-android component, dependency on javax.transaction has been dropped there (https://svn.neo4j.org/components/neo-android/trunk/) by just writing empty interfaces for all the javax.transaction stuff needed. javax.transaction / JTA and X/Open are just interfaces

Re: [Neo] neo at GAE ?

2009-05-05 Thread Johan Svensson
Yes, I spent some time yesterday looking up GAE and also concluded we have to use the datastore: http://code.google.com/appengine/docs/java/javadoc/com/google/appengine/api/datastore/package-summary.html Thought some about different layouts for storing nodes,relationships and properties

Re: [Neo] neo4j on .NET

2009-05-05 Thread Johan Svensson
the same functionality. Once this is solved, I see no further [major] obstacles to the port: avoiding the integration with the System.Transactions mechanism, the base of neo4j port would work in its core functionalities. Cheers. Antonello On Sun, May 3, 2009 at 4:51 PM, Johan Svensson jo

Re: [Neo] Information on Data Model?

2009-05-05 Thread Johan Svensson
Hi Matthias, Great if you want to contribute! Currently there exist no good external documentation on Neo4j internals. This has been requested before and I hope we can put together a document of that type soon (but very low on bandwidth right now). Your best shot right now is to search the

Re: [Neo] Information on Data Model?

2009-05-06 Thread Johan Svensson
Yes, I think you got it almost completely correct. As you say node records (and all other records) are fixed length and they have a pointer to the first property and first relationship. We don't store property or relationship count, they are just lists/chains. Regarding the PropertyIndexStore it

Re: [Neo] org.neo4j.api.core.NotFoundException: Node[7] not found.

2009-05-13 Thread Johan Svensson
Hi Andreas, I was able to reproduce this. If I start from a clean db and only execute those 2 tests over and over again the 4th run will always fail on the multi rollback test. I created a ticket for it https://trac.neo4j.org/ticket/168 and will look into it as soon as possible. Regards, -Johan

Re: [Neo] org.neo4j.api.core.NotFoundException: Node[7] not found.

2009-05-14 Thread Johan Svensson
and maybe future Neoclipse search features, is there any reason to not consider Neo external search functionality? I assume all Neo IndexService implementations are thread-safe ;) -Andreas Johan Svensson wrote: Hi Andreas, I was able to reproduce this. If I start from a clean db and only

Re: [Neo] Online backup fails with suggested Spring transaction integration

2009-05-17 Thread Johan Svensson
On Sat, May 16, 2009 at 10:25 PM, Andreas Guenther aguent...@flying-orange.com wrote: I have been poking around with online backup for a couple of days now and are happy with the results in general, especially the runtime backup capability. Most of the issues I came across I was able to work

Re: [Neo] Online backup fails with suggested Spring transaction integration

2009-05-20 Thread Johan Svensson
Andreas, I had a look at this and realized problem is caused by the static nature of SpringTransactionManager and UserTransactionImpl. A fix for this has been on my todo for some time but to make it right we need to expose some new stuff in NeoService (mainly tied to configuration API that has

Re: [Neo] Online backup fails with suggested Spring transaction integration

2009-05-29 Thread Johan Svensson
Andreas, I applied most of it, both SpringTransactionManager and UserTransactionImpl now have the get/set method for transaction manager and the default constructor. I did not add the new constructor in EmbeddedNeo because it didn't feel right to have a constructor taking

Re: [Neo] IllegalStateException meaning

2009-05-31 Thread Johan Svensson
Hi Rob, I've seen this problem once before but could not reproduce the behavior once I tried. Could you check if tx.success() is called before tx.finish()? Also, could you check in the stacktrace for the source of the nested IllegalStateException. -Johan On Sun, May 31, 2009 at 12:12 AM, Rob

Re: [Neo] RDBMS import utility thoughts?

2009-06-01 Thread Johan Svensson
Peter, For batch insert with Lucene index have a look at this wiki page: http://wiki.neo4j.org/content/Batch_Insert -Johan On Sun, May 31, 2009 at 11:16 AM, Peter Neubauer peter.neuba...@jayway.se wrote: Thanks Johan, this works great! However, is there any utility to create the Lucene

Re: [Neo] Some exceptions

2009-06-04 Thread Johan Svensson
Hi Niel, What version of Neo4j are you running (b8,b9-SNAPSHOT) and on what OS/file system? -Johan On Thu, Jun 4, 2009 at 4:45 PM, Neil Ellis neil.el...@mangala.co.uk wrote: I took a little more of a look in the logs and found: java.lang.NullPointerException         at

Re: [Neo] Some exceptions

2009-06-04 Thread Johan Svensson
like a nested transaction quirk ... and would only occur after a large number of successful writes (gigs). Thx Neil On 4 Jun 2009, at 18:18, Johan Svensson wrote: Hi Niel, What version of Neo4j are you running (b8,b9-SNAPSHOT) and on what OS/file system? -Johan On Thu, Jun 4, 2009

Re: [Neo] RDBMS import utility thoughts?

2009-06-08 Thread Johan Svensson
Yes, Currently the reference node always has node id 0 but this may change in the future. We currently have some discussions about making the reference node static so you can't delete it (will then always be there with id 0). Another solution that has been discussed is to have a setReferenceNode

Re: [Neo] Some exceptions

2009-06-08 Thread Johan Svensson
On Mon, Jun 8, 2009 at 1:42 PM, Neil Ellis neil.el...@mangala.co.uk wrote: On 8 Jun 2009, at 12:21, Johan Svensson wrote: On Mon, Jun 8, 2009 at 12:04 PM, Neil Ellis neil.el...@mangala.co.uk wrote: So after a weekend away from the problem it occured to me that I had neglected to nohup

Re: [Neo] Graph presentation at school.

2009-06-22 Thread Johan Svensson
Hi Macarse, I had a look at this and here are some comments: Running your code with default parameters on a 1.6 JVM about 50% of the time will be spent in garbage collection. Giving the JVM -Xms128M -Xmx128M will cut the variation of the query times from 2500-3000 ms down to 1300-1600 ms

Re: [Neo] Graph presentation at school.

2009-06-24 Thread Johan Svensson
On Mon, Jun 22, 2009 at 4:37 PM, Macarsemaca...@gmail.com wrote: On Mon, Jun 22, 2009 at 10:21 AM, Johan Svenssonjo...@neotechnology.com wrote: ... You also run everything in the same transaction. I tried getting some information on transaction and what isolation level the insert/query you

Re: [Neo] how to decouple transaction management from access to underlying nodes

2009-06-29 Thread Johan Svensson
On Thu, Jun 25, 2009 at 2:51 PM, Mattias Perssonmatt...@neotechnology.com wrote: 2009/6/25 Symeon (Akis) Papadopoulos papa...@iti.gr: [My apologies for insisting on this issue.] There's (at least) two solutions to this problem. One is that, as you suggest, to have the iterator wrap its methods

Re: [Neo] neo4j on .NET

2009-07-02 Thread Johan Svensson
Antonello, Pass it in as a key/value pair in the constructor that takes a configuration map: MapString,String params = new HashMapString,String(); params.put( use_memory_mapped_buffers, false ); NeoService neo = new EmbeddedNeo( neo-db, params ); Hope that helps. Regards, -Johan On

Re: [Neo] precedence of evaluators

2009-07-02 Thread Johan Svensson
Hi Rob, On Thu, Jul 2, 2009 at 12:43 PM, Rob Challenrjchal...@gmail.com wrote: Having lots of fun experimenting with Neo. Nice job. Great to hear! Its not clear from the traverser documentation what behaviour I should expect from a traverser if both stop evaluator and returnable evaluator

Re: [Neo] repairing an index

2009-07-07 Thread Johan Svensson
Hi Jan, On Tue, Jul 7, 2009 at 1:43 PM, Jan Berkeljan.ber...@gmail.com wrote: here's the log of the failed recovery (post-powercut) It looks like the recovery was completed successfully and right after it a normal relationship create failed. This is odd. In order to see the real causes of the

Re: [Neo] indexing relationships

2009-07-07 Thread Johan Svensson
Hello, We have discussed this and given it some thought before. I think having a global index on (node1,node2,relationship) will not work well. Just managing that index will slow down relationship create and delete a lot. What we keep forgetting is that the graph already is the index. A well

Re: [Neo] indexing relationships

2009-07-09 Thread Johan Svensson
On Tue, Jul 7, 2009 at 5:15 PM, Symeon (Akis) Papadopoulospapa...@iti.gr wrote: Johan Svensson wrote: What we keep forgetting is that the graph already is the index. A well designed graph will often check if a specific relationship exist between two nodes just as fast as asking an already

Re: [Neo] Preserving existing node IDs when using Batch Insert

2009-07-11 Thread Johan Svensson
Hi Ikechukwu, On Fri, Jul 10, 2009 at 11:50 PM, Ikechukwu Eshiokwuikechukwu.eshio...@primalfusion.com wrote: Hey, So I'm attempting to import an existing graph stored in a RDBMS into Neo4j using the BatchInserter.createNode(long, MapString, Object) method (since I'd like to preserve the

Re: [Neo] OSGi update

2009-07-18 Thread Johan Svensson
Excellent work Andreas! Would be great if someone could try this out. Else I can ask Peter later (think he is on vacation right now) to do this. Regards, -Johan On Sat, Jul 18, 2009 at 12:56 AM, Andreas Kolleggerakolleg...@tembopublic.org wrote: Hi all, A quick update on the status of the

Re: [Neo] Sorry full trace.

2009-07-20 Thread Johan Svensson
Can you reproduce this? If you could create a test that triggers this would be great cause it looks like a bug. Also are you running this on windows? -Johan On Mon, Jul 20, 2009 at 1:45 PM, Neil Ellisneil.el...@mangala.co.uk wrote: SEVERE: Failed loading relationships for node[5906099] ...

Re: [Neo] out of swap space

2009-07-21 Thread Johan Svensson
Hi Akis, Again you have run into a JVM bug (http://bugs.sun.com/bugdatabase/view_bug.do?bug_id=6423256, and it should have been marked as a bug not request for enhancment). I would suggest you update your JDK to the latest one (update 14) and hopefully the problem will go away. If it does not

Re: [Neo] Read Only

2009-07-26 Thread Johan Svensson
Hi Neil, It is possible to make Neo4j act as a read-only database resulting in no recovery after a non clean shutdown. We are planing to have a look at this after the b9 release. Also speeding up the recovery process is something we have to do before going 1.0 final (should be possible to drop

Re: [Neo] Read Only

2009-07-30 Thread Johan Svensson
, those are the things that will cause us problems when we get to production. All the best Neil On 26 Jul 2009, at 13:07, Johan Svensson wrote: Hi Neil, It is possible to make Neo4j act as a read-only database resulting in no recovery after a non clean shutdown. We are planing to have

Re: [Neo] Interrupts

2009-07-30 Thread Johan Svensson
Hi Neil, Yes, there are a lot of error messages that needs to be improved. On the other hand the documentation should state that calling any Neo4j API operation after (or concurrently with) NeoService.shutdown() is not valid. Adding a flag to check if running is not an option because of

Re: [Neo] online backup

2009-07-30 Thread Johan Svensson
Hi Jerry, Looks like you have shutdown NeoService then try to make a backup. When using the online-backup component NeoService has to be running. For offline backups you can just copy the store directory. Regards, -Johan On Wed, Jul 29, 2009 at 4:01 AM, Jerry Juanicojtjuan...@gmail.com wrote:

Re: [Neo] Interrupts

2009-07-30 Thread Johan Svensson
an error and continue - or to end the loop it is in). Thanks as always Neil On 30 Jul 2009, at 19:45, Johan Svensson wrote: Hi Neil, Yes, there are a lot of error messages that needs to be improved. On the other hand the documentation should state that calling any Neo4j API operation after

Re: [Neo] Batchinserter methods

2009-07-30 Thread Johan Svensson
Hi Rob, Your problem was caused by a bug in the batch inserter. I just committed a fix for it so a new b9-SNAPSHOT should be available soon. -Johan On Tue, Jul 28, 2009 at 11:25 AM, Rob Challenrjchal...@gmail.com wrote: I'm using the batchinserter to build a graph. I'm not sure if what I am

Re: [Neo] hi

2009-08-12 Thread Johan Svensson
Hi, Happy to hear that you got good results and thanks for the kind words. The RDF components are not officially released yet. We do have commercial customers using them but they have tailor made solutions to fit their needs. All in all these components would need some polish and packaging

[Neo] Announcing Neo4j 1.0-b9

2009-08-16 Thread Johan Svensson
People, I am very happy to announce the release of Neo4j 1.0-b9. It's available here: http://neo4j.org/download http://dist.neo4j.org/neo-1.0-b9-binary.zip http://dist.neo4j.org/neo-1.0-b9-binary.tar.gz For maven users group / artifact id: org.neo4j / neo-1.0-b9 This release includes

Re: [Neo] NullPointerException

2009-08-18 Thread Johan Svensson
$DynamicAdvisedIntercept or.intercept(Cglib2AopProxy.java:635) and the error went away when reverting back to 0.1 gary ___ Neo mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user -- Johan Svensson [jo...@neotechnology.com

Re: [Neo] Load hugh graph

2009-08-25 Thread Johan Svensson
Hi, What is the total number of edges in the graph? Also how much RAM does the computer have you are running this on? The batch inserter needs to be configured properly as described in the last section on the wiki page [http://wiki.neo4j.org/content/Batch_Insert] to achieve best performance.

Re: [Neo] Index vs IndexService

2009-09-02 Thread Johan Svensson
Hi, Index interface is (old and) used by the NeoIndexService internally to represent different index implementations. IndexService is the new interface that you should use together with LuceneIndexService. The index-util component needs to be documented better and have the API finalized (with

[Neo] New features in trunk

2009-09-02 Thread Johan Svensson
by loading relationships on demand. This will also reduce the stress on GC when traversing over a node with many relationships since much fewer objects will be created. If you have some suitable project please help us test and try out these new features. Regards, -Johan -- Johan Svensson [jo

Re: [Neo] Neo4J Scalability

2009-09-08 Thread Johan Svensson
Hi Todd, What OS do you run this on? The FileChannel.write fail with an exception saying buffer is too large is new to me. Try decrease the amount of memory you give the store files (if you have modified default configuration) and make sure you at least have disk space to write out 1/10th of the

Re: [Neo] Neo4j at (SF, CA, USA) installfest?

2009-09-08 Thread Johan Svensson
Hi Rich, When is the next Meetup? Not sure if anyone from the Neo4j team will be in the SF area (Oct 26?) but maybe there is someone else here on list that could help out? At least we should fix the documentation and put more content on the wiki. -Johan On Tue, Sep 8, 2009 at 11:57 PM, Rich

Re: [Neo] Neo4J Scalability

2009-09-09 Thread Johan Svensson
Todd, I successfully ran the code resulting in roughly 190M nodes/properties and 390M relationships injected in 35min (the condition in one of your for loops probably has a typo, should have been personnumberOfPeople and then more relationships would have been created). This was on a Linux

Re: [Neo] All your node are belong to us

2009-09-10 Thread Johan Svensson
Looks like there are recovered transactions that the global transaction manager do not know what to do with. Have you been running b9/b10 followed by either b6/b7 or b8 on the same store? Currently we are not backwards compatible and doing so on a non clean shutdown (ex. let a b9 crash then try

Re: [Neo] Neo4J Scalability

2009-09-10 Thread Johan Svensson
On Thu, Sep 10, 2009 at 2:40 PM, Todd Stavish toddstav...@gmail.com wrote: Thanks! Quick summary, it was definitely a config issue. Changing to the recommend config settings makes the exceptions go away. Weird though, those config values are for VM memory management. But the exceptions looked

Re: [Neo] StoreFailureException during load

2009-09-11 Thread Johan Svensson
Hi, Looks like there is an inconsistency between the property store and either the string or array store (don't know which one since there are no line numbers). Terminating the running process (whenever) is not a problem as long as you let the recovery run on next start-up using the transaction

Re: [Neo] User Digest, Vol 30, Issue 12

2009-09-12 Thread Johan Svensson
Hi, I was able to reproduce this on Windows. Was a bug in the plain buffer mode (used by default when running on windows). Committed a fix for it in trunk so if you try with the latest b10-SNAPSHOT the problem should go away. Regards, -Johan On Fri, Sep 11, 2009 at 11:26 AM, Catalin Marius

Re: [Neo] Using batch inserter

2009-09-15 Thread Johan Svensson
Hi, You can only have one writable NeoService or BatchInserter at the time to the same Neo4j store. The BatchInserter is intended for import your data once and can not be used together with a normal NeoService concurrently. Regards, -Johan On Tue, Sep 15, 2009 at 11:38 AM, Ahmed Abdelsalam

Re: [Neo] Multi-threaded tx's question

2009-09-16 Thread Johan Svensson
Hi, Top level transactions are independent of each other so: 1) no B will not be rolled back (if no tx.failure() is invoked on B and B gets a tx.success() called before tx.finish()) 2) no, a committed transaction is committed As you pointed out, when a transaction is already running starting a

Re: [Neo] Multi-threaded tx's question

2009-09-16 Thread Johan Svensson
jmontgom...@uchicago.edu wrote: So, transactions are thread confined? -Original Message- From: user-boun...@lists.neo4j.org [mailto:user- boun...@lists.neo4j.org] On Behalf Of Johan Svensson Sent: Wednesday, September 16, 2009 8:30 AM To: Neo user discussions Subject: Re: [Neo] Multi

Re: [Neo] Using batch inserter

2009-09-16 Thread Johan Svensson
On Tue, Sep 15, 2009 at 5:49 PM, Craig Taverner cr...@amanzi.com wrote: Is this true even if they are run in different threads? It implies that a graphic application cannot run batch inserts, because it is almost certain that other elements of the application will have NeoService open to that

Re: [Neo] Error in neoclipse after a crash

2009-09-16 Thread Johan Svensson
Is this on Windows? Then it can be related to a bug recently found: http://lists.neo4j.org/pipermail/user/2009-September/001784.html Bug is fixed in 1.0-b10-SNAPSHOT. This bug is present in the 1.0-b9 release (windows only). Work around is: o Pass in use_memory_mapped_buffers=true as

Re: [Neo] Subreference pattern scaling

2009-09-21 Thread Johan Svensson
Hi, Go with relationship since that will allow you to traverse both from a node to its subreference node and vice versa. For example, if you only have a property pointing out the subreference node you can not easily figure out all nodes connected to a specific subreference node. Regarding

Re: [Neo] Deadlock on RWLock in Neoclipse

2009-09-28 Thread Johan Svensson
Hi, Do a full thread dump and check for threads waiting (and what they have locked). The most common cause of these issues is one (or more) synchronize {} block around a Neo4j write operation. Check the code for synchronization blocks and try to move Neo4j write operations out of them. Another

Re: [Neo] threading

2009-10-11 Thread Johan Svensson
as you suggest. Regards, Marc On Sat, Oct 10, 2009 at 9:23 AM, Johan Svensson jo...@neotechnology.comwrote: Hi, Do you have a NeoService writing to the store concurrently with the embedded read only ones? Regarding the other question you should use one NeoService (instance) per

Re: [Neo] threading

2009-10-11 Thread Johan Svensson
On Sun, Oct 11, 2009 at 6:01 PM, Marc Preddie mpred...@gmail.com wrote: Hi Johan, That's what I initially suspected, and so I ran a small test to output the relationship in question, and there is only one. But wouldn't the same error occur when using a single thread, if there were more than

Re: [Neo] threading

2009-10-13 Thread Johan Svensson
there? 2009/10/11, Johan Svensson jo...@neotechnology.com: On Sun, Oct 11, 2009 at 6:01 PM, Marc Preddie mpred...@gmail.com wrote: ... ___ Neo mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user

Re: [Neo] Problems using Traverse

2009-10-14 Thread Johan Svensson
Hi, How many nodes do you visit during the traversal? Currently the traverser implementation makes sure you will not visit the same node twice and it does this by storing the nodes visited in a set. -Johan On Wed, Oct 14, 2009 at 12:33 PM, Andrea Puddu kiedi...@gmail.com wrote: HI, This is

Re: [Neo] Problems using Traverse

2009-10-14 Thread Johan Svensson
at the end of the graph, after it has found all nodes. I gave 6GB to the java heap space but, after about 120k nodes, it hangs. I don't know if there is a better solution then mine to do that. Andrea Il giorno 14/ott/2009, alle ore 15.10, Johan Svensson ha scritto: Hi, How many nodes do you

Re: [Neo] Problems using Traverse

2009-10-15 Thread Johan Svensson
and it is not hierarchical. More specifically, it represent an encyclopedia where nodes are the Pages and arcs are Links from a Page to another Page. Regards, Andrea Il giorno 14/ott/2009, alle ore 17.26, Johan Svensson ha scritto: Andrea, Depending on your graph and the traversal you need to perform

Re: [Neo] FOAF import code?

2009-10-20 Thread Johan Svensson
Good memory :) It was actually Emil who wrote the initial importer. Code is not in our repository and has not been touched in over 4 years. I will mail it to you. -Johan On Tue, Oct 20, 2009 at 11:03 AM, Peter Neubauer neubauer.pe...@gmail.com wrote: Hi there, Andreas and me have been talking

Re: [Neo] merging databases to enable bulk load on live database

2009-10-30 Thread Johan Svensson
Hi, It would be possible to implemented it but as I said it would require a lot of work. The hard part is to merge the bulk loaded data set in a safe *transactional* way. The problem I see with it is that the data you are bulk loading have to be independent of the rest of the graph. This is

Re: [Neo] merging databases to enable bulk load on live database

2009-11-02 Thread Johan Svensson
On Fri, Oct 30, 2009 at 5:31 PM, Craig Taverner cr...@amanzi.com wrote: Hi Johan, Of course I have a response to each of your excellent points :-) *'transactional merge'* I do assume that all database access is locked for the duration of the real 'merge'. But since the merge should be a set

Re: [Neo] Infrequent DeadlockDetectedException

2009-11-02 Thread Johan Svensson
On Mon, Nov 2, 2009 at 9:06 PM, Andreas Guenther andreas.guent...@web.de wrote: Hi, I am getting the below deadlock exception occasionally and so far only on relationship operations. The code base is trunk. The system this is running on is Linux and the Java app integrates Neo with Spring

Re: [Neo] Infrequent DeadlockDetectedException

2009-11-03 Thread Johan Svensson
approach for this? Thank you in advance, -Andreas Johan Svensson wrote: On Mon, Nov 2, 2009 at 9:06 PM, Andreas Guenther andreas.guent...@web.de wrote: Hi, I am getting the below deadlock exception occasionally and so far only on relationship operations. The code base is trunk. The system

Re: [Neo] InvalidRecordException during load

2009-11-03 Thread Johan Svensson
Hi, Not much has changed since r3108 in trunk, just a few minor changes related to online-backup. Are you using the online-backup component? Also are you using memory mapped configuration or not? It can be configured by setting the use_memory_mapped_buffers=true|false (if you are running windows

Re: [Neo] InvalidRecordException during load

2009-11-04 Thread Johan Svensson
configuration.   Out of curiosity where can I find the configuration properties available and how are they set? - Justin -Original Message- From: user-boun...@lists.neo4j.org [mailto:user- boun...@lists.neo4j.org] On Behalf Of Johan Svensson Sent: Tuesday, November 03, 2009 11:51

Re: [Neo] Neo,Rest,.NET

2009-11-11 Thread Johan Svensson
On Tue, Nov 10, 2009 at 10:05 PM, Jawher djo.mli...@gmail.com wrote: - And a *question to the neo4j team* : would using org.neo4j.scala as a package name and org.neo4j as a maven groupId pause a problem ? No problem I think (name=neo-scala, groupId=org.neo4j, package=org.neo4j.scala). I will

Re: [Neo] Web Analytics Use Case

2009-11-11 Thread Johan Svensson
On Wed, Nov 11, 2009 at 11:02 AM, Benjamin Dageroth benjamin.dager...@webtrekk.com wrote: Hi, ... Then the best solution for this seems to me that I would run two databases: First I ask our current current database to give me all Visitors, to whom this criteria applies, and then ask neo4j

  1   2   3   >