nice, no errors now, thanks! I've been postponing checking stuff like SortedTree or anything until the errors were gone...
I guess I could try SortedTree, but it's based on Nodes, and that would add an extra unnecessary layer maybe? still good to know I have this option and the RelationshipIndex option thanks to Anders too. I'll have to see what to do with both... Thanks so far, Good luck! John On Thu, Jul 28, 2011 at 3:04 PM, Niels Hoogeveen <[email protected]>wrote: > > I checked the Git repo, and left two more files in that I had removed in my > local project. (Note to self: When deleting or renaming files always update > repo). > The repo is now up-to-date, and the most recent download installed > perfectly using Maven. > What I meant by playing nice with Neo4j transactions is for the scenario > where BDB would act as an IndexProvider for Neo4j. In such a scenario I > would want to be able to commit, rollback in both Neo4j and BDB and make > sure they both close properly and recover properly from error situations. > I found an implementation of a BDB IndexProvider in Peter Neubauer's Git > repo, but I get an error when trying to build that project, so I would have > to look into that. > With respect to you 10mil relations needing to check if A --> B, have you > tried SortedTree in the collections component. This class has a containsNode > method allowing you to check if A --> B. SortedTree is a Btree so the lookup > should be much faster. > Niels > > > > Date: Thu, 28 Jul 2011 13:35:43 +0200 > > From: [email protected] > > To: [email protected] > > Subject: Re: [Neo4j] HyperRelationship example > > > > I don't know what you mean by this: > > "I don't know how nicely BDB plays with Neo4J transactions. " > > I have some small experience with bdb java edition that is, but I'm not > sure > > what would their transaction have to do with neo4j transactions... if you > > meant if you could make a wrapper such that you could use the same > > format/interface neo4j uses for their transactions, then you can, I did > some > > attempt to that it works for me, also BDB Java Edition doesn't support > > nested transactions either (the C++ version does), but emulating them to > use > > the same root/parent transaction is easy, my attempt is here: > > > https://github.com/13th-floor/neo4john/blob/6c0371e82b7fc5b5f45d7c0ea9fb03ee4d241df9/src.obsolete/org/bdb/BETransaction.java > > probably not much relevant though. But this file here: > > > https://github.com/13th-floor/neo4john/blob/master/src/org/benchtests/neo4j/TestLinkage.java > > I made to use both neo4j and bdb to do the same thing, that is: > > create nodes(uppercase named ones) with these rels: > > ROOT_LIST --> START > > ROOT_LIST --> <half a million unique nodes> > > ROOT_LIST --> MIDDLE > > ROOT_LIST --> <another half a million unique nodes> > > ROOT_LIST --> END > > > > then make both bdb and neo4j check if the following rels exist: > > ROOT_LIST --> START > > ROOT_LIST --> MIDDLE > > ROOT_LIST --> END > > (you probably saw this already in another post) > > But both bdb and neo4j now use transactions... that is, in my test file. > > > > About licensing, I'm not much into that but here's the license for > Berkeley > > DB Java Edition: > > > http://www.oracle.com/technetwork/database/berkeleydb/downloads/jeoslicense-086837.html > > Looks like New(or normal?) BSD license or something ... > > also > > " > > Licensing > > > > Berkeley DB is available under dual license: > > > > - Public license that requires that software that uses the Berkeley DB > > code be free/open source software; and > > - Closed source license for non-open source software. > > > > If your code is not redistributed, no license is required (free for > in-house > > use). > > > > " > > > > from http://www.orafaq.com/wiki/Berkeley_DB#Licensing > > > > > > I would totally use neo4j, if it would be as fast at searches :/ ie. > BTree > > storage of nodes/rels? (guessing) > > > > But having 10mil rels, and seeing BDB checking if A-->B in 0ms, and neo4j > in > > like 0 to 66 to 310 seconds (depending on its position) > > > > is a show stopper for me, especially because I want to base everything on > > just nodes (without properties) and their relationships. ie. make a set > or > > list of things, without having A ---[ENTRY]--> e ---[NEXT] ---> e2 but > > instead A->b->e->c->e2 where b and c are just nodes, and also > > AllEntries->b and AllNexts->c (silly example with such less info tho) > > > > Point is, I would do lots of searches a lot (imagine a real time program > > running on top of nodes/rels, that is it's defined in and can access only > > nodes), this would likely cause those ms to add up to seconds... > > > > > > I installed maven (m2e) again, I guess I could use it, but it seems it > > creates .jar , not sure if that's useful to me while I am coding... seems > > better to use project/sources no? and maven only when ready to > publish/get > > the jar ; anyway I need to learn how to use it otherwise I'm getting > errors > > like this , when trying to build: > > > > [ERROR] The project org.neo4j:neo4j-graph-collections:1.5-SNAPSHOT > > (E:\wrkspc\graph-collections\pom.xml) has 1 error > > [ERROR] Non-resolvable parent POM: The repository system is offline > but > > the artifact org.neo4j:parent-central:pom:21 is not available in the > local > > repositor > > y. and 'parent.relativePath' points at wrong local POM @ line 4, column > 11 > > -> [Help 2] > > > > > > > > Anyway, with normal eclipse, I'm still showing 2 different errors: > > > > 1) in org.neo4j.collections.graphdb.ComparablePropertyType<T> > > > > line 29: super(name, graphDb); > > > > The constructor PropertyType<T>(String, GraphDatabaseService) is not > visible > > > > 2) org.neo4j.collections.graphdb.impl.NodeLikeImpl.getRelationships() > > The return type is incompatible with > > RelationshipContainer.getRelationships() > > > > 3) > > > org.neo4j.collections.graphdb.impl.NodeLikeImpl.getRelationships(RelationshipType...) > > The return type is incompatible with > > RelationshipContainer.getRelationships(RelationshipType[]) > > > > > > John. > > > > On Thu, Jul 28, 2011 at 12:52 PM, Niels Hoogeveen < > [email protected] > > > wrote: > > > > > > > > Hi John, > > > Thanks for showing an interest. > > > The compile error you got was due to the fact that a removed class was > > > still hanging around in the Git repo. I renamed BinaryRelationshipRoles > into > > > BinaryRelationshipRole, but the original file was still active in the > Git > > > repo. I fixed that. > > > I have been thinking about BDB too for this situation, because the > graph > > > database now stores some information about the associated nodes and > their > > > reverse lookup. This of course polutes the name/node space. It would be > neat > > > to offload this book keeping information to some persistent hashmap, so > the > > > implementation is completely transparent to the user. > > > I don't know how nicely BDB plays with Neo4J transactions. Does anyone > have > > > experience with this? > > > Another aspect is licencing. I am no legal buff, so maybe someone else > can > > > jump in and answer this. > > > Personally, I don't mind adding BDB as a dependency, but it has to work > > > well at the transaction level and licence wise, otherwise it's a no go > for > > > me. > > > I would recommend you to start using maven. There is an Eclipse plugin > > > m2eclipse, which allows you to use/maintain Maven projects from within > > > Eclipse. > > > Niels > > > > > > > Date: Thu, 28 Jul 2011 05:09:54 +0200 > > > > From: [email protected] > > > > To: [email protected] > > > > Subject: Re: [Neo4j] HyperRelationship example > > > > > > > > Hey Niels, > > > > > > > > I like xD > > > > this seems like a lot of work and professionally done; ie. something > I > > > could > > > > not have done (I don't have that kind of experience and focus). Gratz > on > > > > that, I really appreciate seeing this. > > > > > > > > I cloned the repo from git, manually, with eclipse (not using maven - > > > don't > > > > know how with eclipse) > > > > I am getting only about 3 compile errors, like: > > > > 1) The type BinaryRelationshipRoles<T> must implement the inherited > > > abstract > > > > method PropertyContainer.getId() > > > > 2) The constructor PropertyType<T>(String, GraphDatabaseService) is > not > > > > visible > > > > 3) The return type is incompatible with > > > > RelationshipContainer.getRelationships() > > > > for > > > > > > > > org.neo4j.collections.graphdb.impl.RelationshipIterable.RelationshipIterable(Iterable<Relationship> > > > > rels) > > > > > > > > > > > > Also, I am thinking to try and implement this on top of berkeleydb > just > > > > for fun/benchmarking (so to speak) to compare between that and neo4j > - > > > since > > > > I am currently unsure which one to use for my hobby project (I like > that > > > > berkeleydb's searches are 0-1ms instead of few seconds) > > > > > > > > Btw, would it be any interest to you if I were to fork your repo and > add > > > ie. > > > > AllTests.java for junit and the .project and related files for > eclipse > > > > project in a pull or two ? as long as it doesn't seem useless or > > > > cluttering... (note however I never actually, yet, used fork&pull but > > > only > > > > read about it on github xD) > > > > > > > > Thanks to all, for wasting some time reading this, > > > > Greeting and salutations, > > > > John > > > > > > > > On Wed, Jul 27, 2011 at 8:48 PM, Niels Hoogeveen > > > > <[email protected]>wrote: > > > > > > > > > > > > > > I just posted an example on how to use HyperRelationships: > > > > > > > > > > > > > > > > > > > https://github.com/peterneubauer/graph-collections/wiki/HyperRelationship-example > > > > > > > > > > There is now a proper test for HyperRelationships, so I hereby push > the > > > > > software to Beta status. > > > > > > > > > > Please try out the Enhanced API and HyperRelationships and let me > know > > > what > > > > > needs improvement. > > > > > > > > > > Niels > > > > > _______________________________________________ > > > > > Neo4j mailing list > > > > > [email protected] > > > > > https://lists.neo4j.org/mailman/listinfo/user > > > > > > > > > _______________________________________________ > > > > Neo4j mailing list > > > > [email protected] > > > > https://lists.neo4j.org/mailman/listinfo/user > > > > > > _______________________________________________ > > > Neo4j mailing list > > > [email protected] > > > https://lists.neo4j.org/mailman/listinfo/user > > > > > _______________________________________________ > > Neo4j mailing list > > [email protected] > > https://lists.neo4j.org/mailman/listinfo/user > > _______________________________________________ > Neo4j mailing list > [email protected] > https://lists.neo4j.org/mailman/listinfo/user > _______________________________________________ Neo4j mailing list [email protected] https://lists.neo4j.org/mailman/listinfo/user
