I think for such a scenario you'd need read locks which gets upgraded to
write locks when modifying. Consider this simple scenario w/o read locks:
Thread ONE: get relationship R
Thread TWO: get relationship R
Thread TWO: delete relationship R and commit transaction
Thread ONE: do any modification
I'm definitely modifying the graph at the same time; that's why this is
happening. But my assumption was that that shouldn't be breaking Neo4j -- I
thought requests are transactional/serialized.
I don't have a repro test at the moment, but the behavior is really simple.
Here's an example analogy.
On Sun, Nov 20, 2011 at 10:43 PM, Andres Taylor
andres.tay...@neotechnology.com wrote:
Cypher in 1.4 was very experimental. If you are using Cypher, I would
suggest you move to 1.5 ASAP - a lot has happened there. If you still have
the same problems with 1.5, then we can start looking for the
Mattias, thanks for the suggestion, but to clarify, we're using the server
as-is, with the REST API; we're not using the Java API. Is there any way we
can specify locking like you suggest via the server config or similar?
Aseem
On Mon, Nov 21, 2011 at 12:26 AM, Mattias Persson
One more point of clarification: these are concurrent REST API requests.
One request is deleting a relationship, another request is querying for
a(nother) relationship.
A simple analogy is a user unliking one thing on Facebook then immediately
liking something else.
I wouldn't expect the
Hi there! Continuing our trials with neo4j, I need to load a reasonable
amount of data (250k nodes + 20M relationships) into a neo server.
This data lives in a mySQL db and a mongodb.
For obvious reasons I'm not going to use the REST API for that, but I'd
also would like to avoid using a plugin
Vinicius,
doing the import in Java is a VERY sane idea, go for it. As for the custom
IDs, we are goind to address the issue further down the roadmap, for now I
think an index is your best option since these are non-scalar values if I
understand it right?
For my next lab day, I would love to test
2011/11/21 Aseem Kishore aseem.kish...@gmail.com
One more point of clarification: these are concurrent REST API requests.
One request is deleting a relationship, another request is querying for
a(nother) relationship.
A simple analogy is a user unliking one thing on Facebook then immediately
Vinicius,
as Peter said, good idea.
Please try to avoid lucene index lookups during the import (use a hashmap cache
String, Node or String,Long instead).
If you want to have ultrafast import, please use the batch-inserter API,
for an example look here: https://gist.github.com/1375679
Cheers
Thank you both for helping out. This list is just the best :D
Michael I was considering that, now that you said, I'm definitely going to
do it, use a hashmap to store the nodes as they get inserted, and then
lookup there to create the relations.
I'll have a look at the batch-inserter thanks.
Sounds great, if you need any help just ping me.
Yes read performance should soar,
are the numbers you provided (250k nodes + 20M relationships) your real dataset
or what is the data amount that you think you see in production.
You can also answer that off-list :) (to Peter and me).
Cheers
Daniel,
I updated the project to Neo4j 1.5 GA. Could you try building again,
and contact me with the build log?
Cheers,
/peter neubauer
GTalk: neubauer.peter
Skype peter.neubauer
Phone +46 704 106975
LinkedIn http://www.linkedin.com/in/neubauer
Twitter
Hi,
I was wondering whether there's (or are any plans to implement) any way to
export sub-graphs to graphml/gexf files?
I did a quick google search and found this:
http://stackoverflow.com/questions/2204440/convert-neo4j-db-to-xml
However I think it'd be better being able to do this as part of
It is probably best to export a set of paths as a subgraph as they are returned
from cypher and the traversal framework.
And it is trivial to handle a single node as Path[0] or Path[1]
and a single relationship as Path[1].
I don't think that it would be a part of core but rather a additional
Yobi,
the Heroku integration is backed by a Heroku-independent Neo4j hosting
architecture, so we should be able to provide integration to Nodejitsu
as well, however we have not looked at it yet. Got everything else
working so far from Node.js?
Cheers,
/peter neubauer
GTalk: neubauer.peter
I like,
got any feedback yet?
Cheers,
/peter neubauer
GTalk: neubauer.peter
Skype peter.neubauer
Phone +46 704 106975
LinkedIn http://www.linkedin.com/in/neubauer
Twitter http://twitter.com/peterneubauer
http://www.neo4j.org - NOSQL for the Enterprise.
Hi Peter,
I guess the meta-inf entry for the org.neo4j.kernel.KernelExtension is still
missing. The repo URL https://github.com/neo4j/spatial.git is correct? It
states last commit was 4 days ago...
The build ends with error: http://dl.dropbox.com/u/18693700/git21.txt
Daniel
--
View this
Thankz for the reply Jim.
--
View this message in context:
http://neo4j-community-discussions.438527.n3.nabble.com/Neo4j-server-plugin-tp3521193p3524589.html
Sent from the Neo4j Community Discussions mailing list archive at Nabble.com.
___
Neo4j
I think we could start small, and add stuff as we go. Have added some
comments in there. Everyone, feel free to contribute!
Cheers,
/peter neubauer
GTalk: neubauer.peter
Skype peter.neubauer
Phone +46 704 106975
LinkedIn http://www.linkedin.com/in/neubauer
Twitter
Daniel,
that setup works for me, would we connect via Skype to sort it out?
What JDK are you using?
[~/code/neo/spatial] $mvn clean compile
[INFO] Scanning for projects...
[WARNING]
[WARNING] Some problems were encountered while building the effective
model for
Yes Micheal will get inputs from the code and will derive some solution.
Shireesh.
--
View this message in context:
http://neo4j-community-discussions.438527.n3.nabble.com/Neo4j-server-plugin-tp3521193p3524607.html
Sent from the Neo4j Community Discussions mailing list archive at Nabble.com.
Everyone,
have started to put in some random people in, see
http://docs.neo4j.org/chunked/snapshot/contributors.html .
Any ideas what more info to provide here, or how to make this nicer?
Cheers,
/peter neubauer
GTalk: neubauer.peter
Skype peter.neubauer
Phone +46 704 106975
Andrew,
I think you could set up the Webadmin over your embedded project like
http://docs.neo4j.org/chunked/snapshot/server-embedded.html maybe as
part of a unit test, and then start modifying the layout using the
coffeescript and template infrastructure under
Yes,
that is a very cool post. Also, related to Activity Streams, Rene
Pickard has come up with great algo that uses a LOT of relationship
types to make the acitivity streams read-scale:
Cres,
yes, that is a valid assumption. If you have long-running
transactions, you might switch to a more diff-based model instead of
locking parts of the graph. Rickard Öberg and Niclas Hedhman have done
a lot of good work on these thoughts over at www.qi4j.org, maybe there
are some good answers
Martin,
for storing times, you could try the timeline index in graph
collections if things are not too long linked, see
https://github.com/neo4j/graph-collections/blob/master/src/test/java/org/neo4j/collections/timeline/TestTimeline.java
or some of the other indexes in that component.
Would that
You might even be interested in Rene Pickards work on a full solution
(albeit with some write-time overhead), see
http://www.rene-pickhardt.de/graphity-an-efficient-graph-model-for-retrieving-the-top-k-news-feeds-for-users-in-social-networks/
Cheers,
/peter neubauer
GTalk: neubauer.peter
Dieter,
maybe you could raise an issue and add the info?
Cheers,
/peter neubauer
GTalk: neubauer.peter
Skype peter.neubauer
Phone +46 704 106975
LinkedIn http://www.linkedin.com/in/neubauer
Twitter http://twitter.com/peterneubauer
http://www.neo4j.org -
So,
are you talking about the performance on a supernode, or on an
arbitrary set of 1M relationships from e.g. a variable length Cypher
query?
Cheers,
/peter neubauer
GTalk: neubauer.peter
Skype peter.neubauer
Phone +46 704 106975
LinkedIn http://www.linkedin.com/in/neubauer
There should be milstones available now, see
http://www.springsource.org/spring-data/neo4j#maven
Cheers,
/peter neubauer
GTalk: neubauer.peter
Skype peter.neubauer
Phone +46 704 106975
LinkedIn http://www.linkedin.com/in/neubauer
Twitter http://twitter.com/peterneubauer
Daniel,
there is the ImpertmanentGraphDatabase,
https://github.com/neo4j/community/blob/master/kernel/src/test/java/org/neo4j/test/ImpermanentGraphDatabase.java
that you could use just to test in-memory out, since it does abstract
away the file system layer. Would be interesting to see if you can
Something like
http://docs.neo4j.org/chunked/snapshot/query-where.html#where-filter-on-null-valuesmaybe?
/peter
Sent from my phone, please excuse typos and autocorrection.
On Nov 21, 2011 5:14 PM, Spektrum 800megah...@gmail.com wrote:
Suppose there are two types of nodes: Entry node and
Hi Peter,
I have JDK 1.7.0_01 on a Windows 7 64bit machine. After I added the
missing meta-inf entry org.neo4j.kernel.KernelExtension I could build the
project. Now I have a few more problems. I can run the tests for the
DynamicLayers and OSMImport without failure but then I am stuck at the
Hi Jacob,
If you have the choice, Linux is preferable. We fully support both
platforms, but generally get higher performance on Linux, and less
problems.
Is there a Linux operating system that you can recommend?
This completely depends on how much data you intend to store. Can you
provide
Hi José Devezas,
Thank's to send the link to the calculator.
If you're not doing a batch insertion, the REST API would be fine I guess,
specially if you put the database on a separate machine.
This is exactly what I intend to do, the database will be in separate server
application and is
Hi Gustavo, I had some questions with the batch insert as well. After
getting help here :D What I'm doing is using the batchInserterImpl to load
the neo instance, I'll use the REST API later for querying.
So far, our lab has a neo4j instance running in a single node blade server
with tons of RAM
Could you please try with jdk1. 6? We have an incompatibility there, so it
would help if you can try it out.
/peter
Sent from my phone, please excuse typos and autocorrection.
On Nov 21, 2011 6:01 PM, danielb danielbercht...@gmail.com wrote:
Hi Peter,
I have JDK 1.7.0_01 on a Windows 7 64bit
Hi Vinicius,
Where are you from? have you a email contact?
--
View this message in context:
http://neo4j-community-discussions.438527.n3.nabble.com/URGENT-Recommended-server-configurations-tp3519328p3525431.html
Sent from the Neo4j Community Discussions mailing list archive at Nabble.com.
Vinicius,
My problem is not data load, from what I understand, the batch operation
would be for this? Right?
Further along, but I'll have a load of data, but this is not my primary
concern.
--
View this message in context:
Can you show the relevant parts of your class definitions?
@NodeEntity
class Collection {
@RelatedTo(type=PART_OF, Direction.INCOMING)
SetEntry entries;
}
@NodeEntity class Entry {}
you can do:
CollectionEntry allEntries = template.repositoryFor(Entry.class).findAll()
SetEntry
Hi,
it's the question, how to get the unique set of relationship properties in
the graph, without querying/traversing all of the properties. Since I can
only index nodes/relationships, the index API does not seem to be an option.
Example: 1M relationships, each of them having one of 10 properties
Thanks Peter
Cheers,
From: Peter Neubauer peter.neuba...@neotechnology.com
To: Neo4j user discussions user@lists.neo4j.org
Sent: Monday, November 21, 2011 4:41 AM
Subject: Re: [Neo4j] some questions
Andrew,
I think you could set up the Webadmin over your
Let us know if it works out for you.
/peter
Sent from my phone, please excuse typos and autocorrection.
On Nov 21, 2011 7:58 PM, andrew ton andrewt...@yahoo.com wrote:
Thanks Peter
Cheers,
From: Peter Neubauer peter.neuba...@neotechnology.com
To:
Hi Peter,
JDK 1.6 does the job! But only for building the project. Netbeans still
shows an error for the missing KernelExtension meta-inf, however it does not
prevent from running the OSMImporter. Lucene is still not working, maybe it
has something to do with that error which is at the
This is very interesting -- thanks Peter for the link, and thanks
maxdemarzi for starting this conversation.
In our social network -- which has extremely little load, it's just in beta
-- we currently use basically (a), and it works just fine. We use Cypher to
do the sorting/trimming on the
You might also want to take a look at the videos from the Twitter presentations
from QCon London.
-Original Message-
From: user-boun...@lists.neo4j.org [mailto:user-boun...@lists.neo4j.org] On
Behalf Of Aseem Kishore
Sent: Monday, November 21, 2011 4:43 PM
To: Neo4j user discussions
Tried Eclipse Java Edition and it seems that everything is working as it
should. I could at least start an OSMImport to an embedded database and
nodes were copied. I will have a detailed look tomorrow.
I still have a few problems with the Neo4j server itself. When I try to
batchinsert I get the
A couple of things bothered me about Rene's approach.
1. Custom Neo4j that could handle lots of relationship types. Not 100% sure
where this fits?
2. Performance drops like a bomb when K (the number of items retrieved)
increases.
So it kind of works to get the top 15 items... A twitter stream
--
Tatham Oddie
Tiny keyboard = tiny message
Begin forwarded message:
From: Tatham Oddie
tatham.od...@readify.onmicrosoft.commailto:tatham.od...@readify.onmicrosoft.com
Date: 22 November 2011 14:43:00 AEDT
To: tat...@oddie.com.aumailto:tat...@oddie.com.au
I've been playing with OSMImporter; tried batch and native java. I've had
mixed success trying to import the planet, but since it's of considerable
size, the job usually blows up or grinds to a halt about half way. I think
the most I've made it to is 651M nodes and that's not even the ways or
I agree.
Sending arbitrary Groovy is not what you want a database to execute. Do you
see any good index - neutral way to expose this? It's even very relevant to
Cypher...
/peter
Sent from my phone, please excuse typos and autocorrection.
On Nov 22, 2011 4:46 AM, Tatham Oddie tat...@oddie.com.au
51 matches
Mail list logo
