Re: [Neo4j] Are graphs ok for lots of Event data

2011-12-07 Thread Craig Taverner
Of course the graph can be used for processing event data, and whether that works for your case or not depends. But we have used it for this, and I can discuss a few points. The event stream is obviously just a linear chain and can be modeled as such in the graph (eg. with NEXT relationships

Re: [Neo4j] path finding using OSM ways

2011-12-07 Thread Craig Taverner
We do indeed have twice the node count (and twice the relationship count). This is a necessary side effect of the fact that an OSM node can participate in more than one way (at intersections as well as shared edges of polygons, etc.). In addition, with shared edges the direction can be reversed

Re: [Neo4j] Feedback requested: Major wish list item for Neo4J

2011-12-07 Thread Craig Taverner
I definitely second this suggestion. We have recently being working on a binary store for dense data we would like to access as if they were properties of nodes. Right now we have properties that are references to files on disk, and then handle the binary ourselves, but this does not benefit from

Re: [Neo4j] OSMImporter: Is there a way to do incremental imports?

2011-12-06 Thread Craig Taverner
There was only a method ending in 'WithCheck', or something like that, lying unused in the code from last year. Nothing more than that. Except for thinking about it, which is why I wrote the previous mail. On Dec 2, 2011 12:50 PM, Peter Neubauer pe...@neubauer.se wrote: Not sure, Craig, do you

Re: [Neo4j] possibility to merge some neo4j databases?

2011-11-29 Thread Craig Taverner
There are two approaches I can think of: - use a better index for mapping ids. Lucent is too slow. Memory hashtables are memory bound.Peter has been investigating alternative dbs like bdb. I tried, but did not finish a hashmap of cached arrays, and Chris wrote his big data import project on

Re: [Neo4j] Contributors section in the manual

2011-11-29 Thread Craig Taverner
What is the sort order? Date of first commit, number of lines, commits, packages? On Nov 21, 2011 2:35 PM, Peter Neubauer peter.neuba...@neotechnology.com wrote: Everyone, have started to put in some random people in, see http://docs.neo4j.org/chunked/snapshot/contributors.html . Any ideas

Re: [Neo4j] OSMImporter: Is there a way to do incremental imports?

2011-11-22 Thread Craig Taverner
I did some initial work on incremental imports back in 2010, but stopped due to some complications: - We needed to mix lucene reads and writes during the import (read to check if the node already exists, so we don't import twice) and this performs very badly in the batch inserter. We

Re: [Neo4j] osm_import.rb

2011-11-11 Thread Craig Taverner
Hi, Sorry for a late contribution to this discussion. I will try make a few comments to cover the various mails above. Firstly, the neo4j-spatial.rb GEM at version 0.0.8 on RubyGems works with Neo4j-Spatial 0.6, which does include the non-batch inserter code, so in principle should work for you.

Re: [Neo4j] Neo4j low-level data storage

2011-10-07 Thread Craig Taverner
I think Daniels questions are very relevant, but not just to OSM. Any large graph (of which OSM is simply a good example) will be affected by fragmentation, and that can affect performance. I recently was hit by performance of GIS queries (not OSM) related to fragmentation of the index tree. I

Re: [Neo4j] Neo4j in GIS Applications

2011-10-07 Thread Craig Taverner
Hi all, I am certainly behind on my emails, but I did just answer a related question about OSM and fragmentation, and I think that might have answered some of Daniels questions. But I can say a little more about OSM and Neo4j here, specifically about the issue of joins in postgres. Let me start

Re: [Neo4j] Problem Installing Spatial (Beginner)

2011-10-07 Thread Craig Taverner
Sorry for such a late response, I missed this mail. I must first point out that it seems you are trying to use Neo4j-Spatial in the standalone server version of Neo4j. That is possible, but not well supported. We have only exposed a few of the functions in the server, and do not test it

Re: [Neo4j] Spatial query with property filter

2011-08-29 Thread Craig Taverner
I can elaborate a little on what Peter says. The DynamicLayer support is indeed the only way to do what you want right now, but I think it is actually quite a good fit for your use case. When defining a dynamic layer you are actually just defining a 'returnable evaluator', which will be applied to

Re: [Neo4j] neo4j spatial and postgis

2011-08-13 Thread Craig Taverner
Or if you want a command line import, try the ruby gem 'neo4j-spatial.rb'. Once installed you can type: osm_import file.shp On Aug 13, 2011 10:33 AM, Andreas Wilhelm a...@kabelbw.de wrote: Hi, with the pgsql2shp tool you can dump your postgis db in a shapefile and you should be able to import

Re: [Neo4j] Neo4j Spatial and gtype property

2011-07-29 Thread Craig Taverner
at 10:50 PM, Craig Taverner cr...@amanzi.com wrote: Actually we do allow multiple geometry types in the same layer, but some actions, like export to shapely, will fail. We even test for this in TestDynamicLayers. You can use the gtype if you want, but it is specific to some

Re: [Neo4j] Neo4j Spatial and gtype property

2011-07-27 Thread Craig Taverner
Actually we do allow multiple geometry types in the same layer, but some actions, like export to shapely, will fail. We even test for this in TestDynamicLayers. You can use the gtype if you want, but it is specific to some GeometryEncoders, and might change in future releases. It would be better

Re: [Neo4j] How often are Spatial snapshots published?

2011-07-22 Thread Craig Taverner
Interesting that if you look at the github 'blame' for that file (see https://github.com/neo4j/neo4j-spatial/blame/master/src/main/java/org/neo4j/gis/spatial/SpatialTopologyUtils.java), you find that all the findClosestEdges methods where added in October 2010. So if Nolan has a version older than

Re: [Neo4j] How to create a graph database out of a huge dataset?

2011-07-19 Thread Craig Taverner
I'm not sure it's such a good idea to call tx.success() on every iteration of the loop. I suggest call it only in the commit, and after the loop (ie. move it two lines down). Also I think a commit size of 50k it a little large. You're probably not going to see much improvement past 10k. In fact I

Re: [Neo4j] Neo4j Spatial - Keep OSM imports - Use in GeoServer

2011-07-12 Thread Craig Taverner
isn't with the DB. Thanks, Robin Cura 2011/7/9 Craig Taverner cr...@amanzi.com Another option is to run the main method of OSMImport class, which expects command line arguments for database location and OSM file, and will simply import a file once. This is not tested often, so there is a risk

Re: [Neo4j] Neo4j Spatial - Keep OSM imports

2011-07-08 Thread Craig Taverner
Another option is to run the main method of OSMImport class, which expects command line arguments for database location and OSM file, and will simply import a file once. This is not tested often, so there is a risk things have changed, but it is worth a try. Another, even easier, option in my

Re: [Neo4j] neo4j spatial bounding box vs. lat/lon

2011-07-06 Thread Craig Taverner
can't find the code on github. Thanks! On Sat, Jul 2, 2011 at 6:00 PM, Craig Taverner cr...@amanzi.com wrote: As I understand it, Andreas is working on the much more complex problem of updating OSM geometries. That is more complex because it involves restructuring the connected graph

Re: [Neo4j] GSoC 2011 Neo4j Geoprocessing | Weekly Report #6

2011-07-02 Thread Craig Taverner
Hi Andreas, Sounds like good progress over all. It is only a week to the mid-terms, so it would be good to do a general code overview and see if this can be integrated with trunk. Shall we plan for a review and test integration in the middle of next week? Regards, Craig On Sat, Jul 2, 2011 at

Re: [Neo4j] reify links with other neo4j databases located on different distributed servers

2011-07-02 Thread Craig Taverner
As far as I know there is no internal support for transparent traversals across shards. Generally people are doing that in the application layer. However, I think there might be a middle ground of sorts. I we modify the relationship expander, I could imagine that relationships that are between

Re: [Neo4j] wkb value in node created by addGeometryWKTToLayer

2011-07-02 Thread Craig Taverner
Hi Boris, You do not need to read the property yourself from the node, rather use the GeometryEncoder for this, it converts from the internal spatial storage to the Geometry class, which you can work with. If you call geom.toString() you will get a nice printable version (in WKT). Using the

Re: [Neo4j] neo4j spatial bounding box vs. lat/lon

2011-07-02 Thread Craig Taverner
! On Wed, Jun 8, 2011 at 4:58 PM, Craig Taverner cr...@amanzi.com wrote: OK. I understand much better what you want now. Your person nodes are not geographic objects, they are persons that can be at many positions and indeed move around. However, the 'path' that they take is a geographic

Re: [Neo4j] neo4j spatial bounding box vs. lat/lon

2011-07-02 Thread Craig Taverner
, Craig Taverner cr...@amanzi.com wrote: Hi Boris, Ah! You are using the REST API. That changes a lot, since Neo4j Spatial is only recently exposed in REST and we do not expose most of the capabilities I have discussed in this thread, or indeed in my other answer today. I did

[Neo4j] Cypher error in neo4j-spatial

2011-07-02 Thread Craig Taverner
Hi, Recent builds of Neo4j-Spatial no longer like Peters new bounding box query. Peter is on vacation, and I am not familiar with the code (nor cypher), so I thought I would just dump the error message here for now in case someone can give me a quick pointer. The line of code is: Query query =

Re: [Neo4j] traversing densely populated nodes

2011-06-30 Thread Craig Taverner
This topics has come up before, and the domain level solutions are usually very similar, like Norbert's category/proxy nodes (to group by type/direction) and Niels' TimeLineIndex (BTree). I wonder whether we can build a generic user-level solution that can also be wrapped to appear as an internal

Re: [Neo4j] Database engine using Neo4j

2011-06-30 Thread Craig Taverner
Hi Kriti, I can comment on a few things, especially neo4j-spatial: - Neo4j is certainly good for social networks, and people have used it for that, but I personally do not have experience with that so I will not comment further (others can chip in where necessary). - Neo4j-Spatial is

Re: [Neo4j] traversing densely populated nodes

2011-06-30 Thread Craig Taverner
In the amanzi-index I link all indexed nodes into the index tree, so traversals are straight up the tree. Of course this also means that there are at least as many relationships as indexed nodes. I was reviewing Michaels code for the relationship expander, and think that is a great idea,

Re: [Neo4j] neo4j-graph-collections

2011-06-29 Thread Craig Taverner
I have previously used two solutions to deal with multiple types in btrees: - My first index in 2009 was a btree-like n-dim index using generics to support int[], long[], float[] and double[] (no strings). I used this for TimeLine (long[1]) and Location (double[2]). The knowledge about

Re: [Neo4j] neo4j-graph-collections

2011-06-29 Thread Craig Taverner
It is technically possible, but it is a somewhat specialized index, not a normal BTree, so I think you would want both (mine and a classic btree). My index performs better for certain data patterns, is best with semi-ordered data and moderately even distributions (since it has no rebalancing), and

Re: [Neo4j] neo4j-graph-collections

2011-06-29 Thread Craig Taverner
I think moving the RTree to the generic collections would not be too hard. I saw Saikat showed interested in doing this himself. Saikat, contact me off-list for further details on what I think could be done to make this port. On Wed, Jun 29, 2011 at 9:52 PM, Niels Hoogeveen

Re: [Neo4j] neo4j-graph-collections

2011-06-28 Thread Craig Taverner
The RTree in principle should be generalizable, but the current implementation in neo4j-spatial does make a few assumptions specific to spatial data, and makes use of spatial envelopes for the tree node bounding boxes. It is also specific to 2D. We could make a few improvements first, like

Re: [Neo4j] cassandra + neo4j graph

2011-06-27 Thread Craig Taverner
Hi, I can comment on the spatial side. The neo4j-spatialhttps://github.com/neo4j/neo4j-spatiallibrary provides some tools for doing spatial analysis on your data. I do not know exactly what you plan to do, but since you mention user and place locations, I guess you are likely to be asking the

Re: [Neo4j] Recent slowdown in imports with lucene

2011-06-26 Thread Craig Taverner
if I can find some culprit for this. But again, a little more information would be useful, as always. 2011/6/26 Craig Taverner cr...@amanzi.com Hi, Has anyone noticed a slowdown of imports into neo4j with recent snapshots? Neo4j-spatial importing OSM data (which uses lucene to find

Re: [Neo4j] Recent slowdown in imports with lucene

2011-06-26 Thread Craig Taverner
back to 5000 increased the node creation rate to nearly 1 (over 100 times faster). That is a serious improvement. Sorry again for wasting space on the list. I'm glad this was a user error, though, not a neo4j issue :-) Regards, Craig On Mon, Jun 27, 2011 at 12:54 AM, Craig Taverner cr

[Neo4j] Recent slowdown in imports with lucene

2011-06-25 Thread Craig Taverner
Hi, Has anyone noticed a slowdown of imports into neo4j with recent snapshots? Neo4j-spatial importing OSM data (which uses lucene to find matching nodes for ways) is suddenly running much slower than usual on non-batch imports. For most of my medium sized test cases, I normally have surprisingly

Re: [Neo4j] Neo4j -- Can it be embedded in Android?

2011-06-24 Thread Craig Taverner
I heard that Peter Neubauer made a port of neo4j to android a few years ago, but that nothing has been done since and no version since then would work. So my understanding is that it does not work on android, but that it is possible to make it work (with some work ;-). Peter is away, but I expect

Re: [Neo4j] Neo4j -- Can it be embedded in Android?

2011-06-24 Thread Craig Taverner
that Android exposes. -Original Message- From: user-boun...@lists.neo4j.org [mailto:user-boun...@lists.neo4j.org] On Behalf Of Craig Taverner Sent: Friday, June 24, 2011 8:37 AM To: Neo4j user discussions Subject: Re: [Neo4j] Neo4j -- Can it be embedded in Android? I heard

Re: [Neo4j] neo4j-spatial roadmap/stability

2011-06-23 Thread Craig Taverner
Hi Christopher, Thanks for your interest in neo4j and neo4j-spatial. I will answer your questions and comments inline. I am working for the largest German speaking travel and holiday portal. Currently we are using a relatively simple MySQL based spatial distance functionality. We plan to

Re: [Neo4j] More spatial questions

2011-06-19 Thread Craig Taverner
Hi Nolan, I think I can answer a few of your questions. Firstly, some background. The graph model of the OSM data is based largely on the XML formated OSM documents, and there you will find 'nodes', 'ways', 'relations' and 'tags' each as their own xml-tag, and as a consequence each will also have

Re: [Neo4j] Auto Indexing for Neo4j

2011-06-18 Thread Craig Taverner
performance graph database. http://startupbootcamp.org/- Ă–resund - Innovation happens HERE. http://www.thoughtmade.com - Scandinavia's coolest Bring-a-Thing party. On Tue, Jun 14, 2011 at 5:49 PM, Craig Taverner cr...@amanzi.com wrote: This is great news. Now I'm really curious about

Re: [Neo4j] Slow Traversals on Nodes with too many Relationships

2011-06-15 Thread Craig Taverner
Could this also be related to the possibility that in order to determine relationship type and direction, the relationships need to be loaded from disk? If so, then having a large number of relationships on the same node would decrease performance, if the number was large enough to affect the disk

Re: [Neo4j] Most Efficient way to query in my use cases

2011-06-15 Thread Craig Taverner
Another common thing to do in this case is create a node for the purchase action. This node would be related to the purchaser (user), item (pen) and shop, and would contain data appropriate to the purchase (date/time, price, etc). Then traverse from the shop or the pen to all purchase actions

Re: [Neo4j] Slow Traversals on Nodes with too many Relationships

2011-06-15 Thread Craig Taverner
I understood that on windows the memory mapped sizes needed to be included in the heap, since they are not allocated outside the heap as they are on linux/mac. So in this case he needs a larger heap (and make sure the memory mapped files are much smaller than the heap). The relevant part of the

Re: [Neo4j] Auto Indexing for Neo4j

2011-06-14 Thread Craig Taverner
This is great news. Now I'm really curious about the next step, and that is allowing indexes other than lucene. For example, the RTree index in neo4j-spatial was never possible to wrap behind the normal index API, because that was designed only for properties of nodes (and relationships), but the

Re: [Neo4j] Traversals versus Indexing

2011-06-13 Thread Craig Taverner
Think of your domain model graph as a kind of index. Traversing that should generally be faster than a generic index like lucene. Of course some things do not graph well, and you should use lucene for those. But if you can find something with a graph traversal, that is likely the way to go. Also

Re: [Neo4j] neo4j-spatial

2011-06-09 Thread Craig Taverner
Hi Saikat, Yes, your explanation was clear, but I was busy with other work and failed to repond - my bad ;-) Anyway, your idea is nice. And I can think of a few ways to model this in the graph, but at the end of the day the most important thing to decide first is what queries are you going to

Re: [Neo4j] neo4j spatial bounding box vs. lat/lon

2011-06-08 Thread Craig Taverner
this with REST? Thanks! On Tue, Jun 7, 2011 at 11:34 AM, Craig Taverner cr...@amanzi.com wrote: Hi, The bounding boxes are used by the RTree index, which is a typical way to index spatial data. For Point data, the lat/long and the bounding box are the same thing

Re: [Neo4j] neo4j spatial bounding box vs. lat/lon

2011-06-07 Thread Craig Taverner
Hi, The bounding boxes are used by the RTree index, which is a typical way to index spatial data. For Point data, the lat/long and the bounding box are the same thing, but for other shapes (streets/LineString and Polygons), the bounding box is quite different to the actual geometry (which is not

Re: [Neo4j] neo4j spatial bounding box vs. lat/lon

2011-06-07 Thread Craig Taverner
of a set of points, rather than individual points. So the query is, find the nodes where the given point falls inside their bounding boxes. Can I do this with REST? Thanks! On Tue, Jun 7, 2011 at 11:34 AM, Craig Taverner cr...@amanzi.com wrote: Hi, The bounding boxes are used by the RTree

Re: [Neo4j] Sample Linear Referencing Functions in Neo4j Spatial and GSoC

2011-06-07 Thread Craig Taverner
://www.neo4j.org - Your high performance graph database. http://startupbootcamp.org/- Ă–resund - Innovation happens HERE. http://www.thoughtmade.com - Scandinavia's coolest Bring-a-Thing party. On Thu, Jun 2, 2011 at 2:13 PM, Craig Taverner cr...@amanzi.com wrote: Hi, Recently

Re: [Neo4j] GSoC 2011 Neo4j Geoprocessing | Weekly Report #2

2011-06-07 Thread Craig Taverner
I suggest you code review them first. Especially since there are API changes. On Tue, Jun 7, 2011 at 10:11 AM, Peter Neubauer peter.neuba...@neotechnology.com wrote: Very nice Andreas! You consider it safe to pull these changes into the main repo? Cheers, /peter neubauer GTalk:

Re: [Neo4j] [SoC] Re: GSoC 2011 Weekly report - OSM data mining and editing capabilities in uDig and Geotools

2011-06-05 Thread Craig Taverner
Hi Mirco, Sounds like progress. Some suggestions: - I do not think you need to change the code for neo4j and udig, but only for neo4j-spatial and udig-community/neo4j. It is OK to make clones of those so you have the code for review, but they are quite core, and you should not need

[Neo4j] Sample Linear Referencing Functions in Neo4j Spatial and GSoC

2011-06-02 Thread Craig Taverner
Hi, Recently someone asked a question on StackOverflow, if Neo4j Spatial was capable of one of the Oracle geoprocessing funtions, SDO_LRS.LOCATE_PT specifically. Since this is related to the ongoing GSoC projects for Neo4j Spatial, I thought I would do a quick investigation. What I found was that

Re: [Neo4j] path finding using OSM ways

2011-05-31 Thread Craig Taverner
Hi Bryce, Nice to see you back. The OSM data model in Neo4j-Spatial, created by the OSMImporter, is designed to mimic the complete contents of the XML files provided for OSM. As it is, this is not ideal for routing because it traces the complete set of nodes for the ways, while for routing you

Re: [Neo4j] Embedded with webadmin

2011-05-25 Thread Craig Taverner
While HA is one option, with two processes 'sharing' a database, one being the server and the other the embedded app, there is another option, and that is to integrate the two apps. If your app is a web-app and also needs to exist in something like jetty or winstone, perhaps you could run both the

Re: [Neo4j] finding nodes between two nodes

2011-05-18 Thread Craig Taverner
If you remove the depth=1, and specify the direction, you can get to the excluded dishes in one traversal: relationships = [{type= answered, direction = outgoing}, {type= excludes, direction = outgoing}] That will simplify the code a lot. It does not get to the safe dishes in one traversal,

Re: [Neo4j] Color suggestions for the Self-Relationship bike shed

2011-05-17 Thread Craig Taverner
What about a system config enabling/disabling loops? Then we could have option 1, but for people that never loops, they can still get the extra loop check by setting the system config option. On Tue, May 17, 2011 at 2:01 AM, Stephen Roos sr...@careerarcgroup.comwrote: We are not going to use

Re: [Neo4j] Timeline index

2011-05-09 Thread Craig Taverner
Very good points. But I must admit that there is a demand for automatic indexing. I personally am not using it, but I would like prepared indexes, indexes that can be configured up front and then just add the node. I see your point about this implying more schema (in the index preparation), but I

Re: [Neo4j] Timeline index

2011-05-09 Thread Craig Taverner
I'm confident that given the history of neo4j, there will be no forcing of a schema :-) And I'm thinking of previous developments that added convenience and value, like jo4neo, neo4j.rb, even the meta-model. Useful, but no-one was ever forced or even pushed to use them. I hope the new automatic

Re: [Neo4j] First-class type property on relationships but not nodes; why?

2011-05-05 Thread Craig Taverner
Another view of things would be to say that ideally there should be no first class type on either relationships or nodes, since that is a domain specific concept (as Neils says he wants two types, but Rick wants one, and some object models type nodes by relating them to a separate node

Re: [Neo4j] Examples of multiple indices in use?

2011-05-05 Thread Craig Taverner
This is how we use it, for performance, since some data will be much more dense than other data, we don't want the index lookup of the sparse data to be impacted by the dense data, we make separate indexes. On Thu, May 5, 2011 at 3:47 PM, Peter Hunsberger peter.hunsber...@gmail.com wrote: On

Re: [Neo4j] Lucene/Neo Indexing Question

2011-05-02 Thread Craig Taverner
Thinking back you your original domain description, cars with colors, surely you have more properties than just colors to index? If you have two or more properties, then you use combinations of properties for the first level of the index tree, which provides your logical partitioning of

[Neo4j] Geoprocessing with Neo4j Spatial and OSM

2011-05-02 Thread Craig Taverner
Hi all, I have applied to FOSS4G to talk about Geoprocessing with Neo4j Spatial and OSM. This talk will include the new work we've done on the open street map model. In addition, we got two GSoC students this year, on related projects OSM Editor and Geoprocessing with OSM, and so they are likely

Re: [Neo4j] New blog post on non-graph stores for graph-y things

2011-04-26 Thread Craig Taverner
On foreign key I think it was a subconscious choice to avoid it, since it has very strong semantics in other data models. I wanted to try to convey the concept of pointers without muddying that with the stricter semantics of foreign keys and referential integrity. Perhaps I'm

Re: [Neo4j] New blog post on non-graph stores for graph-y things

2011-04-24 Thread Craig Taverner
Hi Jim, As always, I enjoyed reading your blog. It was well written and made the point (including even a plug in the last line ;-) While Aseem's observations are valid, I think you handled it correctly, with the product recall example being only a relatively small win for graph databases, and

Re: [Neo4j] REST results pagination

2011-04-22 Thread Craig Taverner
Good catch, forgot to add the in-graph representation of the results to my mail, thanks for adding that part. Temporary (transient) nodes and relationships would really rock here, with the advantage that with HA you have them distributed to all cluster nodes. Certainly Craig has to add some

Re: [Neo4j] REST results pagination

2011-04-21 Thread Craig Taverner
I can only think of a few use cases where loosing some of the expected result is ok, for instance if you want to peek at the result. IMHO, paging is, by definition, a peek. Since the client controls when the next page will be requested, it is not possible, or reasonable, to enforce that the

Re: [Neo4j] REST results pagination

2011-04-21 Thread Craig Taverner
I think Jim makes a great point about the differences between paging and streaming, being client or server controlled. I think there is a related point to be made, and that is that paging does not, and cannot, guarantee a consistent total result set. Since the database can change between pages

Re: [Neo4j] REST results pagination

2011-04-20 Thread Craig Taverner
to sort (and use the database cursor approach to avoid loading the result set into memory). On Wed, Apr 20, 2011 at 2:01 PM, Jacob Hansson ja...@voltvoodoo.com wrote: On Wed, Apr 20, 2011 at 11:25 AM, Craig Taverner cr...@amanzi.com wrote: I think sorting would need to be optional, since

Re: [Neo4j] How to combine both traversing and index queries?

2011-04-19 Thread Craig Taverner
Another approach to this problem is to consider that an index is actually structured as a graph (a tree), and so if you write the tree into the graph together with your data model, you can combined the index and the traversal into a pure graph traversal. Of course, it is insufficient to simply

Re: [Neo4j] Neo4J Spatial - issue with bounding box indices in OSM Layer.

2011-03-31 Thread Craig Taverner
Hi Robert, I took a look at this and the issue is that you are using the OSMGeometryEncoder to decode the RTree nodes. And the GeometryEncoder is designed to be specific to your data model, while the RTree internal data is hard-coded into the RTree design. So there is no guarantee that any

Re: [Neo4j] question

2011-03-30 Thread Craig Taverner
I think for that the TimelineIndex interface would have to be extended to be able to hold additional data so that you can do compound queries http://docs.neo4j.org/chunked/milestone/indexing-lucene-extras.html#indexing-lucene-compound to it and get exactly the functionality you're asking

Re: [Neo4j] question

2011-03-30 Thread Craig Taverner
Ok, in fact it shouldn't be a performance downgrade even with large blobs, right? It just depends on whether the queried part refers to an id or similar and that node then is simply connected to the blob. I.e. I extract the blob only when I am sure it is the wanted. Is that what you meant?

Re: [Neo4j] question

2011-03-30 Thread Craig Taverner
That sounds nice. My scenario is something like: I have a centralized database. On the Desktop side I have a workstation on which I do GIS analysis. People want to get a chunk of data of interest, so they can pollute them with their analyses until they are happy. So it is a bit the concept

Re: [Neo4j] question

2011-03-30 Thread Craig Taverner
- From: Craig Taverner cr...@amanzi.com Date: Wed, Mar 30, 2011 7:43 am Subject: [Neo4j] question To: Neo4j user discussions user@lists.neo4j.org I think for that the TimelineIndex interface would have to be extended to be able to hold additional data so that you can do compound

[Neo4j] Google Summer of Code 2011

2011-03-29 Thread Craig Taverner
Hi all, Last year Neo4j was represented in the Google Summer of Code with two successful projects, in collaboration with Gephi and OSGeo. This year we are again interested in supporting GSoC projects within other open source organizations interested in integrating with Neo4j. The

Re: [Neo4j] question

2011-03-28 Thread Craig Taverner
Hi Andrea, I am cc'ing the list with these answers, since I think there are questions here others know much more about. I will answer all with what I know, or think I know :-) 1) what can I put into the node? I see that the superclass proposes Property types. So I was wondering if blogs are

Re: [Neo4j] Neo4J Spatial - issue with bounding box indices in OSM Layer.

2011-03-24 Thread Craig Taverner
Hi Robert, Interesting work you're doing. I just read your blogs and I think it would be great to discuss your tests in more detail. Michael Hunger has done some interesting tests on the scalability of the OSM import, and could probably give suggestions on configuring the import. Looking at your

Re: [Neo4j] Neo4J Spatial - issue with bounding box indices in OSM Layer.

2011-03-24 Thread Craig Taverner
I will need to double check this. I know there was a dispute early on with Neo4j Spatial because the JTS library orders bbox params in one way, and GeoTools does it another way, so you might be seeing the results of that. I believed we sorted that all out, but perhaps not. I have have just checked

Re: [Neo4j] [Neo4j Spatial] Need advice on modeling my spatial domain properly

2011-03-18 Thread Craig Taverner
Hi Chris, A lot depends on your final intentions of how to use the model. There are many, many ways to model this, and each has its pros and cons. Let me try briefly describe two options I can think of that are related to the two factors you suggest below. *Option one - model time in the graph*

Re: [Neo4j] [Neo4j Spatial] Need advice on modeling my spatial domain properly

2011-03-18 Thread Craig Taverner
desired. greetz Chris On Fri, Mar 18, 2011 at 12:47 PM, Craig Taverner cr...@amanzi.com wrote: Hi Chris, A lot depends on your final intentions of how to use the model. There are many, many ways to model this, and each has its pros and cons. Let me try briefly describe two options I can

Re: [Neo4j] Where is the beer?

2011-03-17 Thread Craig Taverner
When I added my face, I tested to make sure it scaled the same as the others. The results: no images scale at all, no matter what zoom level. They are all fixed size images. Google said we should load images up to 64x64, so I originally loaded a 64x64 image, but since it was noticeably larger

Re: [Neo4j] Graph design

2011-03-16 Thread Craig Taverner
One key point of Davids suggestion is that it takes into account that each action of the user could take place from a different IP. Massimo's original model implied that the user would always be at the same IP for all actions, or if he could change IP's you would not know which of them related to

Re: [Neo4j] Neo4j spatial

2011-03-16 Thread Craig Taverner
Hi Saikat, There are a few places you can look for code samples. One of the best places is the set of test cases included in neo4j spatial. You can find them at https://github.com/neo4j/neo4j-spatial/tree/master/src/test/java/org/neo4j/gis/spatial. In particular, since you are interested mostly

Re: [Neo4j] Traversal framework

2011-03-15 Thread Craig Taverner
I like the pipes idea. What I would like to see is nested traversers. The pipe example below seems to imply single hops at each step, but it would be nicer to allow each step to traverse until it reached a certain criteria, at which point a different traversal would take over. In the old and

[Neo4j] Neo4j Spatial and GeoTools

2011-03-15 Thread Craig Taverner
Hi, There were a few comments on twitter about the use of GeoTools in Neo4j Spatial, so I wanted to elaborate on the discussion with a short description of where and why we include some GeoTools libraries in Neo4j Spatial. The discussion started with two tweets by

Re: [Neo4j] Nice change from all this Java

2011-03-10 Thread Craig Taverner
Cool syntax. I love that he has not skimped on docs. But isn't the EPL going to be a problem here? (a'la EPL/GPL clash) On Wed, Mar 9, 2011 at 10:38 PM, Andres Taylor andres.tay...@neotechnology.com wrote: Hey all, Wanted to share something I just found on reddit.

Re: [Neo4j] Neoclipse Wish List

2011-03-07 Thread Craig Taverner
But as far as I know there is not filter on properties of nodes or relationships. Should be easy to add though. How would you like that to look? Perhaps this could use the REST API traversal syntax also? - List of existing lucene indices available to query The new search dialog

Re: [Neo4j] Batch Insertion, how to index relationships?

2011-03-07 Thread Craig Taverner
I think you'll have to add a dummy key/value to each relationship, like exists/true or whatever. The overhead for that is insignificant and once relationships are indexed with whatever key/value they can be queried with those additional start/end node. And I believe you can index the

Re: [Neo4j] Neoclipse Wish List

2011-03-05 Thread Craig Taverner
You can filter the number of nodes in the preferences settings (click the gear icon on the top left, and then click neo4j, and change maximum number of nodes). You can filter the relationships by types in the relationships view, deselect the types (also by incoming/outgoing). But as far as I

Re: [Neo4j] Release of 1.0.0

2011-03-04 Thread Craig Taverner
Thanks for a great gem Andreas, One thing I noticed is that rubygems.org still lists version 0.4.6 as the official release. On Thu, Mar 3, 2011 at 10:42 AM, Peter Neubauer peter.neuba...@neotechnology.com wrote: Amazing work Andreas, the community is truly thankful to both you and all the

Re: [Neo4j] Load last 10 created nodes from neo4j

2011-03-04 Thread Craig Taverner
What about taking the id of the last node created, and just decrementing backwards by 1, ten times, and get those ten nodes? This will not take into account id-reuse, though, so if you have node deletion, this will not necessarily give the last ten added, only the ten with highest id. I expect

Re: [Neo4j] How to copy a complete database?

2011-03-03 Thread Craig Taverner
What would be the consequence of running a background thread that iterated through all nodes and relationships, and if any had a short string property, it would re-save the property? I assume the properties store would get a lot of empty space in the beginning, or would old-id reuse kick in and

Re: [Neo4j] Can anyone compile the latest Neo4J Spatial?

2011-02-27 Thread Craig Taverner
coolest Bring-a-Thing party. On Sun, Feb 27, 2011 at 2:03 AM, Nolan Darilek no...@thewordnerd.info wrote: -BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 02/26/2011 05:56 PM, Craig Taverner wrote: It is working for me too. One thing that is interesting about the error message

Re: [Neo4j] MMap Error on importing large data

2011-02-27 Thread Craig Taverner
schrieb Craig Taverner cr...@amanzi.com: What about the IOException Operation not permitted ? Can you check the access rights on your store? They look fine (644 and 755). Also, it would seem strange for the access rights to change in the middle of a run. The database is being written

[Neo4j] MMap Error on importing large data

2011-02-26 Thread Craig Taverner
Hi, I was importing a reasonably large OSM dataset into Neo4j Spatial, and this involves a batch inserter which imports everything, followed by switching to a normal embedded graph database for adding nodes to the RTree index, which is an in-graph tree structure. The batch inserter phase worked

Re: [Neo4j] MMap Error on importing large data

2011-02-26 Thread Craig Taverner
there OSMImport.main() exactly for that purpose ? Am 26.02.2011 um 12:38 schrieb Craig Taverner: Hi, I was importing a reasonably large OSM dataset into Neo4j Spatial, and this involves a batch inserter which imports everything, followed by switching to a normal embedded graph database

Re: [Neo4j] Can anyone compile the latest Neo4J Spatial?

2011-02-26 Thread Craig Taverner
It is working for me too. One thing that is interesting about the error message is that it says it looks like another instance is running in the *same JVM*. Is that the usual error message? (complete text was this is usually caused by another Neo4j kernel already running in this JVM for this

  1   2   3   >