[Neo4j] Anything like a changes feed?
I'm specing out an app that looks like a great fit for a graph database, and this is the first time I'm considering using raw Neo4J (I.e. not using the spatial layer.) A big part of this app involves actively engaging users. So if their user node becomes connected to a new task node, for instance, they are instantly notified that new tasks are available for them. Is it possible to create a listener that automatically monitors an embedded database for changes--new relationships created, relationships removed, etc.? I can probably do this out-of-band with a separate component, but it'd be awesome if I could do this closer to the database. Thanks! ___ NOTICE: THIS MAILING LIST IS BEING SWITCHED TO GOOGLE GROUPS, please register and consider posting at https://groups.google.com/forum/#!forum/neo4j Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user
Re: [Neo4j] Anything like a changes feed?
Great! Thanks. On 02/21/2012 11:20 AM, Peter Neubauer wrote: http://docs.neo4j.org/chunked/snapshot/transactions-events.html Could that be interesting? Send from a device with crappy keyboard and autocorrection. /peter On Feb 21, 2012 6:17 PM, Johnny Luujohnny@yobistore.com wrote: That would be a great feature. Reminds me about CouchDB's changes notification. Johnny On Tue, Feb 21, 2012 at 5:27 PM, Nolan Darilekno...@thewordnerd.info wrote: I'm specing out an app that looks like a great fit for a graph database, and this is the first time I'm considering using raw Neo4J (I.e. not using the spatial layer.) A big part of this app involves actively engaging users. So if their user node becomes connected to a new task node, for instance, they are instantly notified that new tasks are available for them. Is it possible to create a listener that automatically monitors an embedded database for changes--new relationships created, relationships removed, etc.? I can probably do this out-of-band with a separate component, but it'd be awesome if I could do this closer to the database. Thanks! ___ NOTICE: THIS MAILING LIST IS BEING SWITCHED TO GOOGLE GROUPS, please register and consider posting at https://groups.google.com/forum/#!forum/neo4j Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user ___ NOTICE: THIS MAILING LIST IS BEING SWITCHED TO GOOGLE GROUPS, please register and consider posting at https://groups.google.com/forum/#!forum/neo4j Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user ___ NOTICE: THIS MAILING LIST IS BEING SWITCHED TO GOOGLE GROUPS, please register and consider posting at https://groups.google.com/forum/#!forum/neo4j Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user ___ NOTICE: THIS MAILING LIST IS BEING SWITCHED TO GOOGLE GROUPS, please register and consider posting at https://groups.google.com/forum/#!forum/neo4j Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user
Re: [Neo4j] How often are Spatial snapshots published?
Not sure what's up, but I went ahead and built from Git. All's well now.
On 07/22/2011 02:28 AM, Peter Neubauer wrote:
Nolan,
saftest is to build it yourself from GITHub, I will check the
deployment. Is that ok for now?
/peter
On Fri, Jul 22, 2011 at 3:57 AM, Nolan Darilekno...@thewordnerd.info wrote:
I'm looking at the Spatial sources from Git, and am seeing lots of
versions of SpatialTopologyUtils.findClosestEdges that don't appear to
be in the snapshot I'm downloading. For instance,
public static ArrayListPointResult findClosestEdges(Point point,
Layer layer) {
doesn't appear to be in the snapshot build I have--that or my local
cache is borken.
Are these snapshots rebuilt regularly?
Thanks.
___
Neo4j mailing list
User@lists.neo4j.org
https://lists.neo4j.org/mailman/listinfo/user
___
Neo4j mailing list
User@lists.neo4j.org
https://lists.neo4j.org/mailman/listinfo/user
___
Neo4j mailing list
User@lists.neo4j.org
https://lists.neo4j.org/mailman/listinfo/user
Re: [Neo4j] More spatial questions
OK, thanks for this. Unfortunately my project is getting less attention
now than it ever has, but I finally sat down and reworked my
architecture. Instead of working with Neo4J Nodes, I've reworked my
library to use SpatialDatabaseRecord and am now having a bit more success.
I have three more query types to implement, and I'm not immediately
seeing how to do this using the OSM API. I'm not sure if I need to drop
to the lower-level JTS searches for these, so any guidance would be
appreciated. Note that, in all that follows, node means OSM node, not
Neo4J node:
def nearestWay(lat:Double, lon:Double,
allowedTypes:Option[List[String]] = None) = {
Finds the nearest way to a given lat, lon. The list of allowed types
lets me filter out power lines, footways, etc. by specifying values for
the highway= tag.
def nearestNodeWithWay(lat:Double, lon:Double,
allowedTypes:Option[List[String]]) = {
Finds the nearest node on any way.
def waysForNode(n:Node) = {
Lists the ways on which a given node is found. OSMDataset lets me do the
opposite and returns the nodes for a way, but I don't immediately see a
way to do this.
Thanks.
On 06/19/2011 04:47 PM, Craig Taverner wrote:
Hi Nolan,
I think I can answer a few of your questions. Firstly, some background. The
graph model of the OSM data is based largely on the XML formated OSM
documents, and there you will find 'nodes', 'ways', 'relations' and 'tags'
each as their own xml-tag, and as a consequence each will also have their
own neo4j-node in the graph. Another point is that the geometry can be based
on one or more nodes or ways, and so we always create another node for the
geometry, and link it to the osm-node, way or relation that represents that
geometry.
What all this boils down to is that you cannot find the tags on the geometry
node itself. You cannot even find the location on that node. If you want to
use the graph model in a direct way, as you have been trying, you really do
need to know how the OSM data is modeled. For example, for a LineString
geometry, you would need to traverse from the geometry node to the way node
and finally to the tags node (to get the tags). To get to the locations is
even more complex. Rather than do that, I would suggest that you work with
the OSM API we provided with the OSMLayer, OSMDataset and OSMGeometryEncoder
classes. Then you do not need to know the graph model at all.
For example, OSMDataset has a method for getting a Way object from a node,
and the returned object can be queried for its nodes, geometry, etc.
Currently we provide methods for returning neo4j-nodes as well as objects
that make spatial sense. One minor issue here is the ambiguity inherent in
the fact that both neo4j and OSM make use of the term 'node', but for
different things. We have various solutions to this, sometimes replacing
'node' with 'point' and sometimes prefixing with 'osm'. The unit tests in
TestsForDocs includes some tests for the OSM API.
My first goal is to find the nearest OSM node to a given lat, lon. My
attempts seem to be made of fail thus far, however. Here's my code:
Most of the OSM dataset is converted into LineStrings, and what you really
want to do is find the closest vertex of the closest LineString. We have a
utility function 'findClosestEdges' in the SpatialTopologyUtils class for
that. The unit tests in TestSpatialUtils, and the testSnapping() method in
particular, show use of this.
My thinking is that nodes should be represented as points, so I can't
see why this fails. When I run this in a REPL, I do get a node back. So
far so good. Next, I want to get the node's tags. So I run:
The spatial search will return 'geometries', which are spatial objects. In
neo4j-spatial every geometry is represented by a unique node, but it is not
required that that node contain coordinates or tags. That is up to the
GeometryEncoder. In the case of the OSM model, this information is
elsewhere, because of the nature of the OSM graph, which is a highly
interconnected network of points, most of which do not represent Point
geometries, but are part of much more complex geometries (streets, regions,
buildings, etc.).
n.getSingleRelationship(OSMRelation.TAGS, Direction.INCOMING)
The geometry node is not connected directly to the tags node. You need two
steps to get there. But again, rather than figure out the graph yourself,
use the API. In this case, instead of getting the geometry node from the
SpatialDatabaseRecord, rather just get the properties using getPropertyNames
and getProperty(String). This API works the same on all kinds of spatial
data, and in the case of OSM data will return the TAGS, since those are
interpreted as attributes of the geometries.
n.getSingleRelationship(OSMRelationship.GEOM,
Direction.INCOMING).getOtherNode(n).getPropertyKeys
I see what appears to be a series of tags (oneway, name, etc.) Why are
these being returned for OSMRelation.GEOM
Re: [Neo4j] How often are Spatial snapshots published?
Awesome! Thanks a bunch. On 07/22/2011 04:33 PM, Anders Nawroth wrote: Hi! Are these snapshots rebuilt regularly? Now they are, again: http://m2.neo4j.org/snapshots/org/neo4j/neo4j-spatial/0.6-SNAPSHOT/ /anders Thanks. ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user
[Neo4j] How often are Spatial snapshots published?
I'm looking at the Spatial sources from Git, and am seeing lots of
versions of SpatialTopologyUtils.findClosestEdges that don't appear to
be in the snapshot I'm downloading. For instance,
public static ArrayListPointResult findClosestEdges(Point point,
Layer layer) {
doesn't appear to be in the snapshot build I have--that or my local
cache is borken.
Are these snapshots rebuilt regularly?
Thanks.
___
Neo4j mailing list
User@lists.neo4j.org
https://lists.neo4j.org/mailman/listinfo/user
[Neo4j] More spatial questions
Fortunately, recent changes seem to have made the memory leaks I was
experiencing a few weeks ago to vanish. Apologies for not playing a more
active part in these discussions, but I'm finding there to be a quite
steep learning curve here, and I don't have the time to make a major
push to overcome it at once. But I finally have an import that I can
play with in a Scala REPL, though I'm encountering things about it that
just don't make sense.
My first goal is to find the nearest OSM node to a given lat, lon. My
attempts seem to be made of fail thus far, however. Here's my code:
def layer = spatialService.getLayer(map).asInstanceOf[OSMLayer]
private def pointSearch(lat:Double, lon:Double) = new SearchClosest(
layer.getGeometryFactory.createPoint(
new Coordinate(lat, lon)
)
)
def nearestNode(lat:Double, lon:Double) = {
val query = pointSearch(lat, lon)
val l = layer
l.addSimpleDynamicLayer(Constants.GTYPE_POINT)
l.getIndex.executeSearch(query)
val results = query.getResults
results.headOption.map { r =
r.getGeomNode
}
}
My thinking is that nodes should be represented as points, so I can't
see why this fails. When I run this in a REPL, I do get a node back. So
far so good. Next, I want to get the node's tags. So I run:
n.getSingleRelationship(OSMRelation.TAGS, Direction.INCOMING)
I get null. OK, so maybe this doesn't have tags. Yet, when I run:
n.getSingleRelationship(OSMRelationship.GEOM,
Direction.INCOMING).getOtherNode(n).getPropertyKeys
I see what appears to be a series of tags (oneway, name, etc.) Why are
these being returned for OSMRelation.GEOM rather than OSMRelation.TAGS?
Additionally, I see the property way_osm_id, which clearly isn't a tag.
It would also seem to indicate that this query returned a way rather
than a node like I'd hoped. This conclusion is further born out by the
tag names. So clearly I'm not getting the search correct. But beyond
that, the way being returned by this search isn't close to the lat,lon I
provided. What am I missing?
As an aside, in looking at the latest OSM import testcase, it seems like
the batch inserter may now be optional. Is this true, and what
benefits/disadvantages are there to its use? I tried importing the Texas
OSM data on my fairly powerful laptop, but gave up after 12 hours and
17 way imports (I think there are over a million in that dataset.)
Other geospatial formats seem to do the import in a matter of hours, but
this import seemed like it'd go on for days if I let it.
Thanks.
___
Neo4j mailing list
User@lists.neo4j.org
https://lists.neo4j.org/mailman/listinfo/user
[Neo4j] Out of memory with Neo4j Spatial
Picking up my slow port to Neo4j Spatial again, and am hitting an out-of-memory error when trying to import large datasets. Given that this code works fine if I use a different database and swap out the implementations, I suspect Neo4j as the issue. This is Neo4j 1.4-SNAPSHOT and Spatial 0.6-SNAPSHOT. Not sure if this is enough to diagnose the issue, but I have a heap dump: http://dl.dropbox.com/u/147071/java_pid7405.hprof.bz2 It's currently uploading to Dropbox, so maybe grab it in an hour or two. It's something like 185M compressed, 1.5G uncompressed. Thanks, please let me know if I might provide any more details. The exact error was this writer hit an OutOfMemoryError; cannot flush, at org.apache.lucene.IndexWriter.doFlush():3307. Not sure how relevant the stacktrace is, as my experience with OutOfMemoryErrors is that the code just fails wherever. ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user
Re: [Neo4j] Out of memory with Neo4j Spatial
I'm importing the dataset for Texas. My version is a few weeks old, but
you can find the newest here:
http://downloads.cloudmade.com/americas/northern_america/united_states/texas/texas.osm.bz2
My import code, more or less, let me know if you need more
implementation details:
class Neo4jImport(filename:String, layer:String = map) extends Import {
val importer = new OSMImporter(layer)
private var processed = 0
def processedEntities = processed
private def ds = dataset.asInstanceOf[Neo4JDataSet]
private def database = ds.database
class MyBatchInserter extends BatchInserterImpl(database.getStoreDir) {
override def createNode(properties:JMap[String, Object]) = {
processed += 1
super.createNode(properties)
}
override def createNode(id:Long, properties:JMap[String, Object]){
super.createNode(id, properties)
processed += 1
}
override def createRelationship(n1:Long, n2:Long,
rt:RelationshipType, properties:JMap[String, Object]) = {
processed += 1
super.createRelationship(n1, n2, rt, properties)
}
}
def performImport() {
database.shutdown()
val batchInserter = new MyBatchInserter
importer.importFile(batchInserter, filename)
batchInserter.shutdown()
ds.init(true)
importer.reIndex(database, 1000)
}
}
Console output:
Fri May 13 10:22:20 CDT 2011: Saving node 6525309
(13713.904715468341 node/second)
Fri May 13 10:22:21 CDT 2011: Saving node 6539916
(13703.333682556313 node/second)
java.lang.OutOfMemoryError: Java heap space
Dumping heap to java_pid13506.hprof ...
Heap dump file created [1426787760 bytes in 30.001 secs]
scala.actors.Actor$$anon$1@764e2837: caught
java.lang.IllegalStateException: this writer hit an OutOfMemoryError;
cannot flush
java.lang.IllegalStateException: this writer hit an OutOfMemoryError;
cannot flush
at org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:3307)
at org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:3296)
at org.apache.lucene.index.IndexWriter.optimize(IndexWriter.java:2376)
at org.apache.lucene.index.IndexWriter.optimize(IndexWriter.java:2352)
at
org.neo4j.index.impl.lucene.LuceneBatchInserterIndex.closeWriter(LuceneBatchInserterIndex.java:279)
at
org.neo4j.index.impl.lucene.LuceneBatchInserterIndex.shutdown(LuceneBatchInserterIndex.java:354)
at
org.neo4j.index.impl.lucene.LuceneBatchInserterIndexProvider.shutdown(LuceneBatchInserterIndexProvider.java:145)
at
org.neo4j.gis.spatial.osm.OSMImporter$OSMBatchWriter.finish(OSMImporter.java:1144)
at
org.neo4j.gis.spatial.osm.OSMImporter.importFile(OSMImporter.java:1320)
at
org.neo4j.gis.spatial.osm.OSMImporter.importFile(OSMImporter.java:1219)
at
org.neo4j.gis.spatial.osm.OSMImporter.importFile(OSMImporter.java:1215)
at
info.hermesnav.core.model.data.impl.neo4j.Neo4jImport.performImport(neo4j.scala:54)
at
info.hermesnav.core.model.data.Import$$anonfun$start$1.apply$mcV$sp(data.scala:25)
at scala.actors.Actor$$anon$1.act(Actor.scala:135)
at scala.actors.Reactor$$anonfun$dostart$1.apply(Reactor.scala:222)
at scala.actors.Reactor$$anonfun$dostart$1.apply(Reactor.scala:222)
at scala.actors.ReactorTask.run(ReactorTask.scala:36)
at
scala.concurrent.forkjoin.ForkJoinPool$AdaptedRunnable.exec(ForkJoinPool.java:611)
at
scala.concurrent.forkjoin.ForkJoinTask.quietlyExec(ForkJoinTask.java:422)
at
scala.concurrent.forkjoin.ForkJoinWorkerThread.mainLoop(ForkJoinWorkerThread.java:340)
at
scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:325)
On 05/13/2011 09:34 AM, Peter Neubauer wrote:
Nolan,
do you have the importing code and what dataset are you importing? Also, do
you have any console output? It could be very big transactions or other
database settings not adjusted to the size of your import ...
Cheers,
/peter neubauer
GTalk: neubauer.peter
Skype peter.neubauer
Phone +46 704 106975
LinkedIn http://www.linkedin.com/in/neubauer
Twitter http://twitter.com/peterneubauer
http://www.neo4j.org - Your high performance graph database.
http://startupbootcamp.org/- Öresund - Innovation happens HERE.
http://www.thoughtmade.com - Scandinavia's coolest Bring-a-Thing party.
On Fri, May 13, 2011 at 4:13 AM, Nolan Darilekno...@thewordnerd.infowrote:
Picking up my slow port to Neo4j Spatial again, and am hitting an
out-of-memory error when trying to import large datasets. Given that
this code works fine if I use a different database and swap out the
implementations, I suspect Neo4j as the issue. This is Neo4j
1.4-SNAPSHOT and Spatial 0.6-SNAPSHOT.
Not sure if this is enough to diagnose the issue, but I have a heap dump:
http://dl.dropbox.com/u/147071/java_pid7405.hprof.bz2
It's currently uploading to Dropbox, so maybe grab it in an hour or two.
Re: [Neo4j] Problems downloading Neo4J Spatial from Maven
Yes, this worked. Thanks. I assumed that all contents of the releases repository were also deployed to maven central as well. On 04/09/2011 03:17 PM, Anders Nawroth wrote: Hi! The parent is found in the *releases* repo: http://m2.neo4j.org/releases in this case: http://m2.neo4j.org/releases/org/neo4j/parent-pom/18/ /anders 2011-04-09 17:24, Nolan Darilek skrev: Had this problem a month or so ago, but life got busy and I never had time to delve deeper. My Scala/SBT project can't seem to fetch this artifact from the snapshots repository. The error I get is: [warn] io problem while parsing ivy file: http://m2.neo4j.org/snapshots/org/neo4j/neo4j-spatial/0.6-SNAPSHOT/neo4j-spatial-0.6-SNAPSHOT.pom: Impossible to load parent for file:/home/nolan/.ivy2/cache/org.neo4j/neo4j-spatial/ivy-0.6-SNAPSHOT.xml.original. Parent=org.neo4j#parent-pom;18 [warn] module not found: org.neo4j#neo4j-spatial;0.6-SNAPSHOT [warn] local: tried [warn] /home/nolan/.ivy2/local/org.neo4j/parent-pom/18/ivys/ivy.xml [warn] -- artifact org.neo4j#parent-pom;18!parent-pom.jar: [warn] /home/nolan/.ivy2/local/org.neo4j/parent-pom/18/jars/parent-pom.jar [warn] databinder: tried [warn] http://databinder.net/repo/org/neo4j/parent-pom/18/parent-pom-18.pom [warn] -- artifact org.neo4j#parent-pom;18!parent-pom.jar: [warn] http://databinder.net/repo/org/neo4j/parent-pom/18/parent-pom-18.jar [warn] Neo4J: tried [warn] http://m2.neo4j.org/snapshots/org/neo4j/parent-pom/18/parent-pom-18.pom [warn] -- artifact org.neo4j#parent-pom;18!parent-pom.jar: [warn] http://m2.neo4j.org/snapshots/org/neo4j/parent-pom/18/parent-pom-18.jar [warn] Geotools: tried [warn] http://download.osgeo.org/webdav/geotools/org/neo4j/neo4j-spatial/0.6-SNAPSHOT/neo4j-spatial-0.6-SNAPSHOT.pom [warn] -- artifact org.neo4j#neo4j-spatial;0.6-SNAPSHOT!neo4j-spatial.jar: [warn] http://download.osgeo.org/webdav/geotools/org/neo4j/neo4j-spatial/0.6-SNAPSHOT/neo4j-spatial-0.6-SNAPSHOT.jar [warn] JBoss: tried [warn] http://repository.jboss.org/nexus/content/groups/public/org/neo4j/neo4j-spatial/0.6-SNAPSHOT/neo4j-spatial-0.6-SNAPSHOT.pom [warn] -- artifact org.neo4j#neo4j-spatial;0.6-SNAPSHOT!neo4j-spatial.jar: [warn] http://repository.jboss.org/nexus/content/groups/public/org/neo4j/neo4j-spatial/0.6-SNAPSHOT/neo4j-spatial-0.6-SNAPSHOT.jar [warn] Local Maven Repository: tried [warn] file:///home/nolan/.m2/repository/org/neo4j/neo4j-spatial/0.6-SNAPSHOT/neo4j-spatial-0.6-SNAPSHOT.pom [warn] -- artifact org.neo4j#neo4j-spatial;0.6-SNAPSHOT!neo4j-spatial.jar: [warn] file:///home/nolan/.m2/repository/org/neo4j/neo4j-spatial/0.6-SNAPSHOT/neo4j-spatial-0.6-SNAPSHOT.jar [warn] public: tried [warn] http://repo1.maven.org/maven2/org/neo4j/neo4j-spatial/0.6-SNAPSHOT/neo4j-spatial-0.6-SNAPSHOT.pom [warn] -- artifact org.neo4j#neo4j-spatial;0.6-SNAPSHOT!neo4j-spatial.jar: [warn] http://repo1.maven.org/maven2/org/neo4j/neo4j-spatial/0.6-SNAPSHOT/neo4j-spatial-0.6-SNAPSHOT.jar [warn] Scala-Tools Maven2 Repository: tried [warn] http://scala-tools.org/repo-releases/org/neo4j/neo4j-spatial/0.6-SNAPSHOT/neo4j-spatial-0.6-SNAPSHOT.pom [warn] -- artifact org.neo4j#neo4j-spatial;0.6-SNAPSHOT!neo4j-spatial.jar: [warn] http://scala-tools.org/repo-releases/org/neo4j/neo4j-spatial/0.6-SNAPSHOT/neo4j-spatial-0.6-SNAPSHOT.jar [warn] :: [warn] :: UNRESOLVED DEPENDENCIES :: [warn] :: [warn] :: org.neo4j#neo4j-spatial;0.6-SNAPSHOT: not found [warn] :: [info] [warn] :: problems summary :: [warn] WARNINGS [warn] io problem while parsing ivy file: http://m2.neo4j.org/snapshots/org/neo4j/neo4j-spatial/0.6-SNAPSHOT/neo4j-spatial-0.6-SNAPSHOT.pom: Impossible to load parent for file:/home/nolan/.ivy2/cache/org.neo4j/neo4j-spatial/ivy-0.6-SNAPSHOT.xml.original. Parent=org.neo4j#parent-pom;18 [warn] module not found: org.neo4j#neo4j-spatial;0.6-SNAPSHOT [warn] local: tried [warn] /home/nolan/.ivy2/local/org.neo4j/parent-pom/18/ivys/ivy.xml [warn] -- artifact org.neo4j#parent-pom;18!parent-pom.jar: [warn] /home/nolan/.ivy2/local/org.neo4j/parent-pom/18/jars/parent-pom.jar [warn] databinder: tried [warn] http://databinder.net/repo/org/neo4j/parent-pom/18/parent-pom-18.pom [warn] -- artifact org.neo4j#parent-pom;18!parent-pom.jar: [warn] http://databinder.net/repo/org/neo4j/parent-pom/18/parent-pom-18.jar [warn] Neo4J: tried [warn] http://m2.neo4j.org/snapshots/org/neo4j/parent-pom/18/parent-pom-18.pom [warn] -- artifact org.neo4j#parent-pom;18!parent-pom.jar: [warn] http://m2.neo4j.org/snapshots/org/neo4j/parent-pom/18/parent-pom-18.jar [warn] Geotools: tried [warn] http://download.osgeo.org/webdav/geotools/org
[Neo4j] Problems downloading Neo4J Spatial from Maven
Had this problem a month or so ago, but life got busy and I never had time to delve deeper. My Scala/SBT project can't seem to fetch this artifact from the snapshots repository. The error I get is: [warn] io problem while parsing ivy file: http://m2.neo4j.org/snapshots/org/neo4j/neo4j-spatial/0.6-SNAPSHOT/neo4j-spatial-0.6-SNAPSHOT.pom: Impossible to load parent for file:/home/nolan/.ivy2/cache/org.neo4j/neo4j-spatial/ivy-0.6-SNAPSHOT.xml.original. Parent=org.neo4j#parent-pom;18 [warn] module not found: org.neo4j#neo4j-spatial;0.6-SNAPSHOT [warn] local: tried [warn] /home/nolan/.ivy2/local/org.neo4j/parent-pom/18/ivys/ivy.xml [warn] -- artifact org.neo4j#parent-pom;18!parent-pom.jar: [warn] /home/nolan/.ivy2/local/org.neo4j/parent-pom/18/jars/parent-pom.jar [warn] databinder: tried [warn] http://databinder.net/repo/org/neo4j/parent-pom/18/parent-pom-18.pom [warn] -- artifact org.neo4j#parent-pom;18!parent-pom.jar: [warn] http://databinder.net/repo/org/neo4j/parent-pom/18/parent-pom-18.jar [warn] Neo4J: tried [warn] http://m2.neo4j.org/snapshots/org/neo4j/parent-pom/18/parent-pom-18.pom [warn] -- artifact org.neo4j#parent-pom;18!parent-pom.jar: [warn] http://m2.neo4j.org/snapshots/org/neo4j/parent-pom/18/parent-pom-18.jar [warn] Geotools: tried [warn] http://download.osgeo.org/webdav/geotools/org/neo4j/neo4j-spatial/0.6-SNAPSHOT/neo4j-spatial-0.6-SNAPSHOT.pom [warn] -- artifact org.neo4j#neo4j-spatial;0.6-SNAPSHOT!neo4j-spatial.jar: [warn] http://download.osgeo.org/webdav/geotools/org/neo4j/neo4j-spatial/0.6-SNAPSHOT/neo4j-spatial-0.6-SNAPSHOT.jar [warn] JBoss: tried [warn] http://repository.jboss.org/nexus/content/groups/public/org/neo4j/neo4j-spatial/0.6-SNAPSHOT/neo4j-spatial-0.6-SNAPSHOT.pom [warn] -- artifact org.neo4j#neo4j-spatial;0.6-SNAPSHOT!neo4j-spatial.jar: [warn] http://repository.jboss.org/nexus/content/groups/public/org/neo4j/neo4j-spatial/0.6-SNAPSHOT/neo4j-spatial-0.6-SNAPSHOT.jar [warn] Local Maven Repository: tried [warn] file:///home/nolan/.m2/repository/org/neo4j/neo4j-spatial/0.6-SNAPSHOT/neo4j-spatial-0.6-SNAPSHOT.pom [warn] -- artifact org.neo4j#neo4j-spatial;0.6-SNAPSHOT!neo4j-spatial.jar: [warn] file:///home/nolan/.m2/repository/org/neo4j/neo4j-spatial/0.6-SNAPSHOT/neo4j-spatial-0.6-SNAPSHOT.jar [warn] public: tried [warn] http://repo1.maven.org/maven2/org/neo4j/neo4j-spatial/0.6-SNAPSHOT/neo4j-spatial-0.6-SNAPSHOT.pom [warn] -- artifact org.neo4j#neo4j-spatial;0.6-SNAPSHOT!neo4j-spatial.jar: [warn] http://repo1.maven.org/maven2/org/neo4j/neo4j-spatial/0.6-SNAPSHOT/neo4j-spatial-0.6-SNAPSHOT.jar [warn] Scala-Tools Maven2 Repository: tried [warn] http://scala-tools.org/repo-releases/org/neo4j/neo4j-spatial/0.6-SNAPSHOT/neo4j-spatial-0.6-SNAPSHOT.pom [warn] -- artifact org.neo4j#neo4j-spatial;0.6-SNAPSHOT!neo4j-spatial.jar: [warn] http://scala-tools.org/repo-releases/org/neo4j/neo4j-spatial/0.6-SNAPSHOT/neo4j-spatial-0.6-SNAPSHOT.jar [warn] :: [warn] :: UNRESOLVED DEPENDENCIES :: [warn] :: [warn] :: org.neo4j#neo4j-spatial;0.6-SNAPSHOT: not found [warn] :: [info] [warn] :: problems summary :: [warn] WARNINGS [warn] io problem while parsing ivy file: http://m2.neo4j.org/snapshots/org/neo4j/neo4j-spatial/0.6-SNAPSHOT/neo4j-spatial-0.6-SNAPSHOT.pom: Impossible to load parent for file:/home/nolan/.ivy2/cache/org.neo4j/neo4j-spatial/ivy-0.6-SNAPSHOT.xml.original. Parent=org.neo4j#parent-pom;18 [warn] module not found: org.neo4j#neo4j-spatial;0.6-SNAPSHOT [warn] local: tried [warn] /home/nolan/.ivy2/local/org.neo4j/parent-pom/18/ivys/ivy.xml [warn] -- artifact org.neo4j#parent-pom;18!parent-pom.jar: [warn] /home/nolan/.ivy2/local/org.neo4j/parent-pom/18/jars/parent-pom.jar [warn] databinder: tried [warn] http://databinder.net/repo/org/neo4j/parent-pom/18/parent-pom-18.pom [warn] -- artifact org.neo4j#parent-pom;18!parent-pom.jar: [warn] http://databinder.net/repo/org/neo4j/parent-pom/18/parent-pom-18.jar [warn] Neo4J: tried [warn] http://m2.neo4j.org/snapshots/org/neo4j/parent-pom/18/parent-pom-18.pom [warn] -- artifact org.neo4j#parent-pom;18!parent-pom.jar: [warn] http://m2.neo4j.org/snapshots/org/neo4j/parent-pom/18/parent-pom-18.jar [warn] Geotools: tried [warn] http://download.osgeo.org/webdav/geotools/org/neo4j/neo4j-spatial/0.6-SNAPSHOT/neo4j-spatial-0.6-SNAPSHOT.pom [warn] -- artifact org.neo4j#neo4j-spatial;0.6-SNAPSHOT!neo4j-spatial.jar: [warn] http://download.osgeo.org/webdav/geotools/org/neo4j/neo4j-spatial/0.6-SNAPSHOT/neo4j-spatial-0.6-SNAPSHOT.jar [warn] JBoss: tried [warn]
Re: [Neo4j] Different build errors
Just wanted to say that I finally played with this today and it works almost perfectly. The only issue I'm uncertain about is whether or not Spatial is published to the snapshot repository, as I get a POM error when doing an update. I don't have the error at hand, and everything works out of my local repo, but not remotely. If this isn't a known issue, then I can post that error as soon as I get to a good stopping place with the work I'm doing now. Thanks again. On 03/09/2011 10:44 AM, Andreas Kollegger wrote: Well, that was fun. Turns out that one of our artifacts had the wrong scope for depending on neo4j-kernel-tests. So the transitive dependencies should've included both. Maven does, but Ivy doesn't. In my local project, I added my local maven repository like this: val mavenLocal = Local Maven Repository at file://+Path.userHome+/.m2/repository Then changed the neo4j version to 1.3-SNAPSHOT and experimented with the upstream poms. I've fixed the scope of the upstream dependency and will include the corrections in this week's milestone. I'll have to check that it is still added to our distribution properly, but at least in terms of dependency-resolution this should improve the current situation. Again, sorry for the confusion. -Andreas On Mar 9, 2011, at 2:25 PM, Nolan Darilek wrote: On 03/08/2011 10:23 AM, Andreas Kollegger wrote: Interesting. I've never used the libraryDependencies approach for specifying dependencies. What's the advantage? I'll have to read up about that. I think it ultimately does the same thing as specifying separate vals, so no advantage, just preference. I like the clarity of stating this is a library dependency rather than relying on val introspection. In any case, I contorted my build definition in a variety of ways, but no matter what I did, I never downloaded anything other than neo4j-kernel-tests.jar. Eventually I tried your working project below, and that failed too. So it doesn't appear to be my project definition. I'm also regularly removing ~/.ivy2, ~/.m2, lib_managed/ and target/. Not sure if I'm missing anything, though the SBT download process does state 16 artifacts copied, 0 already retrieved so I think I'm getting them all. What Scala and SBT versions are you using? 2.8.1 and 0.7.5.RC0 here. Not sure where to go from here. I'll try a post to the SBT list later today. Thanks for the help. ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user
Re: [Neo4j] Different build errors
On 03/08/2011 10:23 AM, Andreas Kollegger wrote: Interesting. I've never used the libraryDependencies approach for specifying dependencies. What's the advantage? I'll have to read up about that. I think it ultimately does the same thing as specifying separate vals, so no advantage, just preference. I like the clarity of stating this is a library dependency rather than relying on val introspection. In any case, I contorted my build definition in a variety of ways, but no matter what I did, I never downloaded anything other than neo4j-kernel-tests.jar. Eventually I tried your working project below, and that failed too. So it doesn't appear to be my project definition. I'm also regularly removing ~/.ivy2, ~/.m2, lib_managed/ and target/. Not sure if I'm missing anything, though the SBT download process does state 16 artifacts copied, 0 already retrieved so I think I'm getting them all. What Scala and SBT versions are you using? 2.8.1 and 0.7.5.RC0 here. Not sure where to go from here. I'll try a post to the SBT list later today. Thanks for the help. ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user
Re: [Neo4j] Different build errors
On 03/08/2011 09:40 AM, Andreas Kollegger wrote:
Sorry about that. The graphdb components needs to be built without any
external repository dependencies. Unfortunately JBoss does not sync netty
with maven central (some JBoss stuff does, though).
OK, here's what I figured out yesterday. No matter what I do in SBT, I
can't get the neo4j-kernel dependency. Here's my project configuration,
or at least the relevant parts:
class Project(info: ProjectInfo) extends DefaultProject(info) {
val mavenLocal = Local Maven Repository at
file://+Path.userHome+/.m2/repository
val osmVersion = 2.5.2-RC1
val osmURL =
http://downloads.sourceforge.net/project/travelingsales/libosm/+osmVersion+/;
val databinder = databinder at http://databinder.net/repo/;
val neo4JSnapshots = Neo4J at http://m2.neo4j.org/snapshots;
val jBossRepository = JBoss at
http://repository.jboss.org/nexus/content/groups/public;
val neo4JVersion = 1.3.M03
override def libraryDependencies = Set(
net.databinder %% dispatch-http % 0.7.8,
net.sf.travelingsales % osmlib % osmVersion from
osmURL+libosm-+osmVersion+.jar,
org.geotools % gt-main % 2.7-M3,
org.neo4j % neo4j % neo4JVersion,
org.neo4j % neo4j-kernel % neo4JVersion,
org.neo4j % neo4j-spatial % 0.5-SNAPSHOT
)++super.libraryDependencies
}
Regardless of whether or not I specify the kernel dependency, it is
never fetched. I do, however, get the neo4j-kernel-test jar. This is
after multiple iterations of removing and recreating all caches,
lib_managed/ and target/.
If I pull the kernel jar from my local cache, placing it in lib/,
everything works as expected. But something in SBT's dependency
resolution breaks on Neo4J. I've not experienced this issue before in
over a year of using SBT, so I'm not sure where to go from here. The
placement of the kernel jar in my project is a good temporary solution,
but I'm trying not to commit binary artifacts to my repository unless
absolutely necessary.
Thanks.
___
Neo4j mailing list
User@lists.neo4j.org
https://lists.neo4j.org/mailman/listinfo/user
[Neo4j] Different build errors
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 OK, picking up my Neo4J project again. Updating the dependency to Spatial 0.5-SNAPSHOT seems to have resolved the issue wherein I was having M01 jars on my classpath despite using the M03 branch. Now I'm getting a different error. References to any contents of org.neo4j and subpackages are all unresolved. I poked around in my lib_managed directory and noticed some oddities. I do have a neo4j-1.3.M03.jar, but it's only 16K. Uncompressing it gives me a pom.xml, MetaINF/ but no classes. Should it be this way? I have a neo4j-kernel-1.3.M03-test.jar, but no neo4j-kernel jar. Should I? It looks like my dependency retrieval process isn't downloading something despite my specifying the dependency as documented on the downloads page, or the jar isn't being built correctly. Thanks. -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.10 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ iEYEARECAAYFAk1yfVEACgkQIaMjFWMehWIpvwCeNPlALB6r4uEjTc6Bkb39wPV1 E1AAn09ZhD7m1rp/frSJmZYMZ86e+1S/ =txGS -END PGP SIGNATURE- ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user
Re: [Neo4j] Different build errors
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 03/05/2011 12:27 PM, Andreas Kollegger wrote: What build tool are you using: maven, sbt, ant, gradle, or other? SBT. -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.10 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ iEUEARECAAYFAk1ygkkACgkQIaMjFWMehWJ6qwCfYPtD4Wi0gVKSaMVUpTYFDv9a V2UAmNfMu+haW5i1v+DEuC6gxFTCP/E= =9TAx -END PGP SIGNATURE- ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user
Re: [Neo4j] Different build errors
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 03/05/2011 12:50 PM, Andreas Kollegger wrote: Did `sbt update` fail? Because it did for me when I just now set up a sample project, failing to find org.jboss.netty#netty;3.2.1.Final, which I believe is only available from the JBoss repository. No, seems to work fine for me here. It did fail on that before, maybe a few weeks back, but not now. SBT. ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.10 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ iEYEARECAAYFAk1yohIACgkQIaMjFWMehWJi+wCdERkQv8kkELcjZ4m4G9z/ZSxl 8X0An3ym7DpPHAlplE1sFVUi5BiAj78Q =hMCg -END PGP SIGNATURE- ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user
Re: [Neo4j] Can anyone compile the latest Neo4J Spatial?
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1
I just blew away my ~/.m2 and tried again, same results.
People keep saying things about Neo4j M2, but the pom.xml dependency is
still M1. Could that be the issue? In any case, changing to m2 doesn't
work as that doesn't resolve.
Maybe someone would like a local SSH account? Not sure what else to try.
On 02/27/2011 05:42 AM, Andreas Kollegger wrote:
On a fresh and clean Ubuntu VM (after installing java, maven, git, etc), I
just cloned neo4j-spatial and tried `mvn clean install`.
During the build, I noticed a few these scattered about:
Feb 27, 2011 11:58:26 AM org.geotools.map.MapContent finalize
SEVERE: Call MapContent dispose() to prevent memory leaks
But ended up with a successful build. No failures, no errors.
Cheers,
Andreas
On Feb 27, 2011, at 7:22 AM, Peter Neubauer wrote:
Mmmh,
the index provider kernel extension subsystem has been changed between
1.3.M01 and M02. I suspect an incompatible kernel version being
resolved by maven. let me try to run this tomorrow from home with
moving away my current maven repo and get everything fresh. (Sitting
on a 3G conenction right now).
Hopefully I can tell you tonight, otherwise tomorrow how that works,
ok? Also, you could try to move away your ~/.m2/repository for one
build and try getting all artifacts fresh from the netz?
Cheers,
/peter neubauer
GTalk: neubauer.peter
Skype peter.neubauer
Phone +46 704 106975
LinkedIn http://www.linkedin.com/in/neubauer
Twitter http://twitter.com/peterneubauer
http://www.neo4j.org - Your high performance graph database.
http://startupbootcamp.org/- Öresund - Innovation happens HERE.
http://www.thoughtmade.com - Scandinavia's coolest Bring-a-Thing party.
On Sun, Feb 27, 2011 at 2:03 AM, Nolan Darilek no...@thewordnerd.info
wrote:
On 02/26/2011 05:56 PM, Craig Taverner wrote:
It is working for me too.
One thing that is interesting about the error message is that it says it
looks like another instance is running in the *same JVM*. Is that the
usual
error message? (complete text was this is usually caused by another Neo4j
kernel already running in this JVM for this particular store).
The error is occurring at the very start of the very first test case in
the
TestSpatial class, so cannot be due to another test in that class.
Still, I would take Peters advice, check no other java test processes are
running, manually delete the database to be sure, and then try again.
I don't mean to be difficult, but I *literally* did:
git clone ... neo4j-spatial
cd neo4j-spatial
mvn install
If I can get more pristine than that then do let me know, but I can't
see how.
The one process you'll see open in this transcript is a web app. It has
nothing to do with Neo4J in anything other than it hosts its jars in its
dependencies. The database is not even used at this time and, indeed,
the exact same behavior happens if it isn't running.
My next question, does someone have a development dependency hanging
around in their local m2 repository that I don't? When you've verified
that you can build a clean tree, you've first backed up ~/.m2 and
removed it? In any case:
desktop: ~/src/neo4j nolan@nolan-desktop:~/src/neo4j$ ps auxw |grep java
nolan12111 1.4 2.8 1423840 109504 pts/1 Sl+ 16:07 2:22
[97;45m [Kjava [m [K -XX:+HeapDumpOnOutOfMemoryError
-XX:+CMSClassUnloadingEnabled -Dsbt.log.noformat=true -jar
/home/nolan/bin/sbt-launcher.jar jetty
nolan13153 0.0 0.0 7624 896 pts/4S+ 18:55 0:00 grep
--color=auto [97;45m [Kjava [m [K
]0;nolan@nolan-desktop: ~/src/neo4j nolan@nolan-desktop:~/src/neo4j$
git clone git://github.com/neo4j/neo4j-spatial
Initialized empty Git repository in
/home/nolan/src/neo4j/neo4j-spatial/.git/
remote: Counting objects: 3065, done. [K
...
Resolving deltas: 100% (1247/1247), done.
]0;nolan@nolan-desktop: ~/src/neo4j nolan@nolan-desktop:~/src/neo4j$ cd
neo4j-spatial
]0;nolan@nolan-desktop:
~/src/neo4j/neo4j-spatial nolan@nolan-desktop:~/src/neo4j/neo4j-spatial$
mvn install
[INFO] Scanning for projects...
[INFO]
[INFO] Building Neo4j Spatial Components
[INFO]task-segment: [install]
[INFO]
[WARNING] POM for 'org.rrd4j:rrd4j:pom:2.0.6:provided' is invalid.
Its dependencies (if any) will NOT be available to the current build.
[INFO] [enforcer:enforce {execution: enforce-maven}]
[INFO] [license:check {execution: check-licenses}]
[INFO] Checking licenses...
[INFO] [dependency:unpack-dependencies {execution: get-test-data}]
[INFO] Unpacking
/home/nolan/.m2/repository/org/neo4j/spatial/osm-test-data/20100819/osm-test-data-20100819.jar
to
/home/nolan/src/neo4j/neo4j-spatial/target
with includes null and excludes:null
[INFO] Unpacking
/home
Re: [Neo4j] Can anyone compile the latest Neo4J Spatial?
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 I only use Maven because other projects make me, so I haven't done anything unconventional here. No MAVEN_OPTS and no settings.xml of which I'm aware. I'm on my home LAN but without any proxies, and haven't experienced anything like this with other projects. $ uname -a Linux nolan-desktop 2.6.32-25-generic #45-Ubuntu SMP Sat Oct 16 19:52:42 UTC 2010 x86_64 GNU/Linux $ java -version java version 1.6.0_18 OpenJDK Runtime Environment (IcedTea6 1.8.1) (6b18-1.8.1-0ubuntu1) OpenJDK 64-Bit Server VM (build 16.0-b13, mixed mode) On 02/27/2011 11:30 AM, Andreas Kollegger wrote: To be thorough, what does your settings.xml look like, and what do you have MAVEN_OPTS set to? Are you using any proxies for maven repositories? Are you on your own network, etc? And, while we're at it: `java -version` and `uname -a` There must be a subtle SNAPSHOT artifact problem, is all I can think of. Just for a sanity check, do you have a clean VM you could spin up and try to build from? About M2, the neo4j version scheme has changed, so neo4j.version1.3.M02/neo4j.version would be the thing to try. Oh, and changing neo4j-server dependency to match version1.3.M02/version. Sorry this is so frustrating to track down. If I can replicate your setup maybe I can replicate the problem. -Andreas On Feb 27, 2011, at 5:48 PM, Nolan Darilek wrote: I just blew away my ~/.m2 and tried again, same results. People keep saying things about Neo4j M2, but the pom.xml dependency is still M1. Could that be the issue? In any case, changing to m2 doesn't work as that doesn't resolve. Maybe someone would like a local SSH account? Not sure what else to try. On 02/27/2011 05:42 AM, Andreas Kollegger wrote: On a fresh and clean Ubuntu VM (after installing java, maven, git, etc), I just cloned neo4j-spatial and tried `mvn clean install`. During the build, I noticed a few these scattered about: Feb 27, 2011 11:58:26 AM org.geotools.map.MapContent finalize SEVERE: Call MapContent dispose() to prevent memory leaks But ended up with a successful build. No failures, no errors. Cheers, Andreas On Feb 27, 2011, at 7:22 AM, Peter Neubauer wrote: Mmmh, the index provider kernel extension subsystem has been changed between 1.3.M01 and M02. I suspect an incompatible kernel version being resolved by maven. let me try to run this tomorrow from home with moving away my current maven repo and get everything fresh. (Sitting on a 3G conenction right now). Hopefully I can tell you tonight, otherwise tomorrow how that works, ok? Also, you could try to move away your ~/.m2/repository for one build and try getting all artifacts fresh from the netz? Cheers, /peter neubauer GTalk: neubauer.peter Skype peter.neubauer Phone +46 704 106975 LinkedIn http://www.linkedin.com/in/neubauer Twitter http://twitter.com/peterneubauer http://www.neo4j.org - Your high performance graph database. http://startupbootcamp.org/- Öresund - Innovation happens HERE. http://www.thoughtmade.com - Scandinavia's coolest Bring-a-Thing party. On Sun, Feb 27, 2011 at 2:03 AM, Nolan Darilek no...@thewordnerd.info wrote: On 02/26/2011 05:56 PM, Craig Taverner wrote: It is working for me too. One thing that is interesting about the error message is that it says it looks like another instance is running in the *same JVM*. Is that the usual error message? (complete text was this is usually caused by another Neo4j kernel already running in this JVM for this particular store). The error is occurring at the very start of the very first test case in the TestSpatial class, so cannot be due to another test in that class. Still, I would take Peters advice, check no other java test processes are running, manually delete the database to be sure, and then try again. I don't mean to be difficult, but I *literally* did: git clone ... neo4j-spatial cd neo4j-spatial mvn install If I can get more pristine than that then do let me know, but I can't see how. The one process you'll see open in this transcript is a web app. It has nothing to do with Neo4J in anything other than it hosts its jars in its dependencies. The database is not even used at this time and, indeed, the exact same behavior happens if it isn't running. My next question, does someone have a development dependency hanging around in their local m2 repository that I don't? When you've verified that you can build a clean tree, you've first backed up ~/.m2 and removed it? In any case: desktop: ~/src/neo4j nolan@nolan-desktop:~/src/neo4j$ ps auxw |grep java nolan12111 1.4 2.8 1423840 109504 pts/1 Sl+ 16:07 2:22 [97;45m [Kjava [m [K -XX:+HeapDumpOnOutOfMemoryError -XX:+CMSClassUnloadingEnabled -Dsbt.log.noformat=true -jar /home/nolan/bin/sbt-launcher.jar jetty nolan13153 0.0 0.0 7624 896 pts/4S+ 18:55 0:00 grep
Re: [Neo4j] Can anyone compile the latest Neo4J Spatial?
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1
On 02/27/2011 01:22 PM, Michael Hunger wrote:
can you post maven dependency:tree
[INFO] Scanning for projects...
[INFO]
-
[INFO] Building Neo4j Spatial Components
[INFO]task-segment: [dependency:tree]
[INFO]
-
[WARNING] POM for 'org.rrd4j:rrd4j:pom:2.0.6:provided' is invalid.
Its dependencies (if any) will NOT be available to the current build.
[INFO] [dependency:tree {execution: default-cli}]
[WARNING] POM for 'org.rrd4j:rrd4j:pom:2.0.6:provided' is invalid.
Its dependencies (if any) will NOT be available to the current build.
[INFO] org.neo4j:neo4j-spatial:bundle:0.4-SNAPSHOT
[INFO] +- org.neo4j:neo4j-kernel:jar:1.3-1.3.M01:compile
[INFO] | \-
org.apache.geronimo.specs:geronimo-jta_1.1_spec:jar:1.1.1:compile
[INFO] +- org.neo4j:neo4j-lucene-index:jar:0.5-1.3.M01:compile
[INFO] | \-
org.apache.servicemix.bundles:org.apache.servicemix.bundles.lucene:jar:3.0.1_2:compile
[INFO] +- org.neo4j.app:neo4j-server:jar:0.6-SNAPSHOT:provided
[INFO] | +- org.neo4j:neo4j:pom:1.3-SNAPSHOT:provided
[INFO] | | +- org.neo4j:neo4j-graph-algo:jar:1.3-SNAPSHOT:provided
[INFO] | | +- org.neo4j:neo4j-udc:jar:1.3-SNAPSHOT:provided
[INFO] | | +- org.neo4j:neo4j-management:jar:1.3-SNAPSHOT:provided
[INFO] | | | \- com.sun:tools:jar:1.6:system
[INFO] | | +- org.neo4j:neo4j-com:jar:1.3-SNAPSHOT:provided
[INFO] | | | \- org.jboss.netty:netty:jar:3.2.1.Final:provided
[INFO] | | \- org.neo4j:neo4j-ha:jar:1.3-SNAPSHOT:provided
[INFO] | | \- org.apache.zookeeper:zookeeper:jar:3.3.2:provided
[INFO] | +- org.mortbay.jetty:jetty:jar:6.1.25:provided
[INFO] | | +- org.mortbay.jetty:jetty-util:jar:6.1.25:provided
[INFO] | | \- org.mortbay.jetty:servlet-api:jar:2.5-20081211:provided
[INFO] | +- com.sun.jersey:jersey-server:jar:1.3:provided
[INFO] | | +- com.sun.jersey:jersey-core:jar:1.3:provided
[INFO] | | | \- javax.ws.rs:jsr311-api:jar:1.1.1:provided
[INFO] | | \- asm:asm:jar:3.1:provided
[INFO] | +- commons-configuration:commons-configuration:jar:1.6:provided
[INFO] | | +- commons-collections:commons-collections:jar:3.2.1:provided
[INFO] | | +- commons-lang:commons-lang:jar:2.4:provided
[INFO] | | +- commons-logging:commons-logging:jar:1.1.1:provided
[INFO] | | +- commons-digester:commons-digester:jar:1.8:provided
[INFO] | | | \- commons-beanutils:commons-beanutils:jar:1.7.0:provided
[INFO] | | \- commons-beanutils:commons-beanutils-core:jar:1.8.0:provided
[INFO] | +- commons-io:commons-io:jar:1.4:provided
[INFO] | +- org.codehaus.jackson:jackson-jaxrs:jar:1.6.1:provided
[INFO] | | \- org.codehaus.jackson:jackson-core-asl:jar:1.6.1:provided
[INFO] | +- org.codehaus.jackson:jackson-mapper-asl:jar:1.6.1:provided
[INFO] | +- com.tinkerpop:gremlin:jar:0.7:provided
[INFO] | | +- com.tinkerpop:blueprints:jar:0.4:provided
[INFO] | | | +- net.sf.jung:jung-api:jar:2.0:provided
[INFO] | | | | \-
net.sourceforge.collections:collections-generic:jar:4.01:provided
[INFO] | | | +- net.fortytwo.sesametools:common:jar:1.1:provided
[INFO] | | | | +- org.slf4j:slf4j-log4j12:jar:1.5.2:provided
[INFO] | | | | +- org.openrdf.sesame:sesame-sail-api:jar:2.3.2:provided
[INFO] | | | | | +- org.openrdf.sesame:sesame-query:jar:2.3.2:provided
[INFO] | | | | | | \-
org.openrdf.sesame:sesame-rio-api:jar:2.3.2:provided
[INFO] | | | | | | \-
info.aduna.commons:aduna-commons-net:jar:2.6.0:provided
[INFO] | | | | | |\-
info.aduna.commons:aduna-commons-text:jar:2.6.0:provided
[INFO] | | | | | +-
org.openrdf.sesame:sesame-queryalgebra-model:jar:2.3.2:provided
[INFO] | | | | | +- org.openrdf.sesame:sesame-model:jar:2.3.2:provided
[INFO] | | | | | | \-
info.aduna.commons:aduna-commons-i18n:jar:1.3.0:provided
[INFO] | | | | | \-
info.aduna.commons:aduna-commons-lang:jar:2.8.0:provided
[INFO] | | | | \-
org.openrdf.sesame:sesame-queryalgebra-evaluation:jar:2.3.2:provided
[INFO] | | | | \-
info.aduna.commons:aduna-commons-collections:jar:2.7.0:provided
[INFO] | | | \-
info.aduna.commons:aduna-commons-iteration:jar:2.8.0:provided
[INFO] | | | \-
info.aduna.commons:aduna-commons-concurrent:jar:2.6.0:provided
[INFO] | | +- com.tinkerpop:pipes:jar:0.3:provided
[INFO] | | +- org.codehaus.groovy:groovy:jar:1.7.5:provided
[INFO] | | | +- antlr:antlr:jar:2.7.7:provided
[INFO] | | | +- asm:asm-commons:jar:3.2:provided
[INFO] | | | +- asm:asm-util:jar:3.2:provided
[INFO] | | | +- asm:asm-analysis:jar:3.2:provided
[INFO] | | | \- asm:asm-tree:jar:3.2:provided
[INFO] | | +- org.fusesource.jansi:jansi:jar:1.5:provided
[INFO] | | \- org.codehaus.groovy.maven:gmaven-plugin:jar:1.0:provided
[INFO] | | +-
org.codehaus.groovy.maven.runtime:gmaven-runtime-api:jar:1.0:provided
[INFO] | | | \-
[Neo4j] Hosted OSM and library design considerations
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Just had a very nice chat with one of you, not sure whom, about Neo4J Spatial's future, and we talked briefly about the possibility of a remotely-hosted OSM dataset. I'm working on Hermes, an accessible navigation platform (http://hermesgps.info). You can see an example of what I'm doing at http://thewordnerd.homeip.net/#30.267153,-97.74306 when it's actually running. At the moment it's hosting a very small subset of OSM data, only Texas, but I'd eventually like to host/access the entire planet. This will require a business model, so I'm planning on doing something like a $5-$10/month subscription--definitely a bargain when you consider that the cheapest accessible GPS costs ~$800. :) An externally-hosted and updated OSM planet would be an interesting option, though, and would drastically cut costs/requirements on my end. Not knowing much about Neo4J just yet, though, I'm wondering what considerations I should make in my current designs to allow for this possibility should it be available and should I choose to take it? For instance, at the moment I have OSM data stored in an H2 database, and user points/users stored in MongoDB. This, as you might imagine, is messy. First, there are times when I refer to points by their ID--in the web services API, for instance--and I have to search for the ID in two places. I'm looking forward to storing both types of points in the same database such that one place is the definitive dataset. Only, would this be doable with the possible hosted solution? that is, can a Neo4J instance merge the remote OSM data and the local list of private points such that if I ask for everything in a 100-meter radius, then points from both sources would automatically appear? Or should I start designing some sort of DataSetContainer that searches multiple datasets and combines their results? Also, is it possible to delegate access to different portions of a database? So, for instance, I could host my users and their data locally somehow, but still access OSM data remotely, and treat it like the same database? I realize this won't be happening too terribly soon, but having just redesigned a rather fundamental piece of my core API to make it dataset-agnostic, I'd kind of like to avoid having to do that again in the near future if I can avoid it. :) So if I know how these things are expected to work, then I can know whether or not my current single-dataset design is usable. Thanks. -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.10 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ iEYEARECAAYFAk1qxkwACgkQIaMjFWMehWIJcwCfZRzW2mh5K9B0QNBmy0/kKO+n dykAn1J7LA0ABR3W5DylTJe5It3Zm4jB =uboT -END PGP SIGNATURE- ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user
Re: [Neo4j] Hosted OSM and library design considerations
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 02/27/2011 04:21 PM, Michael Hunger wrote: It was me :) As you sent me the access credentials I assumed you knew. You know, that makes a surprising amount of sense. :) I'm having 3-4 separate conversations this afternoon with at least half a dozen people so my brain is all over the place. Thanks again for all the help. -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.10 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ iEYEARECAAYFAk1q0GsACgkQIaMjFWMehWKMCQCfRDKcD0tWb2LF4anAd7knJhS5 SpMAn3KrnDxzLLqdU16QrhSNCNN4lRRG =x/5D -END PGP SIGNATURE- ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user
Re: [Neo4j] More build issues
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 02/27/2011 05:38 PM, Michael Hunger wrote: What neo4j-spatial did you use? The locally fixed ? This is _still_ at 1.3-M01 or the remote github branch (that one I updated to M03). The M03 branch. -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.10 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ iEYEARECAAYFAk1q4PkACgkQIaMjFWMehWLMSgCePKC+G+UqoEf/Oq9Co3wV8kjQ 1zQAn3zsIrey6EaKXifehfc4pfFbzFpG =WTV1 -END PGP SIGNATURE- ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user
Re: [Neo4j] More build issues
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 02/27/2011 05:43 PM, Michael Hunger wrote: Can you then provide how your classpath is setup for the scala shell, so how the dependencies are pulled? And perhaps a similar transitive listing like the one from maven. Not immediately sure. I'll research and get back to you. I tried using sbt's make-pom action to output a pom.xml, but unfortunately that looked fine. I don't think there's an SBT action to print dependencies, but I'll see what I can find out. Maybe this will help, maybe it won't. I'm pretty sure I compiled the M03 branch, but if I comment out the neo4j-spatial dependency in my project, I end up with only the 1.3.M03 files. Leave it in and I seem to get the M01 kernel. Anyhow, I'll see if I can figure out how to get a dependency graph, if that's possible. -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.10 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ iEYEARECAAYFAk1q6AgACgkQIaMjFWMehWICkwCeKjbvknUPvnKFRqEXz7y4bJ/A LTMAni2QvuCeUiUH/k6sxQyUjK1BFw9U =CUWU -END PGP SIGNATURE- ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user
[Neo4j] Can anyone compile the latest Neo4J Spatial?
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Wondering if something didn't get committed somewhere? I tried both with an update as well as with a fresh checkout and am getting a ton of test errors, not failures. Here's a sample Surefire output. This was gotten from a fresh checkout running mvn install: - --- Test set: org.neo4j.gis.spatial.TestSpatial - --- Tests run: 10, Failures: 0, Errors: 10, Skipped: 0, Time elapsed: 1.558 sec FAILURE! Test Import of billesholm.osm(org.neo4j.gis.spatial.TestSpatial$1) Time elapsed: 1.513 sec ERROR! java.lang.AbstractMethodError at org.neo4j.kernel.KernelExtension$KernelData.loadAll(KernelExtension.java:178) at org.neo4j.kernel.EmbeddedGraphDbImpl$2.load(EmbeddedGraphDbImpl.java:164) at org.neo4j.kernel.EmbeddedGraphDbImpl.init(EmbeddedGraphDbImpl.java:169) at org.neo4j.kernel.EmbeddedGraphDatabase.init(EmbeddedGraphDatabase.java:80) at org.neo4j.gis.spatial.Neo4jTestCase.reActivateDatabase(Neo4jTestCase.java:123) at org.neo4j.gis.spatial.Neo4jTestCase.setUp(Neo4jTestCase.java:88) at org.neo4j.gis.spatial.TestSpatial.setUp(TestSpatial.java:255) at junit.framework.TestCase.runBare(TestCase.java:132) at junit.framework.TestResult$1.protect(TestResult.java:110) at junit.framework.TestResult.runProtected(TestResult.java:128) at junit.framework.TestResult.run(TestResult.java:113) at junit.framework.TestCase.run(TestCase.java:124) at junit.framework.TestSuite.runTest(TestSuite.java:243) at junit.framework.TestSuite.run(TestSuite.java:238) at org.junit.internal.runners.JUnit38ClassRunner.run(JUnit38ClassRunner.java:83) at org.apache.maven.surefire.junit4.JUnit4TestSet.execute(JUnit4TestSet.java:59) at org.apache.maven.surefire.suite.AbstractDirectoryTestSuite.executeTestSet(AbstractDirectoryTestSuite.java:120) at org.apache.maven.surefire.suite.AbstractDirectoryTestSuite.execute(AbstractDirectoryTestSuite.java:103) at org.apache.maven.surefire.Surefire.run(Surefire.java:169) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:616) at org.apache.maven.surefire.booter.SurefireBooter.runSuitesInProcess(SurefireBooter.java:350) at org.apache.maven.surefire.booter.SurefireBooter.main(SurefireBooter.java:1021) Test Spatial Index on billesholm.osm(org.neo4j.gis.spatial.TestSpatial$2) Time elapsed: 0.003 sec ERROR! org.neo4j.graphdb.TransactionFailureException: Could not create data source [nioneodb], see nested exception for cause of error at org.neo4j.kernel.impl.transaction.TxModule.registerDataSource(TxModule.java:153) at org.neo4j.kernel.GraphDbInstance.start(GraphDbInstance.java:106) at org.neo4j.kernel.EmbeddedGraphDbImpl.init(EmbeddedGraphDbImpl.java:167) at org.neo4j.kernel.EmbeddedGraphDatabase.init(EmbeddedGraphDatabase.java:80) at org.neo4j.gis.spatial.Neo4jTestCase.reActivateDatabase(Neo4jTestCase.java:123) at org.neo4j.gis.spatial.Neo4jTestCase.setUp(Neo4jTestCase.java:88) at org.neo4j.gis.spatial.TestSpatial.setUp(TestSpatial.java:255) at junit.framework.TestCase.runBare(TestCase.java:132) at junit.framework.TestResult$1.protect(TestResult.java:110) at junit.framework.TestResult.runProtected(TestResult.java:128) at junit.framework.TestResult.run(TestResult.java:113) at junit.framework.TestCase.run(TestCase.java:124) at junit.framework.TestSuite.runTest(TestSuite.java:243) at junit.framework.TestSuite.run(TestSuite.java:238) at org.junit.internal.runners.JUnit38ClassRunner.run(JUnit38ClassRunner.java:83) at org.apache.maven.surefire.junit4.JUnit4TestSet.execute(JUnit4TestSet.java:59) at org.apache.maven.surefire.suite.AbstractDirectoryTestSuite.executeTestSet(AbstractDirectoryTestSuite.java:120) at org.apache.maven.surefire.suite.AbstractDirectoryTestSuite.execute(AbstractDirectoryTestSuite.java:103) at org.apache.maven.surefire.Surefire.run(Surefire.java:169) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:616) at org.apache.maven.surefire.booter.SurefireBooter.runSuitesInProcess(SurefireBooter.java:350) at
Re: [Neo4j] Can anyone compile the latest Neo4J Spatial?
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1
On 02/26/2011 05:56 PM, Craig Taverner wrote:
It is working for me too.
One thing that is interesting about the error message is that it says it
looks like another instance is running in the *same JVM*. Is that the usual
error message? (complete text was this is usually caused by another Neo4j
kernel already running in this JVM for this particular store).
The error is occurring at the very start of the very first test case in the
TestSpatial class, so cannot be due to another test in that class.
Still, I would take Peters advice, check no other java test processes are
running, manually delete the database to be sure, and then try again.
I don't mean to be difficult, but I *literally* did:
git clone ... neo4j-spatial
cd neo4j-spatial
mvn install
If I can get more pristine than that then do let me know, but I can't
see how.
The one process you'll see open in this transcript is a web app. It has
nothing to do with Neo4J in anything other than it hosts its jars in its
dependencies. The database is not even used at this time and, indeed,
the exact same behavior happens if it isn't running.
My next question, does someone have a development dependency hanging
around in their local m2 repository that I don't? When you've verified
that you can build a clean tree, you've first backed up ~/.m2 and
removed it? In any case:
desktop: ~/src/neo4jnolan@nolan-desktop:~/src/neo4j$ ps auxw |grep java
nolan12111 1.4 2.8 1423840 109504 pts/1 Sl+ 16:07 2:22
[97;45m[Kjava[m[K -XX:+HeapDumpOnOutOfMemoryError
- -XX:+CMSClassUnloadingEnabled -Dsbt.log.noformat=true -jar
/home/nolan/bin/sbt-launcher.jar jetty
nolan13153 0.0 0.0 7624 896 pts/4S+ 18:55 0:00 grep
- --color=auto [97;45m[Kjava[m[K
]0;nolan@nolan-desktop: ~/src/neo4jnolan@nolan-desktop:~/src/neo4j$
git clone git://github.com/neo4j/neo4j-spatial
Initialized empty Git repository in
/home/nolan/src/neo4j/neo4j-spatial/.git/
remote: Counting objects: 3065, done.[K
...
Resolving deltas: 100% (1247/1247), done.
]0;nolan@nolan-desktop: ~/src/neo4jnolan@nolan-desktop:~/src/neo4j$ cd
neo4j-spatial
]0;nolan@nolan-desktop:
~/src/neo4j/neo4j-spatialnolan@nolan-desktop:~/src/neo4j/neo4j-spatial$
mvn install
[INFO] Scanning for projects...
[INFO]
-
[INFO] Building Neo4j Spatial Components
[INFO]task-segment: [install]
[INFO]
-
[WARNING] POM for 'org.rrd4j:rrd4j:pom:2.0.6:provided' is invalid.
Its dependencies (if any) will NOT be available to the current build.
[INFO] [enforcer:enforce {execution: enforce-maven}]
[INFO] [license:check {execution: check-licenses}]
[INFO] Checking licenses...
[INFO] [dependency:unpack-dependencies {execution: get-test-data}]
[INFO] Unpacking
/home/nolan/.m2/repository/org/neo4j/spatial/osm-test-data/20100819/osm-test-data-20100819.jar
to
/home/nolan/src/neo4j/neo4j-spatial/target
with includes null and excludes:null
[INFO] Unpacking
/home/nolan/.m2/repository/org/neo4j/spatial/shp-test-data/20100819/shp-test-data-20100819.jar
to
/home/nolan/src/neo4j/neo4j-spatial/target
with includes null and excludes:null
[INFO] [resources:resources {execution: default-resources}]
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 15 resources
[INFO] Copying 0 resource to META-INF
[INFO] [compiler:compile {execution: default-compile}]
[INFO] Compiling 70 source files to
/home/nolan/src/neo4j/neo4j-spatial/target/classes
[INFO] [resources:testResources {execution: default-testResources}]
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory
/home/nolan/src/neo4j/neo4j-spatial/src/test/resources
[INFO] Copying 0 resource to META-INF
[INFO] [compiler:testCompile {execution: default-testCompile}]
[INFO] Compiling 11 source files to
/home/nolan/src/neo4j/neo4j-spatial/target/test-classes
[INFO] [surefire:test {execution: default-test}]
[INFO] Surefire report directory:
/home/nolan/src/neo4j/neo4j-spatial/target/surefire-reports
- ---
T E S T S
- ---
Running org.neo4j.gis.spatial.TestSpatialUtils
Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 1.929
sec FAILURE!
Running org.neo4j.gis.spatial.TestDynamicLayers
Tests run: 2, Failures: 0, Errors: 2, Skipped: 0, Time elapsed: 3.172
sec FAILURE!
Running org.neo4j.gis.spatial.TestOSMImport
Tests run: 6, Failures: 0, Errors: 6, Skipped: 0, Time elapsed: 8.699
sec FAILURE!
Running org.neo4j.gis.spatial.IndexProviderTest
Tests run: 3, Failures: 0, Errors: 2, Skipped: 1, Time elapsed: 2.738
sec FAILURE!
Running org.neo4j.gis.spatial.TestSearch
Tests run: 2, Failures: 0, Errors: 2, Skipped: 0, Time elapsed: 2.729
sec FAILURE!
Running org.neo4j.gis.spatial.LayersTest
Tests
Re: [Neo4j] Can't get a spatial layer
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 02/21/2011 05:46 PM, Craig Taverner wrote: But now you are running the reIndex method on a database you previously shutdown. You need to re-open the database for reIndex to work. Also, you should shutdown the batchinserter after the importFile and before opening the database again. The sequence should be: Yeah, that did it. Thanks for the help, I likely wouldn't have figured that out on my own. :) -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.10 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ iEYEARECAAYFAk1j5JYACgkQIaMjFWMehWIYtwCeNIm1y5oJB51rQgCuSSEh+vZN 4/YAn3u/+tP+w1jeLsLwahEmgMPFvXiC =tVS0 -END PGP SIGNATURE- ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user
[Neo4j] Can't get a spatial layer
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1
What conditions would cause there to be no layer names returned by
spatialService.getLayerNames(), and null for all calls to
spatialService.getLayer(...)?
I tweaked my test script slightly such that it dumps me into a console
so I can see how well I've ported my data model. Only, try though I
might, I can't seem to load any layers. I'm pretty sure that my code is
correct. Here's what I have:
class Neo4JDataSet(val database:GraphDatabaseService) extends DataSet {
val spatialService = new SpatialDatabaseService(database)
println(Layers)
spatialService.getLayerNames.foreach(println)
println(Done)
...
}
The foreach line should print a list of the layers, one per line. The
database is being initialized, as I occasionally get unclean shutdown
errors if I don't shutdown() before killing the Scala REPL. I've even
tried the foreach in a transaction, but can't get a list of layers. If I
poke the database in the shell, I do see a node called map, which
happens to be the layer name I chose.
What am I missing, or what additional information can I provide? It's
hard to know exactly, since I have a couple layers of indirection at
work here. But if I access the database directly and create a
SpatialDatabaseService from the REPL, I still get 0 layers, so I must be
missing a step somewhere.
Thanks.
-BEGIN PGP SIGNATURE-
Version: GnuPG v1.4.10 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/
iEYEARECAAYFAk1iydgACgkQIaMjFWMehWI8RwCeJMFBBk+bgNNQCyAbIOjijN0M
qukAn1FA8aGrU+scGJ2Bb2e10rOuwe37
=MION
-END PGP SIGNATURE-
___
Neo4j mailing list
User@lists.neo4j.org
https://lists.neo4j.org/mailman/listinfo/user
Re: [Neo4j] Getting started with Neo4J Spatial
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 02/18/2011 11:23 AM, Craig Taverner wrote: I will answer inline below. Thanks, I'll do the same. Neo4j Spatial is a good choice for OSM data, and can load OSM files and expose them to GIS application for analysis. Are you planning to run this on a mobile device? The question of whether or not, or how well, Neo4j runs on embedded devices would need to be answered by others. I only use it (so far) on PCs. I know there was an android prototype a few years back, but I do not believe android (or other platforms) are officially supported. If you have a backend server for neo4j (which it sounds like you do), then there is no problem. Right, currently my project is client-server, with an Android app or web browser communicating with a web-based server. I've made a rough cut at a database abstraction so I can move away from LibOSM to Neo4J and, presumably, to other database types in the future should I find something that works well on mobile devices. At the moment, that's almost certainly not Neo4J Spatial. It's been chugging away importing Texas on my modest desktop for several hours, and the file is nearly at 30 gigs. Considering that this is much larger than either H2 or MongoDB's storage of the same data, I'm hoping there are plans to optimize this in the future. :) I saw something about small strings here recently, and how this might decrease storage requirements by 80%. Is that just for strings, or across the entire database? For reference, the uncompressed OSM data is only 5G so a 6X increase worries me. Anyhow, information on what I'm doing can be found at my project's development site, http://hermesgps.info. There's also an instance which may or may not be running. A live demo of an actual map can sometimes be seen at http://thewordnerd.homeip.net/#30.267153,-97.74306 though performance is pretty bad right now since my desktop is taxed with the Neo4J import. I'll refer back to that later on. what you really want. I think I would need to know more about your needs before recommending further. So at the above link, you see a list of nearby points, along with a direction and distance. The same information is also exported via web services to mobile apps in a scrollable list. What I'd hoped to do was to create an infinitely-scrolling list as commonly found in other Android apps. Unfortunately, it's hard to do that by simply bumping out the distance, since you can't necessarily know whether adding X to the bounding box dimensions might give you no points or another thousand. :) Since MongoDB can do this with a rather limited geospatial implementation, I was hoping that Neo4J or something tuned for spatial queries would *really* rock at it. Certainly Neo4j can import OSM data into a decent graph. The OSM model in Neo4j is somewhat similar to the graph model in the OSM xml files, but expressed in a more graph-friendly way. The only public information on the model so far is in the presentation I gave at FOSS4J. See these at slideshare: http://www.slideshare.net/craigtaverner/neo4j-spatial-backing-a-gis-with-a-true-graph-database (slides 13, 14 and 15 show graphs of the OSM model in the database). I'd appreciate a description of those slides if you or someone else has the time, as I can't see them. :) In any case, I'll try playing with the database myself once this import finishes and see what I can learn that way. If you want to do this in Java, take a look at the sample code at https://github.com/neo4j/neo4j-spatial/blob/master/src/test/java/org/neo4j/gis/spatial/TestDynamicLayers.java I'm doing this in Scala, so thanks for pointing me to the Java example. I've been seeing lots of old testcases and such so it was tough to find ones that were still valid. So I wrote a simple Scala script that is currently importing OSM data, and this raises a few questions. The README shows a shapefile being imported without a BatchInserter. Is there any way to do this with OSM as well? One feature I'd like to provide at some point are automatic map updates, so each week an OSM changeset would be fetched and merged in. It would be great if I could do that merge without having to shut down the live database, and to handle that changeset merge as a single transaction. I gather changeset imports aren't yet possible, but is there any way to forgo the BatchInserter? Even if the process is slower, it wouldn't necessarily have to complete quickly, and if it chugged away for a few days in the background then I'd be fine with that. Also, is there any means of determining how many OSM entities have been imported? I have an Import class that tries to track this for display purposes. My first attempt overrode the various create methods on BatchInserter to increment a counter, but that's currently at 90 million in a file that should only have 20 million or so entities. :) Finally, I'm seeing lots of geospatial queries and have a basic
[Neo4j] Getting started with Neo4J Spatial
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Hi folks. A few months ago, someone pointed me to Neo4J Spatial, though I haven't seriously investigated it until now. I have a few questions both about how to get started, as well as about what is and isn't possible. I'm currently working on a web-based (and hopefully embedded at some point) GPS navigation platform based on OSM data. The codebase is at a fairly advanced state, but I'm starting to run up against the limits of my data model. In particular, I'm encountering the following issues which I'm wondering if Neo4J Spatial can help with: My database is currently H2 with no geospatial extensions whatsoever, so I'm finding it very hard to, say, list the ten nearest points to a given location, ten more beyond that, etc. as all I'm doing is increasing the bounds on an arbitrary box and taking whatever that returns. Is this something that Neo4J can do well? It seems like a graph database would be specialized at these sorts of queries, but I could be wrong. I think I have a basic understanding of how graph databases work, but could someone relate that to how Neo4J Spatial would import OSM data? Are OSM nodes directly imported into Neo4J nodes, with ways modeling the relations between them? Or is there another scheme? I think it would really help if I can import and play with live data. Where can I find the simplest possible code to import OSM data into a Neo4J Spatial database? And, once done, how can I best play with that data? Does the shell support spatial queries? Thanks in advance. -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.10 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ iEYEARECAAYFAk1eBd4ACgkQIaMjFWMehWJ3eQCeMgpp8EgHM/ek8vnqf43E3gXN 9qEAniv56B16lZnPtFblr1AfLPr7mfFD =DJt3 -END PGP SIGNATURE- ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user
