Re: [Neo4j] Online backup works in full but not incremental
Hi Mattias, Does the latest online backup work on backup to a running read only db? Brendan On 21 February 2011 23:09, user-requ...@lists.neo4j.org wrote: Date: Mon, 21 Feb 2011 15:27:30 +0100 From: Mattias Persson matt...@neotechnology.com Subject: Re: [Neo4j] Online backup works in full but not incremental To: Neo4j user discussions user@lists.neo4j.org Message-ID: AANLkTikS26vv=aqk45jjqjijz+kdxnuzdtbp1o_sq...@mail.gmail.com Content-Type: text/plain; charset=UTF-8 I just can't reproduce your problems. How are you doing backup? It looks like (from your wrapper.log) that it's the server which somehow requests to do the incremental backup. Aren't you doing backup of the server database? 2011/2/21 Brendan Cheng ccp...@gmail.com Tobias, Here s the stack trace and part of the wrapper.log: run: Mon Feb 21 10:28:59 CST 2011: Client connected to 192.168.1.101:6362 Mon Feb 21 10:29:00 CST 2011: Opened a new channel to /192.168.1.101:6362 21-Feb-2011 10:29:20 itags.Sync.SyncData main SEVERE: null org.neo4j.com.ComException: org.neo4j.com.ComException: org.jboss.netty.handler.queue.BlockingReadTimeoutException at org.neo4j.com.Client.sendRequest(Client.java:183) at org.neo4j.com.backup.BackupClient.incrementalBackup(BackupClient.java:48) at org.neo4j.com.backup.OnlineBackup.incremental(OnlineBackup.java:115) at org.neo4j.com.backup.OnlineBackup.incremental(OnlineBackup.java:105) at itags.Sync.SyncData.RunningOnlineBackup(SyncData.java:57) at itags.Sync.SyncData.main(SyncData.java:247) Caused by: org.neo4j.com.ComException: org.jboss.netty.handler.queue.BlockingReadTimeoutException at org.neo4j.com.DechunkingChannelBuffer.readNext(DechunkingChannelBuffer.java:61) at org.neo4j.com.Client$2.readNext(Client.java:155) at org.neo4j.com.DechunkingChannelBuffer.readNextChunk(DechunkingChannelBuffer.java:79) at org.neo4j.com.DechunkingChannelBuffer.init(DechunkingChannelBuffer.java:50) at org.neo4j.com.Client$2.init(Client.java:151) at org.neo4j.com.Client.sendRequest(Client.java:150) ... 5 more Caused by: org.jboss.netty.handler.queue.BlockingReadTimeoutException at org.jboss.netty.handler.queue.BlockingReadHandler.readEvent(BlockingReadHandler.java:236) at org.jboss.netty.handler.queue.BlockingReadHandler.read(BlockingReadHandler.java:167) at org.neo4j.com.DechunkingChannelBuffer.readNext(DechunkingChannelBuffer.java:57) ... 10 more Do I miss any configuration? cheers, Brendan Date: Mon, 21 Feb 2011 01:11:19 +0800 From: Brendan ccp...@gmail.com Subject: [Neo4j] Online backup works in full but not incremental To: user@lists.neo4j.org user@lists.neo4j.org Message-ID: e837cb14-01f5-444b-ab96-6df17c41e...@gmail.com Content-Type: text/plain; charset=us-ascii Hi, After I install the neo4j on ubuntu server I'm able to backup the full database, even repeatedly but it crashed on incremental. I also fixed the problem with webadmin page loading but I found 2 issues: 1 the timeline graph can not be loaded on ie 8. 2 I experienced stack overflow on the webadmin page during the full online backup running. Also unresponsive in Save changes command issued from webadmin. I then tried webadmin from chrome and I saw the timeline graph but the add relationship panel loaded but not functional, can't enter the node I'd URL. Which browser is most compatible with webadmin? Your comment is highly appreciated! Brendan Sent from my iPad Date: Sun, 20 Feb 2011 19:07:02 +0100 From: Tobias Ivarsson tobias.ivars...@neotechnology.com Subject: Re: [Neo4j] Online backup works in full but not incremental To: Neo4j user discussions user@lists.neo4j.org Message-ID: AANLkTi=8uothpl9ptabewos_naqiz78pvusmnwvdo...@mail.gmail.com Content-Type: text/plain; charset=ISO-8859-1 On Sun, Feb 20, 2011 at 6:11 PM, Brendan ccp...@gmail.com wrote: Hi, After I install the neo4j on ubuntu server I'm able to backup the full database, even repeatedly but it crashed on incremental. Could you please provide a stacktrace, and other kinds of error output from this crash. Thank you, -- Tobias Ivarsson tobias.ivars...@neotechnology.com Hacker, Neo Technology www.neotechnology.com Cellphone: +46 706 534857 ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user -- Mattias Persson, [matt...@neotechnology.com] Hacker, Neo Technology www.neotechnology.com ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user
Re: [Neo4j] Social Networks And Graph Databases
+1 for optimizing only when necessary. Having said that, there will always be cases where sharding is necessary. Mostly a sensible domain-specific decision can be taken, but I was thinking about what Michael said about traversal statistics, and that is a great runtime idea beyond what I previously thought was the main criteria, which is network density. I wondered if the caching engine actually does keep some transient statistics on traversals, and perhaps that could be persisted in some way, and mined later by algorithms interested in sharding the graph? Perhaps even just something coarse grained, like which relationships are 'hot', traversed frequently, or recently, or both. It might also help with algorithms designed for large graph visualization, helping to identify the islands, and the areas of interest, for clustering nodes into mega-nodes when drawing very large graphs? On Tue, Feb 22, 2011 at 8:52 AM, Mattias Persson matt...@neotechnology.comwrote: 2011/2/22 J T jt4websi...@googlemail.com Hmm, I hadn't considered the apache approach but it still kind of goes against the grain - perhaps i just want too much or its my innate laziness ... hehe ;) Its not just about data size, its more about not wanting to have to re-engineer/re-factor as things grow - whether that growth is concurrent access or in data quantity. There are not that many cases (fewer than you'd might imagine) where you'd need to scale/shard out Neo4j to multiple machines just to handle the load put on it. It's great to think ahead and be aware of limitations, but there's a pretty high chance you just wont run into those. And if/when you do Neo4j will probably have evolved to handle that load for you anyway, maybe even sharding :) On Mon, Feb 21, 2011 at 11:47 PM, Michael Hunger michael.hun...@neotechnology.com wrote: Hi J.T., of course you can have the cache sharding taken care of by the server side, e.g. use an apache proxy for client sticky routing, redirecting according to URL patterns etc. But that doesn't cover your domain. The problem is that other than simple kv stores, where the sharding the key is pretty easy, sharding graphs is much more demanding. You would like to have traversal locality (so that you don't have to cross servers for a single traversal). That means something that keeps (and also updates) your subgraphs to be in just one server. And deciding which subgraphs should be put together is either a pure domain driven thing or something that could be achieved by having lots of (long running?) clients (and their request URLs) and looking at their traversal / query statistics and optimizing the data held permanently (or even mastered) on the specific node for a certain set of requests. It would also mean that the occasional cross-server traversal should result in local caches being updated for the remote data. Is the problem we're talking about just data size? You can already store pretty big graphs in a single neo4j node (esp. when you go for big machines). Michael Am 22.02.2011 um 00:15 schrieb J T: I realise that there are different qualities that can come in to play with the labels 'scalability' 'performance' and I can see how your strategy would help with some of those qualities but it relies on custom logic in the client application to do the sharding and load spreading and doesn't address scaling the underlying persistant storage engine. One of the things that attracted me to Riak and Cassandra (for the use cases I can apply them to) is that sharding, load balancing and persistance scaling was available out-of-the-box and and pretty much invisible to the client application. The client app didn't have to do anything special. I appreciate that perhaps because they have different semantics that its an easier for them to solve. I had a read of this page you wrote the other day : http://jim.webber.name/2011/02/16/3b8f4b3d-c884-4fba-ae6b-7b75a191fa22.aspx It was your comment it's hard to achieve in practice that prompted me to post my initial message yesterday to enquire further. I'm no specialist in the field, I just know what I want hehe :) The only player in the field I've been able to find that might have more of the qualities I am interested is InfiniteGraph, its a shame that it doesn't have a 'server' version like neo does for me to do a proper comparison. I'll stick with neo for now, and see how the marketplace matures in the coming months - i'm amazed at how much movement there has been in the last year. On Mon, Feb 21, 2011 at 3:09 PM, Jim Webber j...@neotechnology.com wrote: Yup, you nailed it better than I did Rick. Though your partition strategy might not be
[Neo4j] Indexing with BatchInserter (with new API) how to doubt
Hi all, I'm updating my code in order to user the new Indexing API but I have a doubt, when using the BatchInserter, (at least with the old one) you were supposed to use the classes LuceneIndexBatchInserter or LuceneFulltextIndexBatchInserter but, what about now? should I just use the new way of indexing in the middle of the batch insertions? wouldn't that indexations be supposed to be done inside transaction blocks? As you can see I'm a bit confused with this, I'd really appreciate any clarification. Cheers, Pablo -- Pablo Pareja Tobes LinkedInhttp://www.linkedin.com/in/pabloparejatobes Twitter http://www.twitter.com/pablopareja http://about.me/pablopareja http://www.ohnosequences.com ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user
[Neo4j] Question: Neo4j and semantic-mediawiki
Hi all! Recently I started exploring things about graph databases in conjunction with knowledge management and have run across the Neo4j. It now seems to me that Neo4j can somehow be used with the semantic-mediawiki to store RDF and quiery Neo4j with SPARQL. Did anyone have any experience with Neo4j + RDF + SPARQL? Or are there any resources worth reading? If so, could someone please point me to such resources?.. PS: Sorry for newbie question, of course. Dmitry N. Medvedev, Tel.: +7 916.795.1839 E-mail: dmitry.medve...@gmail.com ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user
Re: [Neo4j] Question: Neo4j and semantic-mediawiki
There is a rdf-sparql component to Neo4j that could in theory be configured to be used as a backend for semantic mediawiki. But you still have better chances to configure smw to use a triplestore http://en.wikipedia.org/wiki/Triplestore For more info see: http://www.mediawiki.org/wiki/Extension:SparqlExtension Alfredas 2011/2/22 Дмитрий Медведев dmitry.medve...@gmail.com: Hi all! Recently I started exploring things about graph databases in conjunction with knowledge management and have run across the Neo4j. It now seems to me that Neo4j can somehow be used with the semantic-mediawiki to store RDF and quiery Neo4j with SPARQL. Did anyone have any experience with Neo4j + RDF + SPARQL? Or are there any resources worth reading? If so, could someone please point me to such resources?.. PS: Sorry for newbie question, of course. Dmitry N. Medvedev, Tel.: +7 916.795.1839 E-mail: dmitry.medve...@gmail.com ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user
Re: [Neo4j] Unable to parse mapped memory
I was rather surprised by the setting. 1.2G seems quite large, and then I saw 3048MB for the heap! This is why this does not run on my laptop! I've set the values down a lot. I think the unit tests should run on most peoples computers out the box. I noticed the github commit said these settings we optimized for loading croatia.osm, but I know I could load that file with much lower settings. I think perhaps configurations for loading large datasets should not be part of the normal regression tests, which should be fast unit tests, or medium sized functional tests. I will commit my changes once I have got the OSMImporter working again. It seems your changes to the new Index API conflict somewhat with my work on changesets. I think I have it all working now, but will not commit until I'm a little more confident. On Tue, Feb 22, 2011 at 8:44 AM, Mattias Persson matt...@neotechnology.comwrote: Yup, there doesn't seem to be support for the dot notation for specifying mapped memory. I'm not sure there ever has been either. 2011/2/22 Peter Neubauer peter.neuba...@neotechnology.com Craig, I guess we need to put in 1200M instead? /peter On Monday, February 21, 2011, Craig Taverner cr...@amanzi.com wrote: Hi, Recently, since Peter moved Neo4j Spatial to 1.3M02 I think, I stopped being able to run the Neo4j Spatial unit tests in maven. Most of them now generate an error like: INFO: Unable to parse mapped memory[1.2] string for /home/craig/dev/neo4j/neo4j-spatial/target/var/neo4j-db/neostore.propertystore.db.strings I am making sure to create the database from scratch. The full error is below. Any ideas? Regards, Craig Physical mem: 2517MB, Heap size: 1020MB Feb 21, 2011 10:37:37 PM org.neo4j.kernel.impl.nioneo.store.CommonAbstractStore getMappedMem INFO: Unable to parse mapped memory[1.2] string for /home/craig/dev/neo4j/neo4j-spatial/target/var/neo4j-db/neostore.propertystore.db.strings create=true dump_configuration=true logical_log=/home/craig/dev/neo4j/neo4j-spatial/target/var/neo4j-db/nioneo_logical.log neo_store=/home/craig/dev/neo4j/neo4j-spatial/target/var/neo4j-db/neostore neostore.nodestore.db.mapped_memory=50M neostore.propertystore.db.arrays.mapped_memory=50M neostore.propertystore.db.index.keys.mapped_memory=1M neostore.propertystore.db.index.mapped_memory=1M neostore.propertystore.db.mapped_memory=400M neostore.propertystore.db.strings.mapped_memory=1.2G neostore.relationshipstore.db.mapped_memory=150M rebuild_idgenerators_fast=true store_dir=/home/craig/dev/neo4j/neo4j-spatial/target/var/neo4j-db ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user -- Mattias Persson, [matt...@neotechnology.com] Hacker, Neo Technology www.neotechnology.com ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user
Re: [Neo4j] Getting started with Neo4J Spatial
I've been doing some research into alternate storage mechanism for exact match indexes. I excluded BDB from my list because it has a commercial license. I'll share my findings once I have something concrete. Thanks. Paul Jackson, Principal Software Engineer Pitney Bowes Business Insight 4200 Parliament Place | Suite 600 | Lanham, MD 20706-1844 USA O: 301.918.0850 | M: 703.862.0120 | www.pb.com paul.jack...@pb.com Every connection is a new opportunityT Please consider the environment before printing or forwarding this email. If you do print this email, please recycle the paper. This email message may contain confidential, proprietary and/or privileged information. It is intended only for the use of the intended recipient(s). If you have received it in error, please immediately advise the sender by reply email and then delete this email message. Any disclosure, copying, distribution or use of the information contained in this email message to or by anyone other than the intended recipient is strictly prohibited. Any views expressed in this message are those of the individual sender, except where the sender specifically states them to be the views of the Company. -Original Message- From: user-boun...@lists.neo4j.org [mailto:user-boun...@lists.neo4j.org] On Behalf Of Peter Neubauer Sent: Friday, February 18, 2011 4:02 PM To: Neo4j user discussions Subject: Re: [Neo4j] Getting started with Neo4J Spatial Guys, I have started looking into the OSM imports. basically, the main problem is to fast insert the nodes into an exact-matching index, and then, when going through the ways, look the nodes up by OSM-ID in that index in order to conenct them to the ways. Lucene is not very good at that, so I have been tinkering with a BerkeleyDB based Neo4j index, see https://github.com/peterneubauer/bdb-index. Then, I removed the batchinserter from the OSM import and instead use a faster index, see the branch at https://github.com/neo4j/neo4j-spatial/tree/embedded-import using BerkeleyDB and not Lucene, and actually passing the basic test suite. This is early work and not at all stable, I am right now trying to profile the import, but this would be something that could improve performance to predictable times. I am testing with Croatia.osm to start with (1.3M nodes, 230K ways) and want to get in Germany.osm (60M nodes, 8M ways). I will be away for a week, but I hope that maybe others can look into profiling the OSM import during this time. Just saying - this is something we are aware of and would highly appreciate help with, so feel free to fork and improve! Cheers, /peter neubauer GTalk: neubauer.peter Skype peter.neubauer Phone +46 704 106975 LinkedIn http://www.linkedin.com/in/neubauer Twitter http://twitter.com/peterneubauer http://www.neo4j.org - Your high performance graph database. http://startupbootcamp.org/ - Öresund - Innovation happens HERE. http://www.thoughtmade.com - Scandinavia's coolest Bring-a-Thing party. On Fri, Feb 18, 2011 at 9:54 PM, Nolan Darilek no...@thewordnerd.info wrote: -BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 02/18/2011 02:49 PM, bryce hendrix wrote: Nolan, The first experience with Neo4j Spatial was with the texas.osm file. I imported it on my notebook I think it took 15 hours, if I remember correctly. I quickly decided to play around with just Austin for the time Oh wow. I'm hoping this is being improved as well? I'm through a bit over 1.6 million ways and all nodes so I'm hoping it won't take 15 hours. being. If you'd like, i can zip up my Austin file (just Austin, not any of the suburbs) and send it to you. Austin takes about 30 secs to import and index. That'd be great, especially as I'm in Austin and can actually use the data live. Thanks. -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.10 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ iEYEARECAAYFAk1e3HsACgkQIaMjFWMehWIcOgCcDvEN+hMfsxtgzLZXAke27tQq YM0AnA8drtsoCTaFQ+gZgR8cV2/fSWxG =Y3TB -END PGP SIGNATURE- ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user
Re: [Neo4j] Gremlin from Java Error
Hey, Thanks a lot. Updated to 0.8-SNAPSHOT. Strangely maven did not resolve groovy dependence automatically. Had to add it by hand. Huh? Gremlin 0.8-SNAPSHOT uses Groovy 1.7.8 (which was released maybe 1 week ago). Gremlin 0.7 was using Groovy 1.7.5. Perhaps something about that was making it burp? What do you mean add it by hand? ScriptEngine approach works fine, Gremlin.compile(expr) does not? Were you compiling a Pipe or a Gremlin statement? Compile can only be used to create a Pipe: public static Pipe compile(final String gremlin); See the first section of: https://github.com/tinkerpop/gremlin/wiki/Using-Gremlin-through-Java If you want to do an arbitrary Gremlin statement, then you use GremlinScriptEngine.eval(); ?? Or, is it because you haven't linked Groovy into your project. Realize that Gremlin class is Gremlin.groovy, not Gremlin.java. Thus, you need to make sure you have gmaven-pluggin support in your pom.xml. See the second section of: https://github.com/tinkerpop/gremlin/wiki/Using-Gremlin-through-Groovy I understand that it could be fastercleaner to use groovy, but I need to be able to pass string queries and get results back. In my use-case this is the definite use of gremlin - arbitrary string queries. Gotcha. For static business logic I can use Pipes - I'm not bothered by the wordy expressions. Cool. You can get around that by using Gremlin.compile() :P. In that way, you can compile a Gremlin statement to get the raw Pipes. Enjoy, Marko. http://markorodriguez.com ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user
Re: [Neo4j] Getting started with Neo4J Spatial
Paul, Aim considering JDBM also, should be very similar toj the BDB index approach ... That ,something you would like to see? On Tuesday, February 22, 2011, Paul A. Jackson paul.jack...@pb.com wrote: I've been doing some research into alternate storage mechanism for exact match indexes. I excluded BDB from my list because it has a commercial license. I'll share my findings once I have something concrete. Thanks. Paul Jackson, Principal Software Engineer Pitney Bowes Business Insight 4200 Parliament Place | Suite 600 | Lanham, MD 20706-1844 USA O: 301.918.0850 | M: 703.862.0120 | www.pb.com paul.jack...@pb.com Every connection is a new opportunityT Please consider the environment before printing or forwarding this email. If you do print this email, please recycle the paper. This email message may contain confidential, proprietary and/or privileged information. It is intended only for the use of the intended recipient(s). If you have received it in error, please immediately advise the sender by reply email and then delete this email message. Any disclosure, copying, distribution or use of the information contained in this email message to or by anyone other than the intended recipient is strictly prohibited. Any views expressed in this message are those of the individual sender, except where the sender specifically states them to be the views of the Company. -Original Message- From: user-boun...@lists.neo4j.org [mailto:user-boun...@lists.neo4j.org] On Behalf Of Peter Neubauer Sent: Friday, February 18, 2011 4:02 PM To: Neo4j user discussions Subject: Re: [Neo4j] Getting started with Neo4J Spatial Guys, I have started looking into the OSM imports. basically, the main problem is to fast insert the nodes into an exact-matching index, and then, when going through the ways, look the nodes up by OSM-ID in that index in order to conenct them to the ways. Lucene is not very good at that, so I have been tinkering with a BerkeleyDB based Neo4j index, see https://github.com/peterneubauer/bdb-index. Then, I removed the batchinserter from the OSM import and instead use a faster index, see the branch at https://github.com/neo4j/neo4j-spatial/tree/embedded-import using BerkeleyDB and not Lucene, and actually passing the basic test suite. This is early work and not at all stable, I am right now trying to profile the import, but this would be something that could improve performance to predictable times. I am testing with Croatia.osm to start with (1.3M nodes, 230K ways) and want to get in Germany.osm (60M nodes, 8M ways). I will be away for a week, but I hope that maybe others can look into profiling the OSM import during this time. Just saying - this is something we are aware of and would highly appreciate help with, so feel free to fork and improve! Cheers, /peter neubauer GTalk: neubauer.peter Skype peter.neubauer Phone +46 704 106975 LinkedIn http://www.linkedin.com/in/neubauer Twitter http://twitter.com/peterneubauer http://www.neo4j.org - Your high performance graph database. http://startupbootcamp.org/ - Öresund - Innovation happens HERE. http://www.thoughtmade.com - Scandinavia's coolest Bring-a-Thing party. On Fri, Feb 18, 2011 at 9:54 PM, Nolan Darilek no...@thewordnerd.info wrote: -BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 02/18/2011 02:49 PM, bryce hendrix wrote: Nolan, The first experience with Neo4j Spatial was with the texas.osm file. I imported it on my notebook I think it took 15 hours, if I remember correctly. I quickly decided to play around with just Austin for the time Oh wow. I'm hoping this is being improved as well? I'm through a bit over 1.6 million ways and all nodes so I'm hoping it won't take 15 hours. being. If you'd like, i can zip up my Austin file (just Austin, not any of the suburbs) and send it to you. Austin takes about 30 secs to import and index. That'd be great, especially as I'm in Austin and can actually use the data live. Thanks. -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.10 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ iEYEARECAAYFAk1e3HsACgkQIaMjFWMehWIcOgCcDvEN+hMfsxtgzLZXAke27tQq YM0AnA8drtsoCTaFQ+gZgR8cV2/fSWxG =Y3TB -END PGP SIGNATURE- ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j. https://lists.neo4j.org/mailman/listinfo/user ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user
Re: [Neo4j] Question: Neo4j and semantic-mediawiki
This looks great. I've encountered a problem when following the example. Here I'm trying to create a sail out of Neo4jGraph. java.lang.RuntimeException: No such index exists: edges at com.tinkerpop.blueprints.pgm.impls.neo4j.Neo4jGraph.getIndex(Neo4jGraph.java:113) at com.tinkerpop.blueprints.pgm.oupls.sail.GraphSail.init(GraphSail.java:88) at com.tinkerpop.blueprints.pgm.oupls.sail.GraphSail.init(GraphSail.java:66) Any ideas? Thanks, Alfredas On Tue, Feb 22, 2011 at 4:17 PM, Marko Rodriguez okramma...@gmail.com wrote: Hi, Did anyone have any experience with Neo4j + RDF + SPARQL? Or are there any resources worth reading? If so, could someone please point me to such resources?.. There is a 1-to-1 RDF mapper in Blueprints. It turns any Blueprints GraphDB into a Sail-based RDF triple/quad store. Given the 1-to-1 nature, you can work with your data from the perspective of the Blueprints API, Sail API, or Neo4j API. https://github.com/tinkerpop/blueprints/wiki/Sail-Ouplementation Through Sail you can do SPARQL, SeRQL, RQL, and Gremlin. See ya, Marko. http://markorodriguez.com ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user
Re: [Neo4j] Question: Neo4j and semantic-mediawiki
Hi, I apologize. When I said 1-to-1, I spoke with exaggeration. You will need to create a GraphSail from a blank Neo4jGraph initially. Sail sail = new GraphSail(new Neo4jGraph(/tmp/neo4jgraphsail)) At that point, you can move back and forth. The reason being, GraphSail requires indices that are appropriate for efficient statement/SPARQL type queries. Moreover, you can't simply take a Neo4jGraph that you already have an make it an RDF triple/quad store. This is because RDF requires URIs, blank nodes, and literals for it to work -- thus, arbitrary properties on a graph are not allowed through Sail. So, 1-to-1 should read: Once you have created a GraphSail, you can GraphSail.getGraph() to work with your graph using native APIs. Apologies for the confusion, Marko. http://markorodriguez.com On Feb 22, 2011, at 10:01 AM, Alfredas Chmieliauskas wrote: This looks great. I've encountered a problem when following the example. Here I'm trying to create a sail out of Neo4jGraph. java.lang.RuntimeException: No such index exists: edges at com.tinkerpop.blueprints.pgm.impls.neo4j.Neo4jGraph.getIndex(Neo4jGraph.java:113) at com.tinkerpop.blueprints.pgm.oupls.sail.GraphSail.init(GraphSail.java:88) at com.tinkerpop.blueprints.pgm.oupls.sail.GraphSail.init(GraphSail.java:66) Any ideas? Thanks, Alfredas On Tue, Feb 22, 2011 at 4:17 PM, Marko Rodriguez okramma...@gmail.com wrote: Hi, Did anyone have any experience with Neo4j + RDF + SPARQL? Or are there any resources worth reading? If so, could someone please point me to such resources?.. There is a 1-to-1 RDF mapper in Blueprints. It turns any Blueprints GraphDB into a Sail-based RDF triple/quad store. Given the 1-to-1 nature, you can work with your data from the perspective of the Blueprints API, Sail API, or Neo4j API. https://github.com/tinkerpop/blueprints/wiki/Sail-Ouplementation Through Sail you can do SPARQL, SeRQL, RQL, and Gremlin. See ya, Marko. http://markorodriguez.com ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user
Re: [Neo4j] Getting started with Neo4J Spatial
Yes, in my tests I included jdbm hmap, btree, and jboss cache backed by jdbm (presumably btree) and got the best performance with jboss cache, followed closely by btree and hmap a distant third. I would like to test hsql and derby before finishing. Thanks, -Paul Paul Jackson, Principal Software Engineer Pitney Bowes Business Insight 4200 Parliament Place | Suite 600 | Lanham, MD 20706-1844 USA O: 301.918.0850 | M: 703.862.0120 | www.pb.com paul.jack...@pb.com Every connection is a new opportunityT Please consider the environment before printing or forwarding this email. If you do print this email, please recycle the paper. This email message may contain confidential, proprietary and/or privileged information. It is intended only for the use of the intended recipient(s). If you have received it in error, please immediately advise the sender by reply email and then delete this email message. Any disclosure, copying, distribution or use of the information contained in this email message to or by anyone other than the intended recipient is strictly prohibited. Any views expressed in this message are those of the individual sender, except where the sender specifically states them to be the views of the Company. -Original Message- From: user-boun...@lists.neo4j.org [mailto:user-boun...@lists.neo4j.org] On Behalf Of Peter Neubauer Sent: Tuesday, February 22, 2011 10:51 AM To: Neo4j user discussions Subject: Re: [Neo4j] Getting started with Neo4J Spatial Paul, Aim considering JDBM also, should be very similar toj the BDB index approach ... That ,something you would like to see? On Tuesday, February 22, 2011, Paul A. Jackson paul.jack...@pb.com wrote: I've been doing some research into alternate storage mechanism for exact match indexes. I excluded BDB from my list because it has a commercial license. I'll share my findings once I have something concrete. Thanks. Paul Jackson, Principal Software Engineer Pitney Bowes Business Insight 4200 Parliament Place | Suite 600 | Lanham, MD 20706-1844 USA O: 301.918.0850 | M: 703.862.0120 | www.pb.com paul.jack...@pb.com Every connection is a new opportunityT Please consider the environment before printing or forwarding this email. If you do print this email, please recycle the paper. This email message may contain confidential, proprietary and/or privileged information. It is intended only for the use of the intended recipient(s). If you have received it in error, please immediately advise the sender by reply email and then delete this email message. Any disclosure, copying, distribution or use of the information contained in this email message to or by anyone other than the intended recipient is strictly prohibited. Any views expressed in this message are those of the individual sender, except where the sender specifically states them to be the views of the Company. -Original Message- From: user-boun...@lists.neo4j.org [mailto:user-boun...@lists.neo4j.org] On Behalf Of Peter Neubauer Sent: Friday, February 18, 2011 4:02 PM To: Neo4j user discussions Subject: Re: [Neo4j] Getting started with Neo4J Spatial Guys, I have started looking into the OSM imports. basically, the main problem is to fast insert the nodes into an exact-matching index, and then, when going through the ways, look the nodes up by OSM-ID in that index in order to conenct them to the ways. Lucene is not very good at that, so I have been tinkering with a BerkeleyDB based Neo4j index, see https://github.com/peterneubauer/bdb-index. Then, I removed the batchinserter from the OSM import and instead use a faster index, see the branch at https://github.com/neo4j/neo4j-spatial/tree/embedded-import using BerkeleyDB and not Lucene, and actually passing the basic test suite. This is early work and not at all stable, I am right now trying to profile the import, but this would be something that could improve performance to predictable times. I am testing with Croatia.osm to start with (1.3M nodes, 230K ways) and want to get in Germany.osm (60M nodes, 8M ways). I will be away for a week, but I hope that maybe others can look into profiling the OSM import during this time. Just saying - this is something we are aware of and would highly appreciate help with, so feel free to fork and improve! Cheers, /peter neubauer GTalk: neubauer.peter Skype peter.neubauer Phone +46 704 106975 LinkedIn http://www.linkedin.com/in/neubauer Twitter http://twitter.com/peterneubauer http://www.neo4j.org - Your high performance graph database. http://startupbootcamp.org/ - Öresund - Innovation happens HERE. http://www.thoughtmade.com - Scandinavia's coolest Bring-a-Thing party. On Fri, Feb 18, 2011 at 9:54 PM, Nolan Darilek no...@thewordnerd.info wrote: -BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 02/18/2011 02:49 PM, bryce hendrix wrote: Nolan, The first
Re: [Neo4j] Can't get a spatial layer
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 02/21/2011 05:46 PM, Craig Taverner wrote: But now you are running the reIndex method on a database you previously shutdown. You need to re-open the database for reIndex to work. Also, you should shutdown the batchinserter after the importFile and before opening the database again. The sequence should be: Yeah, that did it. Thanks for the help, I likely wouldn't have figured that out on my own. :) -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.10 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ iEYEARECAAYFAk1j5JYACgkQIaMjFWMehWIYtwCeNIm1y5oJB51rQgCuSSEh+vZN 4/YAn3u/+tP+w1jeLsLwahEmgMPFvXiC =tVS0 -END PGP SIGNATURE- ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user
Re: [Neo4j] Question: Neo4j and semantic-mediawiki
Got it. It would be great to be able to use Sparql on neo4j or any other Blueprint db. Do you think it would be possible to map/translate sparql query to gremlin/pipes? Alfredas On Tue, Feb 22, 2011 at 5:09 PM, Marko Rodriguez okramma...@gmail.com wrote: Hi, I apologize. When I said 1-to-1, I spoke with exaggeration. You will need to create a GraphSail from a blank Neo4jGraph initially. Sail sail = new GraphSail(new Neo4jGraph(/tmp/neo4jgraphsail)) At that point, you can move back and forth. The reason being, GraphSail requires indices that are appropriate for efficient statement/SPARQL type queries. Moreover, you can't simply take a Neo4jGraph that you already have an make it an RDF triple/quad store. This is because RDF requires URIs, blank nodes, and literals for it to work -- thus, arbitrary properties on a graph are not allowed through Sail. So, 1-to-1 should read: Once you have created a GraphSail, you can GraphSail.getGraph() to work with your graph using native APIs. Apologies for the confusion, Marko. http://markorodriguez.com On Feb 22, 2011, at 10:01 AM, Alfredas Chmieliauskas wrote: This looks great. I've encountered a problem when following the example. Here I'm trying to create a sail out of Neo4jGraph. java.lang.RuntimeException: No such index exists: edges at com.tinkerpop.blueprints.pgm.impls.neo4j.Neo4jGraph.getIndex(Neo4jGraph.java:113) at com.tinkerpop.blueprints.pgm.oupls.sail.GraphSail.init(GraphSail.java:88) at com.tinkerpop.blueprints.pgm.oupls.sail.GraphSail.init(GraphSail.java:66) Any ideas? Thanks, Alfredas On Tue, Feb 22, 2011 at 4:17 PM, Marko Rodriguez okramma...@gmail.com wrote: Hi, Did anyone have any experience with Neo4j + RDF + SPARQL? Or are there any resources worth reading? If so, could someone please point me to such resources?.. There is a 1-to-1 RDF mapper in Blueprints. It turns any Blueprints GraphDB into a Sail-based RDF triple/quad store. Given the 1-to-1 nature, you can work with your data from the perspective of the Blueprints API, Sail API, or Neo4j API. https://github.com/tinkerpop/blueprints/wiki/Sail-Ouplementation Through Sail you can do SPARQL, SeRQL, RQL, and Gremlin. See ya, Marko. http://markorodriguez.com ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user
Re: [Neo4j] Question: Neo4j and semantic-mediawiki
Hi,
Got it. It would be great to be able to use Sparql on neo4j or any
other Blueprint db.
Yea it would.
Do you think it would be possible to map/translate sparql query to
gremlin/pipes?
I plan to create a new DSL over Gremlin/Pipes that has a syntax flavor like
this. E.g.
x = []; y = []
g.select(x, y).where(
g.v('marko').outE('knows').inV.var(x)
var(x).outE('knows').inV.var(y))
EQUIVALENT TO:
SELECT ?x, ?y WHERE {
marko knows ?x
?x knows ?y
}
In short, traversal-based SPARQL (similar to the SPARQL engine developed by
Neo4j). The benefits is that a line is property graph-based, not restricted
to RDF graphs only. E.g.
x = []; y = []
g.select(x, y).where(
g.v('marko').outE('knows').inV.var(x)
var(x).outE('knows').inV{it.age 30}.var(y))
I haven't gotten to starting this project yet, but if anyone is interested in
helping, that would be great.
Thanks,
Marko.
http://markorodriguez.com
___
Neo4j mailing list
User@lists.neo4j.org
https://lists.neo4j.org/mailman/listinfo/user
Re: [Neo4j] Question: Neo4j and semantic-mediawiki
Well I'm in general interested in having all these different
mechanisms (native (traverse), pipes, gremlin, sparql) to query the
same graph.
That would give so much more flexibility when writing domain methods.
Ideally you would not want to write domain methods at all, but
annotate interfaces with some queries, something like:
interface PersonRepository {
@SparqlQuery(query=where {?p foaf:knows ??person . })
public ListPerson findMyFriends(Person person);
@GremlinQuery(query=person.bothE('foaf:knows').bothV.except([person]))
public ListPerson findMyFriends2(Person person);
}
That would be quite great, but thats of course a bit more JPA inspired
approach and many other useful roads can be taken...
Alfredas
On Tue, Feb 22, 2011 at 6:03 PM, Marko Rodriguez okramma...@gmail.com wrote:
Hi,
Got it. It would be great to be able to use Sparql on neo4j or any
other Blueprint db.
Yea it would.
Do you think it would be possible to map/translate sparql query to
gremlin/pipes?
I plan to create a new DSL over Gremlin/Pipes that has a syntax flavor like
this. E.g.
x = []; y = []
g.select(x, y).where(
g.v('marko').outE('knows').inV.var(x)
var(x).outE('knows').inV.var(y))
EQUIVALENT TO:
SELECT ?x, ?y WHERE {
marko knows ?x
?x knows ?y
}
In short, traversal-based SPARQL (similar to the SPARQL engine developed by
Neo4j). The benefits is that a line is property graph-based, not restricted
to RDF graphs only. E.g.
x = []; y = []
g.select(x, y).where(
g.v('marko').outE('knows').inV.var(x)
var(x).outE('knows').inV{it.age 30}.var(y))
I haven't gotten to starting this project yet, but if anyone is interested in
helping, that would be great.
Thanks,
Marko.
http://markorodriguez.com
___
Neo4j mailing list
User@lists.neo4j.org
https://lists.neo4j.org/mailman/listinfo/user
___
Neo4j mailing list
User@lists.neo4j.org
https://lists.neo4j.org/mailman/listinfo/user
Re: [Neo4j] No index provider 'lucene' found with Tomcat/Trinidad
Hi, I just moved my code to the new index API but I cannot deploy my server. I've already tried with glassfishv3 and jetty and neither of them works. The exception I get is: java.lang.Exception: java.lang.IllegalStateException: ContainerBase.addChild: start: org.apache.catalina.LifecycleException: java.lang.IllegalArgumentException: No index provider 'lucene' found I've already tried directly adding the apache bundle lucene jar to with no luck. any ideas of what could be happening? Cheers, Pablo On Thu, Feb 17, 2011 at 11:31 AM, Peter Neubauer peter.neuba...@neotechnology.com wrote: Mmmh, the main issue here I suspect is that the Java Service Loader is not finding the META-INF/services files. It might be that it is not triggered when you add files dynamically to the classloader. That is, the JARs are only scanned at startup time for any non-class files. Could that be an issue? Cheers, /peter neubauer GTalk: neubauer.peter Skype peter.neubauer Phone +46 704 106975 LinkedIn http://www.linkedin.com/in/neubauer Twitter http://twitter.com/peterneubauer http://www.neo4j.org - Your high performance graph database. http://www.thoughtmade.com - Scandinavia's coolest Bring-a-Thing party. On Thu, Feb 17, 2011 at 11:28 AM, Andreas Ronge andreas.ro...@gmail.com wrote: Hi I have found a work around - I added all the jar files needed in the classpath before I start Tomcat/Trinidad (put them in the lib folder) This is awkward since I don't know which jar files should be added (it's in a configuration file). Also, I have not managed to get the online backup working in Tomcat even when I add all the jar files to the classpath. It works when I run it standalone by just adding the online jar file at runtime, but not from Tomcat because of some classloading issue ? So, why can't I load the JAR files dynamically like this in Tomcat ? (which is the same as in ruby: require 'myjar.jar') URL url = getURL(jarFile); getRuntime().getJRubyClassLoader().addURL(url); Is there an alternative of loading the jar files dynamically at runtime ? (from http://thinkincode.net/2011/02/09/jruby-class-loader-by-example.html) /Andreas On Thu, Feb 17, 2011 at 9:33 AM, Anders Nawroth and...@neotechnology.com wrote: Hi! This is included as a dependency: org.apache.servicemix.bundles:org.apache.servicemix.bundles.lucene:jar:3.0.1_2:compile That's an OSGi-friendly packaging of Lucene. /anders On 02/17/2011 09:11 AM, Michael Hunger wrote: Sorry, didn't see your mail (had Andreas' still open for replying). It worked, thanks very much. But funnily the lucene jar is not recognized as dependency by maven for the server (mvn dependency:copy-dependencies). I assume it is added by the server-build project? Cheers Michael Am 17.02.2011 um 08:49 schrieb Mattias Persson: It's probably a classpath issue as you say. You added the neo4j-lucene-index-XXX.jar file manually to the classpath, but also make sure the lucene-core-3.0.1.jar is on the classpath. You can also look in the neo4j-db-directory/messages.log and see which extensions are loaded tigether with the graph database and which of those failed to load a.s.o. 2011/2/16 Andreas Rongeandreas.ro...@gmail.com Hi When I run my Rails application using Tomcat/Trinidad I get No index provider 'lucene' found, see stack trace below I think I have seen a similar problem on the gremlin email list. I guess it's because of a class loading issue, or maybe the META-INF/services files, or because in JRuby the neo4j jar files are loaded at runtime. I need some hints where I should start looking. I have tried to manually add the neo4j-lucene-index-1.3.M02.jar file to the classpath without any luck (jruby -J-cp /home/... -S trinidad) The problem occurs in neo4j.rb version= 1.0.0.beta.17 when the new lucene index framework was introduced. It works in WEBrick/rails s at org.jruby.rack.RackServlet.service(RackServlet.java:56) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:306) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:240) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:161) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:164) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:100) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:118) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:380) at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:243)
Re: [Neo4j] Exception creating EmbeddedGraphDatabase from a Servlet
Pablo, Did you resolve this, or is this still an issue for you? David On Mon, Feb 21, 2011 at 2:08 AM, Pablo Pareja ppar...@era7.com wrote: Hi Jim, I already did it, I'm using a constant defined in the code for the DB folder which it's the same I used for testing things with a really simple jar. I also tried changing the permissions for every DB file granting every kind of permission to any kind of user (I know that's kind of crazy but just wanted to make sure it didn't have anything to do with that...) Pablo On Mon, Feb 21, 2011 at 11:00 AM, Jim Webber j...@neotechnology.com wrote: Hi Pablo, This caught my eye in your stacktrace: Unable to create directory path[] for Neo4j Can you confirm that you have provided the right path for your database into your Jetty app? Jim ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user -- Pablo Pareja Tobes LinkedInhttp://www.linkedin.com/in/pabloparejatobes Twitter http://www.twitter.com/pablopareja http://about.me/pablopareja http://www.ohnosequences.com ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user -- David Montag Neo Technology, www.neotechnology.com Cell: 650.556.4411 david.mon...@neotechnology.com ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user
Re: [Neo4j] Indexing with BatchInserter (with new API) how to doubt
2011/2/22 Pablo Pareja ppar...@era7.com Hi all, I'm updating my code in order to user the new Indexing API but I have a doubt, when using the BatchInserter, (at least with the old one) you were supposed to use the classes LuceneIndexBatchInserter or LuceneFulltextIndexBatchInserter but, what about now? should I just use the new way of indexing in the middle of the batch insertions? wouldn't that indexations be supposed to be done inside transaction blocks? The new batch inserter index thingie works almost the same way as the old batch insert index. Have you looked at http://wiki.neo4j.org/content/Index_Framework#Batch_insertion ? If you still have questions please let me know so I can add that information there. As you can see I'm a bit confused with this, I'd really appreciate any clarification. Cheers, Pablo -- Pablo Pareja Tobes LinkedInhttp://www.linkedin.com/in/pabloparejatobes Twitter http://www.twitter.com/pablopareja http://about.me/pablopareja http://www.ohnosequences.com ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user -- Mattias Persson, [matt...@neotechnology.com] Hacker, Neo Technology www.neotechnology.com ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user
Re: [Neo4j] No index provider 'lucene' found with Tomcat/Trinidad
2011/2/22 Pablo Pareja ppar...@era7.com Hi, I just moved my code to the new index API but I cannot deploy my server. I've already tried with glassfishv3 and jetty and neither of them works. The exception I get is: java.lang.Exception: java.lang.IllegalStateException: ContainerBase.addChild: start: org.apache.catalina.LifecycleException: java.lang.IllegalArgumentException: No index provider 'lucene' found I've already tried directly adding the apache bundle lucene jar to with no luck. any ideas of what could be happening? Could be java service API not loading stuff as it should probably (index providers are loaded that way). You say you tried adding the apache bundle lucene jar directly... did you also add neo4j-lucene-index jar file? The lucene index provider for neo4j consists of Lucene (lucene-core or lucene bundle) and a wrapper to make it participate nicely in Neo4j transactions/lifecycle (neo4j-lucene-index). Cheers, Pablo On Thu, Feb 17, 2011 at 11:31 AM, Peter Neubauer peter.neuba...@neotechnology.com wrote: Mmmh, the main issue here I suspect is that the Java Service Loader is not finding the META-INF/services files. It might be that it is not triggered when you add files dynamically to the classloader. That is, the JARs are only scanned at startup time for any non-class files. Could that be an issue? Cheers, /peter neubauer GTalk: neubauer.peter Skype peter.neubauer Phone +46 704 106975 LinkedIn http://www.linkedin.com/in/neubauer Twitter http://twitter.com/peterneubauer http://www.neo4j.org - Your high performance graph database. http://www.thoughtmade.com - Scandinavia's coolest Bring-a-Thing party. On Thu, Feb 17, 2011 at 11:28 AM, Andreas Ronge andreas.ro...@gmail.com wrote: Hi I have found a work around - I added all the jar files needed in the classpath before I start Tomcat/Trinidad (put them in the lib folder) This is awkward since I don't know which jar files should be added (it's in a configuration file). Also, I have not managed to get the online backup working in Tomcat even when I add all the jar files to the classpath. It works when I run it standalone by just adding the online jar file at runtime, but not from Tomcat because of some classloading issue ? So, why can't I load the JAR files dynamically like this in Tomcat ? (which is the same as in ruby: require 'myjar.jar') URL url = getURL(jarFile); getRuntime().getJRubyClassLoader().addURL(url); Is there an alternative of loading the jar files dynamically at runtime ? (from http://thinkincode.net/2011/02/09/jruby-class-loader-by-example.html) /Andreas On Thu, Feb 17, 2011 at 9:33 AM, Anders Nawroth and...@neotechnology.com wrote: Hi! This is included as a dependency: org.apache.servicemix.bundles:org.apache.servicemix.bundles.lucene:jar:3.0.1_2:compile That's an OSGi-friendly packaging of Lucene. /anders On 02/17/2011 09:11 AM, Michael Hunger wrote: Sorry, didn't see your mail (had Andreas' still open for replying). It worked, thanks very much. But funnily the lucene jar is not recognized as dependency by maven for the server (mvn dependency:copy-dependencies). I assume it is added by the server-build project? Cheers Michael Am 17.02.2011 um 08:49 schrieb Mattias Persson: It's probably a classpath issue as you say. You added the neo4j-lucene-index-XXX.jar file manually to the classpath, but also make sure the lucene-core-3.0.1.jar is on the classpath. You can also look in the neo4j-db-directory/messages.log and see which extensions are loaded tigether with the graph database and which of those failed to load a.s.o. 2011/2/16 Andreas Rongeandreas.ro...@gmail.com Hi When I run my Rails application using Tomcat/Trinidad I get No index provider 'lucene' found, see stack trace below I think I have seen a similar problem on the gremlin email list. I guess it's because of a class loading issue, or maybe the META-INF/services files, or because in JRuby the neo4j jar files are loaded at runtime. I need some hints where I should start looking. I have tried to manually add the neo4j-lucene-index-1.3.M02.jar file to the classpath without any luck (jruby -J-cp /home/... -S trinidad) The problem occurs in neo4j.rb version= 1.0.0.beta.17 when the new lucene index framework was introduced. It works in WEBrick/rails s at org.jruby.rack.RackServlet.service(RackServlet.java:56) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:306) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210) at
Re: [Neo4j] Indexing with BatchInserter (with new API) how to doubt
Hi Mattias, thanks for the link, I don't know how but after checking that page a couple of times I somehow didn't see/reach the BatchInserter indexing part... (guess I'd be too tired) Cheers, Pablo On Tue, Feb 22, 2011 at 8:40 PM, Mattias Persson matt...@neotechnology.comwrote: 2011/2/22 Pablo Pareja ppar...@era7.com Hi all, I'm updating my code in order to user the new Indexing API but I have a doubt, when using the BatchInserter, (at least with the old one) you were supposed to use the classes LuceneIndexBatchInserter or LuceneFulltextIndexBatchInserter but, what about now? should I just use the new way of indexing in the middle of the batch insertions? wouldn't that indexations be supposed to be done inside transaction blocks? The new batch inserter index thingie works almost the same way as the old batch insert index. Have you looked at http://wiki.neo4j.org/content/Index_Framework#Batch_insertion ? If you still have questions please let me know so I can add that information there. As you can see I'm a bit confused with this, I'd really appreciate any clarification. Cheers, Pablo -- Pablo Pareja Tobes LinkedInhttp://www.linkedin.com/in/pabloparejatobes Twitter http://www.twitter.com/pablopareja http://about.me/pablopareja http://www.ohnosequences.com ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user -- Mattias Persson, [matt...@neotechnology.com] Hacker, Neo Technology www.neotechnology.com ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user -- Pablo Pareja Tobes LinkedInhttp://www.linkedin.com/in/pabloparejatobes Twitter http://www.twitter.com/pablopareja http://about.me/pablopareja http://www.ohnosequences.com ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user
Re: [Neo4j] Exception creating EmbeddedGraphDatabase from a Servlet
Hi David, I just found a workaround for it this afternoon. I moved my neo4j db folder with all the data into the jetty installation folder and changed the db folder String using a relative path instead of an absolute one. (I guess it's not the most elegant one but it works fine so far). Cheers, Pablo On Tue, Feb 22, 2011 at 7:40 PM, David Montag david.mon...@neotechnology.com wrote: Pablo, Did you resolve this, or is this still an issue for you? David On Mon, Feb 21, 2011 at 2:08 AM, Pablo Pareja ppar...@era7.com wrote: Hi Jim, I already did it, I'm using a constant defined in the code for the DB folder which it's the same I used for testing things with a really simple jar. I also tried changing the permissions for every DB file granting every kind of permission to any kind of user (I know that's kind of crazy but just wanted to make sure it didn't have anything to do with that...) Pablo On Mon, Feb 21, 2011 at 11:00 AM, Jim Webber j...@neotechnology.com wrote: Hi Pablo, This caught my eye in your stacktrace: Unable to create directory path[] for Neo4j Can you confirm that you have provided the right path for your database into your Jetty app? Jim ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user -- Pablo Pareja Tobes LinkedInhttp://www.linkedin.com/in/pabloparejatobes Twitter http://www.twitter.com/pablopareja http://about.me/pablopareja http://www.ohnosequences.com ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user -- David Montag Neo Technology, www.neotechnology.com Cell: 650.556.4411 david.mon...@neotechnology.com ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user -- Pablo Pareja Tobes LinkedInhttp://www.linkedin.com/in/pabloparejatobes Twitter http://www.twitter.com/pablopareja http://about.me/pablopareja http://www.ohnosequences.com ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user
Re: [Neo4j] No index provider 'lucene' found with Tomcat/Trinidad
Hi Mattias, I'll try that tomorrow and I'll let you know, Pablo On Tue, Feb 22, 2011 at 9:00 PM, Mattias Persson matt...@neotechnology.comwrote: 2011/2/22 Pablo Pareja ppar...@era7.com Hi, I just moved my code to the new index API but I cannot deploy my server. I've already tried with glassfishv3 and jetty and neither of them works. The exception I get is: java.lang.Exception: java.lang.IllegalStateException: ContainerBase.addChild: start: org.apache.catalina.LifecycleException: java.lang.IllegalArgumentException: No index provider 'lucene' found I've already tried directly adding the apache bundle lucene jar to with no luck. any ideas of what could be happening? Could be java service API not loading stuff as it should probably (index providers are loaded that way). You say you tried adding the apache bundle lucene jar directly... did you also add neo4j-lucene-index jar file? The lucene index provider for neo4j consists of Lucene (lucene-core or lucene bundle) and a wrapper to make it participate nicely in Neo4j transactions/lifecycle (neo4j-lucene-index). Cheers, Pablo On Thu, Feb 17, 2011 at 11:31 AM, Peter Neubauer peter.neuba...@neotechnology.com wrote: Mmmh, the main issue here I suspect is that the Java Service Loader is not finding the META-INF/services files. It might be that it is not triggered when you add files dynamically to the classloader. That is, the JARs are only scanned at startup time for any non-class files. Could that be an issue? Cheers, /peter neubauer GTalk: neubauer.peter Skype peter.neubauer Phone +46 704 106975 LinkedIn http://www.linkedin.com/in/neubauer Twitter http://twitter.com/peterneubauer http://www.neo4j.org - Your high performance graph database. http://www.thoughtmade.com - Scandinavia's coolest Bring-a-Thing party. On Thu, Feb 17, 2011 at 11:28 AM, Andreas Ronge andreas.ro...@gmail.com wrote: Hi I have found a work around - I added all the jar files needed in the classpath before I start Tomcat/Trinidad (put them in the lib folder) This is awkward since I don't know which jar files should be added (it's in a configuration file). Also, I have not managed to get the online backup working in Tomcat even when I add all the jar files to the classpath. It works when I run it standalone by just adding the online jar file at runtime, but not from Tomcat because of some classloading issue ? So, why can't I load the JAR files dynamically like this in Tomcat ? (which is the same as in ruby: require 'myjar.jar') URL url = getURL(jarFile); getRuntime().getJRubyClassLoader().addURL(url); Is there an alternative of loading the jar files dynamically at runtime ? (from http://thinkincode.net/2011/02/09/jruby-class-loader-by-example.html) /Andreas On Thu, Feb 17, 2011 at 9:33 AM, Anders Nawroth and...@neotechnology.com wrote: Hi! This is included as a dependency: org.apache.servicemix.bundles:org.apache.servicemix.bundles.lucene:jar:3.0.1_2:compile That's an OSGi-friendly packaging of Lucene. /anders On 02/17/2011 09:11 AM, Michael Hunger wrote: Sorry, didn't see your mail (had Andreas' still open for replying). It worked, thanks very much. But funnily the lucene jar is not recognized as dependency by maven for the server (mvn dependency:copy-dependencies). I assume it is added by the server-build project? Cheers Michael Am 17.02.2011 um 08:49 schrieb Mattias Persson: It's probably a classpath issue as you say. You added the neo4j-lucene-index-XXX.jar file manually to the classpath, but also make sure the lucene-core-3.0.1.jar is on the classpath. You can also look in the neo4j-db-directory/messages.log and see which extensions are loaded tigether with the graph database and which of those failed to load a.s.o. 2011/2/16 Andreas Rongeandreas.ro...@gmail.com Hi When I run my Rails application using Tomcat/Trinidad I get No index provider 'lucene' found, see stack trace below I think I have seen a similar problem on the gremlin email list. I guess it's because of a class loading issue, or maybe the META-INF/services files, or because in JRuby the neo4j jar files are loaded at runtime. I need some hints where I should start looking. I have tried to manually add the neo4j-lucene-index-1.3.M02.jar file to the classpath without any luck (jruby -J-cp /home/... -S trinidad) The problem occurs in neo4j.rb version= 1.0.0.beta.17 when the new lucene index framework was introduced. It works in WEBrick/rails s at org.jruby.rack.RackServlet.service(RackServlet.java:56) at
[Neo4j] simple traverse question
Hi, I am new to neo4j and I am having some difficulty figuring out how to query it to get me what I need. We are using Ruby and not JRuby so I am trying to do all my queries via the REST API. Currently I have a set of people nodes and a set of school nodes. Each node has an id field and a name. The ID field is not to be confused with the ID field assigned by neo, but rather a key into a relational database elsewhere. I have created a people and school index so I can find the nodes by ids curl -H Accept:application/json http://localhost:7474/db/data/index/node/person/person_id/28995 I have also created relationships between each person and school called attended. I set a graduation date and degree name as attributes of each attended relationship. The query that I want to find all people that attended the same school as I did and graduated at the same time. person = school = person1, person2, ... personN. More advanced: Later I might want to add to that people with the same degree as well as graduation date. And, after that, I would probably want to find friends of those same people. Of course that implies that I added a relationship of firend between people. Any help that you can provide me on this would be helpful. I think that once I get started with a couple of examples, I will be able to take off. thanks, Charlie White Avvo, Inc. 1218 Third Avenue, Suite 300 Seattle, WA 98101 ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user
Re: [Neo4j] simple traverse question
Here you go...
Full code with setup:
https://github.com/maxdemarzi/neography/blob/master/examples/traversal_example2.rb
Interesting bit:
def graduated_with_me(student)
student = student[self].split('/').last
student_attended = @neo.get_node_relationships(student)[0]
graduated = student_attended[data][graduated]
school = student_attended[end].split('/').last
@neo.traverse(school,nodes, {order = breadth first,
uniqueness = node global,
relationships = {type=
attended, direction = in},
return filter = {
language = javascript,
body = position.length() == 1
position.endNode().getId() != #{student}
position.lastRelationship().getProperty(\graduated\) ==
#{graduated};}})
end
Visualize it (sort of... I need to add relationship properties):
http://neovigator.heroku.com/?neoid=201
Neo4j guys, how do we use the new Evaluator via Rest?
Thanks,
Max
On Tue, Feb 22, 2011 at 6:50 PM, charlie char...@avvo.com wrote:
Hi,
I am new to neo4j and I am having some difficulty figuring out how to query
it to get me what I
need. We are using Ruby and not JRuby so I am trying to do all my queries
via the REST API.
Currently I have a set of people nodes and a set of school nodes. Each
node has an id field and
a name. The ID field is not to be confused with the ID field assigned by
neo, but rather a key
into a relational database elsewhere.
I have created a people and school index so I can find the nodes by ids
curl -H Accept:application/json
http://localhost:7474/db/data/index/node/person/person_id/28995
I have also created relationships between each person and school called
attended. I set a
graduation date and degree name as attributes of each attended relationship.
The query that I want to find all people that attended the same school as I
did and graduated at the
same time.
person = school = person1, person2, ... personN.
More advanced:
Later I might want to add to that people with the same degree as well as
graduation date. And,
after that, I would probably want to find friends of those same people.
Of course that implies
that I added a relationship of firend between people.
Any help that you can provide me on this would be helpful. I think that once
I get started with a
couple of examples, I will be able to take off.
thanks,
Charlie White
Avvo, Inc.
1218 Third Avenue, Suite 300
Seattle, WA 98101
___
Neo4j mailing list
User@lists.neo4j.org
https://lists.neo4j.org/mailman/listinfo/user
___
Neo4j mailing list
User@lists.neo4j.org
https://lists.neo4j.org/mailman/listinfo/user
