Re: [Neo4j] Unable to Get Backup to Run

2011-05-23 Thread Mattias Persson
Hmm, no it does not. There has got to be something else going on... the log
message you pasted doesn't really say anything, just that a connection timed
out and the server noticed that.

2011/5/22 Kevin Dieter kevin.die...@megree.com

 Here's what I see in the messages.log when I tried the backup command:

 Fri May 20 07:00:24 PDT 2011: Found dead channel [id: 0x3d36acb6, /
 127.0.0.1:56110 : /127.0.0.1:6362], SlaveContext[ID:0, eventIdentifier:0,
 [(lucene-index, 15726285), (nioneodb, 38747027)]]
 Fri May 20 07:00:24 PDT 2011: Removed [id: 0x3d36acb6, /127.0.0.1:56110 :
 /
 127.0.0.1:6362], SlaveContext[ID:0, eventIdentifier:0, [(lucene-index,
 15726285), (nioneodb, 38747027)]]

 It also seems the server becomes somewhat unstable after this and
 eventually
 I need to stop and restart it (and it always seems to detect it as a
 non-clean shutdown and spends a fair amount of time applying transactions
 to
 restore the state of the server).

 Does this help?

 Kevin



 On Fri, May 20, 2011 at 4:42 PM, Mattias Persson
 matt...@neotechnology.comwrote:

  Could you post the contents of the messages.log from the database
  directory?
  It may be that it encounters an exception on the database you're getting
  the
  backup from. If you're running neo4j server the file would be
  neo4j-server-directory\data\graph.db\messages.log or if you run an
  embedded database it would be neo4j-database-directory\messages.log.
 That
  would could give hints about the problem.
 
  Are you seeing more/other stacktraces btw? Could you post full
 stacktraces?
 
  2011/5/20 Kevin Dieter kevin.die...@megree.com
 
   Hi,
  
   I am trying to set up a scheduled backup for my neo4j database and I
 have
   been unable to get the backup to run.
  
   See below for the commands I am running (first to do a full backup and
  then
   incremental).
  
   The weird thing is that I was able to run the full backup, and
  incremental
   successfully last night using the exact same commands.
  
   Any idea why I am getting the timeout exception?
  
   Thanks,
  
   Kevin
   ---
  
   C:\cURLC:\neo4J\neo4j-enterprise-1.3-windows\bin\neo4jbackup -full
 -from
   single://localhost:6362 -to c:/neo4J-backup
   Performing full backup from 'single://localhost:6362'
   Exception in thread main java.lang.RuntimeException: c:/neo4J-backup
   already contains a database
  at org.neo4j.backup.OnlineBackup.full(OnlineBackup.java:69)
  at org.neo4j.backup.BackupTool.doBackup(BackupTool.java:119)
  at org.neo4j.backup.BackupTool.main(BackupTool.java:83)
  
   C:\cURLC:\neo4J\neo4j-enterprise-1.3-windows\bin\neo4jbackup
  -incremental
   -from single://localhost:6362 -to c:/neo4J-backup
   Performing incremental backup from 'single://localhost:6362'
   Couldn't connect to 'single://localhost:6362',
  org.neo4j.com.ComException:
   org.jboss.netty.handler.queue.BlockingReadTimeoutException
   ___
   Neo4j mailing list
   User@lists.neo4j.org
   https://lists.neo4j.org/mailman/listinfo/user
  
 
 
 
  --
  Mattias Persson, [matt...@neotechnology.com]
  Hacker, Neo Technology
  www.neotechnology.com
  ___
  Neo4j mailing list
  User@lists.neo4j.org
  https://lists.neo4j.org/mailman/listinfo/user
 
 ___
 Neo4j mailing list
 User@lists.neo4j.org
 https://lists.neo4j.org/mailman/listinfo/user




-- 
Mattias Persson, [matt...@neotechnology.com]
Hacker, Neo Technology
www.neotechnology.com
___
Neo4j mailing list
User@lists.neo4j.org
https://lists.neo4j.org/mailman/listinfo/user


[Neo4j] Neo4J as Persistence Store for Apache Jackrabbit?

2011-05-23 Thread Rick Bullotta
Has anyone experimented with/implemented this yet?

We're looking at Apache Vypser (embeddable XMPP server) and it would be great 
to have a single persistence store (Neo4J) if possible.  Vysper uses Jackrabbit 
for its storage at present.

Thanks,

Rick

___
Neo4j mailing list
User@lists.neo4j.org
https://lists.neo4j.org/mailman/listinfo/user


[Neo4j] No index provider 'lucene' found - osgi

2011-05-23 Thread Marco Gerber
Hello everybody

I'm currently trying to make my spring based osgi application run with neo4j 
1.3 . However, when I call 'org.neo4j.kernel.IndexManagerImpl.forNodes' I got 
the following error (see [1] for a complete stack trace):

 Invocation of init method failed; nested exception is 
 java.lang.IllegalArgumentException: No index provider 'lucene' found

My setup is as follows:

loaded and running bundles:
- org.apache.servicemix.bundles.lucene
- org.neo4j.kernel
- org.apache.servicemix.bundles.lucene


Do I have to load any lucene classes into the classpath on startup?

Thanks a lot and let me know if I have to provide more information
Marco Gerber

[1]
Caused by: org.springframework.beans.factory.BeanCreationException: Error 
creating bean with name 'myRepository': Invocation of init method failed; 
nested exception is java.lang.IllegalArgumentException: No index provider 
'lucene' found
at 
org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor.postProcessBeforeInitialization(InitDestroyAnnotationBeanPostProcessor.java:133)
at 
org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.applyBeanPostProcessorsBeforeInitialization(AbstractAutowireCapableBeanFactory.java:394)
at 
org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.initializeBean(AbstractAutowireCapableBeanFactory.java:1413)
at 
org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:519)
at 
org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:456)
at 
org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:291)
at 
org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:222)
at 
org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:288)
at 
org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:190)
at 
org.springframework.beans.factory.support.DefaultListableBeanFactory.findAutowireCandidates(DefaultListableBeanFactory.java:844)
at 
org.springframework.beans.factory.support.DefaultListableBeanFactory.doResolveDependency(DefaultListableBeanFactory.java:786)
at 
org.springframework.beans.factory.support.DefaultListableBeanFactory.resolveDependency(DefaultListableBeanFactory.java:703)
at 
org.springframework.beans.factory.support.ConstructorResolver.resolveAutowiredArgument(ConstructorResolver.java:795)
at 
org.springframework.beans.factory.support.ConstructorResolver.createArgumentArray(ConstructorResolver.java:723)
... 20 common frames omitted
Caused by: java.lang.IllegalArgumentException: No index provider 'lucene' found
at 
org.neo4j.kernel.IndexManagerImpl.getIndexProvider(IndexManagerImpl.java:71)
at 
org.neo4j.kernel.IndexManagerImpl.findIndexConfig(IndexManagerImpl.java:104)
at 
org.neo4j.kernel.IndexManagerImpl.getOrCreateIndexConfig(IndexManagerImpl.java:173)
at org.neo4j.kernel.IndexManagerImpl.forNodes(IndexManagerImpl.java:244)
at 
net.junisphere.eranger.helloNeo4j.config.internal.repository.BaseRepository.init(BaseRepository.java:31)
at 
net.junisphere.eranger.helloNeo4j.config.internal.repository.ServiceRepository.init(ServiceRepository.java:35)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at 
org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor$LifecycleElement.invoke(InitDestroyAnnotationBeanPostProcessor.java:340)
at 
org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor$LifecycleMetadata.invokeInitMethods(InitDestroyAnnotationBeanPostProcessor.java:293)
at 
org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor.postProcessBeforeInitialization(InitDestroyAnnotationBeanPostProcessor.java:130)
... 33 common frames omitted
___
Neo4j mailing list
User@lists.neo4j.org
https://lists.neo4j.org/mailman/listinfo/user


Re: [Neo4j] No index provider 'lucene' found - osgi

2011-05-23 Thread Mattias Persson
Hi Marco,

Could you post the contents of graphDb/messages.log file also?

2011/5/23 Marco Gerber mger...@junisphere.net

 Hello everybody

 I'm currently trying to make my spring based osgi application run with
 neo4j 1.3 . However, when I call
 'org.neo4j.kernel.IndexManagerImpl.forNodes' I got the following error (see
 [1] for a complete stack trace):

  Invocation of init method failed; nested exception is
 java.lang.IllegalArgumentException: No index provider 'lucene' found

 My setup is as follows:

 loaded and running bundles:
 - org.apache.servicemix.bundles.lucene
 - org.neo4j.kernel
 - org.apache.servicemix.bundles.lucene


 Do I have to load any lucene classes into the classpath on startup?

 Thanks a lot and let me know if I have to provide more information
 Marco Gerber

 [1]
 Caused by: org.springframework.beans.factory.BeanCreationException: Error
 creating bean with name 'myRepository': Invocation of init method failed;
 nested exception is java.lang.IllegalArgumentException: No index provider
 'lucene' found
at
 org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor.postProcessBeforeInitialization(InitDestroyAnnotationBeanPostProcessor.java:133)
at
 org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.applyBeanPostProcessorsBeforeInitialization(AbstractAutowireCapableBeanFactory.java:394)
at
 org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.initializeBean(AbstractAutowireCapableBeanFactory.java:1413)
at
 org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:519)
at
 org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:456)
at
 org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:291)
at
 org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:222)
at
 org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:288)
at
 org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:190)
at
 org.springframework.beans.factory.support.DefaultListableBeanFactory.findAutowireCandidates(DefaultListableBeanFactory.java:844)
at
 org.springframework.beans.factory.support.DefaultListableBeanFactory.doResolveDependency(DefaultListableBeanFactory.java:786)
at
 org.springframework.beans.factory.support.DefaultListableBeanFactory.resolveDependency(DefaultListableBeanFactory.java:703)
at
 org.springframework.beans.factory.support.ConstructorResolver.resolveAutowiredArgument(ConstructorResolver.java:795)
at
 org.springframework.beans.factory.support.ConstructorResolver.createArgumentArray(ConstructorResolver.java:723)
... 20 common frames omitted
 Caused by: java.lang.IllegalArgumentException: No index provider 'lucene'
 found
at
 org.neo4j.kernel.IndexManagerImpl.getIndexProvider(IndexManagerImpl.java:71)
at
 org.neo4j.kernel.IndexManagerImpl.findIndexConfig(IndexManagerImpl.java:104)
at
 org.neo4j.kernel.IndexManagerImpl.getOrCreateIndexConfig(IndexManagerImpl.java:173)
at
 org.neo4j.kernel.IndexManagerImpl.forNodes(IndexManagerImpl.java:244)
at
 net.junisphere.eranger.helloNeo4j.config.internal.repository.BaseRepository.init(BaseRepository.java:31)
at
 net.junisphere.eranger.helloNeo4j.config.internal.repository.ServiceRepository.init(ServiceRepository.java:35)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
 sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
 sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at
 org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor$LifecycleElement.invoke(InitDestroyAnnotationBeanPostProcessor.java:340)
at
 org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor$LifecycleMetadata.invokeInitMethods(InitDestroyAnnotationBeanPostProcessor.java:293)
at
 org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor.postProcessBeforeInitialization(InitDestroyAnnotationBeanPostProcessor.java:130)
... 33 common frames omitted
 ___
 Neo4j mailing list
 User@lists.neo4j.org
 https://lists.neo4j.org/mailman/listinfo/user




-- 
Mattias Persson, [matt...@neotechnology.com]
Hacker, Neo Technology
www.neotechnology.com
___
Neo4j mailing list
User@lists.neo4j.org
https://lists.neo4j.org/mailman/listinfo/user


Re: [Neo4j] No index provider 'lucene' found - osgi

2011-05-23 Thread Marco Gerber
Hi Mattias

Here's my graphdb/messages.log:


Mon May 23 14:36:05 CEST 2011: Creating new db @ /tmp/var/base/neostore
Mon May 23 14:36:08 CEST 2011: Opened [/tmp/var/base/nioneo_logical.log.1] 
clean empty log, version=0
Mon May 23 14:36:09 CEST 2011: TM new log: tm_tx_log.1
Mon May 23 14:36:09 CEST 2011: --- CONFIGURATION START ---
Mon May 23 14:36:09 CEST 2011: Physical mem: 5839MB, Heap size: 910MB
Mon May 23 14:36:09 CEST 2011: Kernel version: Neo4j - Graph Database Kernel 1.3
Mon May 23 14:36:09 CEST 2011: Operating System: Linux; version: 
2.6.35-28-generic-pae; arch: i386; cpus: 4
Mon May 23 14:36:09 CEST 2011: VM Name: Java HotSpot(TM) Server VM
Mon May 23 14:36:09 CEST 2011: VM Vendor: Sun Microsystems Inc.
Mon May 23 14:36:09 CEST 2011: VM Version: 19.1-b02
Mon May 23 14:36:09 CEST 2011: Boot Class Path: 
/usr/lib/jvm/java-6-sun-1.6.0.24/jre/lib/resources.jar:/usr/lib/jvm/java-6-sun-1.6.0.24/jre/lib/rt.jar:/usr/lib/jvm/java-6-sun-1.6.0.24/jre/lib/sunrsasign.jar:/usr/lib/jvm/java-6-sun-1.6.0.24/jre/lib/jsse.jar:/usr/lib/jvm/java-6-sun-1.6.0.24/jre/lib/jce.jar:/usr/lib/jvm/java-6-sun-1.6.0.24/jre/lib/charsets.jar:/usr/lib/jvm/java-6-sun-1.6.0.24/jre/lib/modules/jdk.boot.jar:/usr/lib/jvm/java-6-sun-1.6.0.24/jre/classes
Mon May 23 14:36:09 CEST 2011: Class Path: 
/home/mgerber/spring/springsource/virgo-tomcat-server-3.0.0.M03/lib/org.eclipse.virgo.osgi.console-3.0.0.M03.jar:/home/mgerber/spring/springsource/virgo-tomcat-server-3.0.0.M03/lib/org.eclipse.virgo.osgi.launcher-3.0.0.M03.jar:/home/mgerber/spring/springsource/virgo-tomcat-server-3.0.0.M03/lib/org.eclipse.virgo.kernel.shutdown-3.0.0.M03.jar:/home/mgerber/spring/springsource/virgo-tomcat-server-3.0.0.M03/lib/com.springsource.javax.transaction-1.1.0.jar:/home/mgerber/spring/springsource/virgo-tomcat-server-3.0.0.M03/lib/org.eclipse.osgi-3.7.0.v20110224.jar:/home/mgerber/spring/springsource/virgo-tomcat-server-3.0.0.M03/lib/org.eclipse.virgo.osgi.extensions.equinox-3.0.0.M03.jar:/home/mgerber/spring/springsource/virgo-tomcat-server-3.0.0.M03/lib/org.eclipse.virgo.kernel.authentication-3.0.0.M03.jar:/usr/lib/jvm/java-6-sun-1.6.0.24/lib/tools.jar
Mon May 23 14:36:09 CEST 2011: Library Path: 
/usr/lib/jvm/java-6-sun-1.6.0.24/jre/lib/i386/server:/usr/lib/jvm/java-6-sun-1.6.0.24/jre/lib/i386:/usr/lib/jvm/java-6-sun-1.6.0.24/jre/../lib/i386:/usr/lib/jvm/java-6-sun-1.6.0.24/jre/lib/i386/client:/usr/lib/jvm/java-6-sun-1.6.0.24/jre/lib/i386::/usr/java/packages/lib/i386:/lib:/usr/lib
Mon May 23 14:36:09 CEST 2011: Garbage Collector: PS Scavenge: [PS Eden Space, 
PS Survivor Space]
Mon May 23 14:36:09 CEST 2011: Garbage Collector: PS MarkSweep: [PS Eden Space, 
PS Survivor Space, PS Old Gen, PS Perm Gen]
Mon May 23 14:36:09 CEST 2011: VM Arguments: [-XX:+HeapDumpOnOutOfMemoryError, 
-XX:ErrorFile=/home/mgerber/spring/springsource/virgo-tomcat-server-3.0.0.M03/serviceability/error.log,
 
-XX:HeapDumpPath=/home/mgerber/spring/springsource/virgo-tomcat-server-3.0.0.M03/serviceability/heap_dump.hprof,
 -Djava.rmi.server.hostname=127.0.0.1, 
-Dorg.eclipse.virgo.kernel.home=/home/mgerber/spring/springsource/virgo-tomcat-server-3.0.0.M03,
 
-Djava.io.tmpdir=/home/mgerber/spring/springsource/virgo-tomcat-server-3.0.0.M03/work/tmp/,
 -Dcom.sun.management.jmxremote, -Dcom.sun.management.jmxremote.port=9753, 
-Dcom.sun.management.jmxremote.authenticate=false, 
-Dcom.sun.management.jmxremote.ssl=false, 
-Dorg.eclipse.virgo.kernel.authentication.file=/home/mgerber/spring/springsource/virgo-tomcat-server-3.0.0.M03/config/org.eclipse.virgo.kernel.users.properties,
 
-Djava.security.auth.login.config=/home/mgerber/spring/springsource/virgo-tomcat-server-3.0.0.M03/config/org.eclipse.virgo.kernel.authentication.config,
 -Dfile.encoding=UTF-8]
Mon May 23 14:36:09 CEST 2011: 
Mon May 23 14:36:09 CEST 2011: create=true
Mon May 23 14:36:09 CEST 2011: logical_log=/tmp/var/base/nioneo_logical.log
Mon May 23 14:36:09 CEST 2011: neo_store=/tmp/var/base/neostore
Mon May 23 14:36:09 CEST 2011: neostore.nodestore.db.mapped_memory=20M
Mon May 23 14:36:09 CEST 2011: 
neostore.propertystore.db.arrays.mapped_memory=130M
Mon May 23 14:36:09 CEST 2011: 
neostore.propertystore.db.index.keys.mapped_memory=1M
Mon May 23 14:36:09 CEST 2011: neostore.propertystore.db.index.mapped_memory=1M
Mon May 23 14:36:09 CEST 2011: neostore.propertystore.db.mapped_memory=90M
Mon May 23 14:36:09 CEST 2011: 
neostore.propertystore.db.strings.mapped_memory=130M
Mon May 23 14:36:09 CEST 2011: neostore.relationshipstore.db.mapped_memory=100M
Mon May 23 14:36:09 CEST 2011: rebuild_idgenerators_fast=true
Mon May 23 14:36:09 CEST 2011: store_dir=/tmp/var/base
Mon May 23 14:36:09 CEST 2011: use_memory_mapped_buffers=true
Mon May 23 14:36:09 CEST 2011: --- CONFIGURATION END ---
Mon May 23 14:36:09 CEST 2011: Closed log /tmp/var/base/nioneo_logical.log
Mon May 23 14:36:09 CEST 2011: NeoStore closed
Mon May 23 14:36:09 CEST 2011: NeoStore closed
Mon May 23 14:36:09 CEST 2011: TM shutting down





-Original 

Re: [Neo4j] Spring Data Graph in an OSGi environment

2011-05-23 Thread Jean-Pierre Bergamin
I have not spent much more time trying to get SDG running as a bundle
any more. I'll give it another shot today or tomorrow and let you know
how I'm proceeding.

What definitively has to be done is fixing the package imports of SDG
and the package exports of neo4j (see
https://jira.springsource.org/browse/DATAGRAPH-88) so that SDG is not
using *.impl.* package of neo4j anymore. Maybe some of the classes
that are publicly used in SDG must be moved out of the *.impl.*
package in neo4j.



Best regards,
James


2011/5/20 Peter Neubauer peter.neuba...@neotechnology.com:
 Hi there,
 any solution to this or do we need to dig deeper here?

 Cheers,

 /peter neubauer

 GTalk:      neubauer.peter
 Skype       peter.neubauer
 Phone       +46 704 106975
 LinkedIn   http://www.linkedin.com/in/neubauer
 Twitter      http://twitter.com/peterneubauer

 http://www.neo4j.org               - Your high performance graph database.
 http://startupbootcamp.org/    - Öresund - Innovation happens HERE.
 http://www.thoughtmade.com - Scandinavia's coolest Bring-a-Thing party.


 On Mon, May 16, 2011 at 3:28 PM, Jean-Pierre Bergamin
 jpberga...@gmail.comwrote:

 This could be the problem, yes. The repository factories that create
 the repositories from the interface definitions would need to import
 the domain specific packages that contain the interfaces to have
 access to them - which requires buddy loading.

 It seems as if the CGLIB enhanced class
 org.springframework.data.graph.neo4j.config.Neo4jConfiguration cannot
 be created when the app starts up. This is the relevant part of the
 log file:

 [2011-05-16 15:10:49.467] region-dm-3
 o.s.beans.factory.support.DefaultListableBeanFactory
 Creating shared instance of singleton bean
 'org.springframework.data.graph.neo4j.config.Neo4jConfiguration#0'
 [2011-05-16 15:10:49.467] region-dm-3
 o.s.beans.factory.support.DefaultListableBeanFactory
 Creating instance of bean
 'org.springframework.data.graph.neo4j.config.Neo4jConfiguration#0'
 [2011-05-16 15:10:49.471] region-dm-3
 org.springframework.beans.factory.annotation.InjectionMetadata
 Found injected element on class

 [org.springframework.data.graph.neo4j.config.Neo4jConfiguration$$EnhancerByCGLIB$$775b2448$$EnhancerByCGLIB$$e7c2c330$$EnhancerByCGLIB$$4422c70a]:
 AutowiredFieldElement for private javax.validation.Validator
 org.springframework.data.graph.neo4j.config.Neo4jConfiguration.validator
 [2011-05-16 15:10:49.471] region-dm-3
 org.springframework.beans.factory.annotation.InjectionMetadata
 Found injected element on class

 [org.springframework.data.graph.neo4j.config.Neo4jConfiguration$$EnhancerByCGLIB$$775b2448$$EnhancerByCGLIB$$e7c2c330$$EnhancerByCGLIB$$4422c70a]:
 AutowiredMethodElement for public void

 org.springframework.data.graph.neo4j.config.Neo4jConfiguration.setGraphDatabaseService(org.neo4j.graphdb.GraphDatabaseService)
 [2011-05-16 15:10:49.471] region-dm-3
 org.springframework.beans.factory.annotation.InjectionMetadata
 Found injected element on class

 [org.springframework.data.graph.neo4j.config.Neo4jConfiguration$$EnhancerByCGLIB$$775b2448$$EnhancerByCGLIB$$e7c2c330$$EnhancerByCGLIB$$4422c70a]:
 AutowiredMethodElement for public void

 org.springframework.data.graph.neo4j.config.Neo4jConfiguration.setEntityManagerFactory(javax.persistence.EntityManagerFactory)
 [2011-05-16 15:10:49.471] region-dm-3
 o.s.beans.factory.support.DefaultListableBeanFactory
 Eagerly caching bean
 'org.springframework.data.graph.neo4j.config.Neo4jConfiguration#0' to
 allow for resolving potential circular references
 [2011-05-16 15:10:49.471] region-dm-3
 org.springframework.beans.CachedIntrospectionResults
 Getting BeanInfo for class

 [org.springframework.data.graph.neo4j.config.Neo4jConfiguration$$EnhancerByCGLIB$$775b2448$$EnhancerByCGLIB$$e7c2c330$$EnhancerByCGLIB$$4422c70a]
 [2011-05-16 15:10:49.472] region-dm-3
 org.springframework.osgi.util.DebugUtils
 Could not find class

 [org.springframework.data.graph.neo4j.config.Neo4jConfiguration$$EnhancerByCGLIB$$775b2448$$EnhancerByCGLIB$$e7c2c330$$EnhancerByCGLIB$$4422c70aBeanInfo]
 required by [neo4j.domain(com.example.neo4j.domain)] scanning
 available bundles
 [2011-05-16 15:10:49.472] region-dm-3
 org.springframework.osgi.util.DebugUtils
 Class is correctly imported as version [1.0.0], checking providing
 bundles
 [2011-05-16 15:10:49.476] region-dm-3
 org.springframework.osgi.util.DebugUtils
 Bundle [Spring Data Neo4J (org.springframework.data.neo4j)] exports
 [org.springframework.data.graph.neo4j.config] as version
 [1.1.0.BUILD-SNAPSHOT] but version [1.0.0] was required
 [2011-05-16 15:10:49.477] region-dm-3
 org.springframework.osgi.util.DebugUtils
 Could not find class

 [org.springframework.data.graph.neo4j.config.Neo4jConfiguration$$EnhancerByCGLIB$$775b2448$$EnhancerByCGLIB$$e7c2c330BeanInfo]
 required by [neo4j.domain(com.example.neo4j.domain)] scanning
 available bundles
 [2011-05-16 15:10:49.477] region-dm-3
 org.springframework.osgi.util.DebugUtils
 Class is 

Re: [Neo4j] Spring Data Graph in an OSGi environment

2011-05-23 Thread Michael Hunger
What we are currently using inside of SDG are:

* TX/XA-Manager Implementations and Providers

org.springframework.data.graph.neo4j.config  (2 usages)
Neo4jConfiguration.java  (2 usages)
(23: 24) import 
org.neo4j.kernel.impl.transaction.SpringTransactionManager;
(24: 24) import 
org.neo4j.kernel.impl.transaction.UserTransactionImpl;
org.springframework.data.graph.neo4j.transaction  (6 usages)
SpringProvider.java  (4 usages)
(20: 24) import 
org.neo4j.kernel.impl.core.KernelPanicEventGenerator;
(21: 24) import 
org.neo4j.kernel.impl.transaction.AbstractTransactionManager;
(22: 24) import 
org.neo4j.kernel.impl.transaction.TransactionManagerProvider;
(23: 24) import 
org.neo4j.kernel.impl.transaction.TxFinishHook;
SpringServiceImpl.java  (2 usages)
(19: 24) import 
org.neo4j.kernel.impl.transaction.AbstractTransactionManager;
(20: 24) import 
org.neo4j.kernel.impl.transaction.XaDataSourceManager;


* LuceneIndex Implementations (but that is minor and can be removed)

org.springframework.data.graph.neo4j.support  (2 usages)
DelegatingGraphDatabase.java  (1 usage)
(23: 23) import 
org.neo4j.index.impl.lucene.LuceneIndexImplementation;
GraphDatabaseContext.java  (1 usage)
(25: 23) import 
org.neo4j.index.impl.lucene.LuceneIndexImplementation;


* Exceptions for Exception-Translation

org.springframework.data.graph.neo4j.template  (7 usages)
Neo4jExceptionTranslator.java  (7 usages)
(22: 23) import 
org.neo4j.index.impl.lucene.QueryNotPossibleException;
(24: 24) import 
org.neo4j.kernel.impl.core.ReadOnlyDbException;
(25: 24) import 
org.neo4j.kernel.impl.nioneo.store.StoreFailureException;
(26: 24) import 
org.neo4j.kernel.impl.persistence.IdGenerationFailedException;
(27: 24) import 
org.neo4j.kernel.impl.transaction.IllegalResourceException;
(28: 24) import 
org.neo4j.kernel.impl.transaction.LockException;
(29: 24) import 
org.neo4j.kernel.impl.transaction.xaframework.ReadPastEndException;


The last could be done by String comparision which I wouldn't like, the lucene 
impl dependency could be removed (is just about using the same config as 
internally) but the TX stuff would have to be moved (imho).

Cheers

Michael

Am 23.05.2011 um 15:44 schrieb Jean-Pierre Bergamin:

 I have not spent much more time trying to get SDG running as a bundle
 any more. I'll give it another shot today or tomorrow and let you know
 how I'm proceeding.
 
 What definitively has to be done is fixing the package imports of SDG
 and the package exports of neo4j (see
 https://jira.springsource.org/browse/DATAGRAPH-88) so that SDG is not
 using *.impl.* package of neo4j anymore. Maybe some of the classes
 that are publicly used in SDG must be moved out of the *.impl.*
 package in neo4j.
 
 
 
 Best regards,
 James
 
 
 2011/5/20 Peter Neubauer peter.neuba...@neotechnology.com:
 Hi there,
 any solution to this or do we need to dig deeper here?
 
 Cheers,
 
 /peter neubauer
 
 GTalk:  neubauer.peter
 Skype   peter.neubauer
 Phone   +46 704 106975
 LinkedIn   http://www.linkedin.com/in/neubauer
 Twitter  http://twitter.com/peterneubauer
 
 http://www.neo4j.org   - Your high performance graph database.
 http://startupbootcamp.org/- Öresund - Innovation happens HERE.
 http://www.thoughtmade.com - Scandinavia's coolest Bring-a-Thing party.
 
 
 On Mon, May 16, 2011 at 3:28 PM, Jean-Pierre Bergamin
 jpberga...@gmail.comwrote:
 
 This could be the problem, yes. The repository factories that create
 the repositories from the interface definitions would need to import
 the domain specific packages that contain the interfaces to have
 access to them - which requires buddy loading.
 
 It seems as if the CGLIB enhanced class
 org.springframework.data.graph.neo4j.config.Neo4jConfiguration cannot
 be created when the app starts up. This is the relevant part of the
 log file:
 
 [2011-05-16 15:10:49.467] region-dm-3
 o.s.beans.factory.support.DefaultListableBeanFactory
 Creating shared instance of singleton bean
 'org.springframework.data.graph.neo4j.config.Neo4jConfiguration#0'
 [2011-05-16 15:10:49.467] region-dm-3
 o.s.beans.factory.support.DefaultListableBeanFactory
 Creating instance of bean
 'org.springframework.data.graph.neo4j.config.Neo4jConfiguration#0'
 [2011-05-16 15:10:49.471] region-dm-3
 org.springframework.beans.factory.annotation.InjectionMetadata
 Found injected element on class
 
 

Re: [Neo4j] Spring Data Graph in an OSGi environment

2011-05-23 Thread Peter Neubauer
Jean-Pierre,
do you know which classes exactly are the offending ones in neo4j *impl?
Would like to know in order to either avoid suing them or move them into the
API.

Cheers,

/peter neubauer

GTalk:  neubauer.peter
Skype   peter.neubauer
Phone   +46 704 106975
LinkedIn   http://www.linkedin.com/in/neubauer
Twitter  http://twitter.com/peterneubauer

http://www.neo4j.org   - Your high performance graph database.
http://startupbootcamp.org/- Öresund - Innovation happens HERE.
http://www.thoughtmade.com - Scandinavia's coolest Bring-a-Thing party.


On Mon, May 23, 2011 at 3:44 PM, Jean-Pierre Bergamin
jpberga...@gmail.comwrote:

 I have not spent much more time trying to get SDG running as a bundle
 any more. I'll give it another shot today or tomorrow and let you know
 how I'm proceeding.

 What definitively has to be done is fixing the package imports of SDG
 and the package exports of neo4j (see
 https://jira.springsource.org/browse/DATAGRAPH-88) so that SDG is not
 using *.impl.* package of neo4j anymore. Maybe some of the classes
 that are publicly used in SDG must be moved out of the *.impl.*
 package in neo4j.



 Best regards,
 James


 2011/5/20 Peter Neubauer peter.neuba...@neotechnology.com:
  Hi there,
  any solution to this or do we need to dig deeper here?
 
  Cheers,
 
  /peter neubauer
 
  GTalk:  neubauer.peter
  Skype   peter.neubauer
  Phone   +46 704 106975
  LinkedIn   http://www.linkedin.com/in/neubauer
  Twitter  http://twitter.com/peterneubauer
 
  http://www.neo4j.org   - Your high performance graph
 database.
  http://startupbootcamp.org/- Öresund - Innovation happens HERE.
  http://www.thoughtmade.com - Scandinavia's coolest Bring-a-Thing party.
 
 
  On Mon, May 16, 2011 at 3:28 PM, Jean-Pierre Bergamin
  jpberga...@gmail.comwrote:
 
  This could be the problem, yes. The repository factories that create
  the repositories from the interface definitions would need to import
  the domain specific packages that contain the interfaces to have
  access to them - which requires buddy loading.
 
  It seems as if the CGLIB enhanced class
  org.springframework.data.graph.neo4j.config.Neo4jConfiguration cannot
  be created when the app starts up. This is the relevant part of the
  log file:
 
  [2011-05-16 15:10:49.467] region-dm-3
  o.s.beans.factory.support.DefaultListableBeanFactory
  Creating shared instance of singleton bean
  'org.springframework.data.graph.neo4j.config.Neo4jConfiguration#0'
  [2011-05-16 15:10:49.467] region-dm-3
  o.s.beans.factory.support.DefaultListableBeanFactory
  Creating instance of bean
  'org.springframework.data.graph.neo4j.config.Neo4jConfiguration#0'
  [2011-05-16 15:10:49.471] region-dm-3
  org.springframework.beans.factory.annotation.InjectionMetadata
  Found injected element on class
 
 
 [org.springframework.data.graph.neo4j.config.Neo4jConfiguration$$EnhancerByCGLIB$$775b2448$$EnhancerByCGLIB$$e7c2c330$$EnhancerByCGLIB$$4422c70a]:
  AutowiredFieldElement for private javax.validation.Validator
  org.springframework.data.graph.neo4j.config.Neo4jConfiguration.validator
  [2011-05-16 15:10:49.471] region-dm-3
  org.springframework.beans.factory.annotation.InjectionMetadata
  Found injected element on class
 
 
 [org.springframework.data.graph.neo4j.config.Neo4jConfiguration$$EnhancerByCGLIB$$775b2448$$EnhancerByCGLIB$$e7c2c330$$EnhancerByCGLIB$$4422c70a]:
  AutowiredMethodElement for public void
 
 
 org.springframework.data.graph.neo4j.config.Neo4jConfiguration.setGraphDatabaseService(org.neo4j.graphdb.GraphDatabaseService)
  [2011-05-16 15:10:49.471] region-dm-3
  org.springframework.beans.factory.annotation.InjectionMetadata
  Found injected element on class
 
 
 [org.springframework.data.graph.neo4j.config.Neo4jConfiguration$$EnhancerByCGLIB$$775b2448$$EnhancerByCGLIB$$e7c2c330$$EnhancerByCGLIB$$4422c70a]:
  AutowiredMethodElement for public void
 
 
 org.springframework.data.graph.neo4j.config.Neo4jConfiguration.setEntityManagerFactory(javax.persistence.EntityManagerFactory)
  [2011-05-16 15:10:49.471] region-dm-3
  o.s.beans.factory.support.DefaultListableBeanFactory
  Eagerly caching bean
  'org.springframework.data.graph.neo4j.config.Neo4jConfiguration#0' to
  allow for resolving potential circular references
  [2011-05-16 15:10:49.471] region-dm-3
  org.springframework.beans.CachedIntrospectionResults
  Getting BeanInfo for class
 
 
 [org.springframework.data.graph.neo4j.config.Neo4jConfiguration$$EnhancerByCGLIB$$775b2448$$EnhancerByCGLIB$$e7c2c330$$EnhancerByCGLIB$$4422c70a]
  [2011-05-16 15:10:49.472] region-dm-3
  org.springframework.osgi.util.DebugUtils
  Could not find class
 
 
 [org.springframework.data.graph.neo4j.config.Neo4jConfiguration$$EnhancerByCGLIB$$775b2448$$EnhancerByCGLIB$$e7c2c330$$EnhancerByCGLIB$$4422c70aBeanInfo]
  required by [neo4j.domain(com.example.neo4j.domain)] scanning
  available bundles
  [2011-05-16 15:10:49.472] region-dm-3
  

Re: [Neo4j] Unable to Get Backup to Run

2011-05-23 Thread Peter Neubauer
Kevin,
could you please zip the contents of your data/log directory and the
messages.log and send them off list to me, so we can have a look at your
problem?

Cheers,

/peter neubauer

GTalk:  neubauer.peter
Skype   peter.neubauer
Phone   +46 704 106975
LinkedIn   http://www.linkedin.com/in/neubauer
Twitter  http://twitter.com/peterneubauer

http://www.neo4j.org   - Your high performance graph database.
http://startupbootcamp.org/- Öresund - Innovation happens HERE.
http://www.thoughtmade.com - Scandinavia's coolest Bring-a-Thing party.


On Mon, May 23, 2011 at 12:45 PM, Mattias Persson matt...@neotechnology.com
 wrote:

 Hmm, no it does not. There has got to be something else going on... the log
 message you pasted doesn't really say anything, just that a connection
 timed
 out and the server noticed that.

 2011/5/22 Kevin Dieter kevin.die...@megree.com

  Here's what I see in the messages.log when I tried the backup command:
 
  Fri May 20 07:00:24 PDT 2011: Found dead channel [id: 0x3d36acb6, /
  127.0.0.1:56110 : /127.0.0.1:6362], SlaveContext[ID:0,
 eventIdentifier:0,
  [(lucene-index, 15726285), (nioneodb, 38747027)]]
  Fri May 20 07:00:24 PDT 2011: Removed [id: 0x3d36acb6, /127.0.0.1:56110:
  /
  127.0.0.1:6362], SlaveContext[ID:0, eventIdentifier:0, [(lucene-index,
  15726285), (nioneodb, 38747027)]]
 
  It also seems the server becomes somewhat unstable after this and
  eventually
  I need to stop and restart it (and it always seems to detect it as a
  non-clean shutdown and spends a fair amount of time applying transactions
  to
  restore the state of the server).
 
  Does this help?
 
  Kevin
 
 
 
  On Fri, May 20, 2011 at 4:42 PM, Mattias Persson
  matt...@neotechnology.comwrote:
 
   Could you post the contents of the messages.log from the database
   directory?
   It may be that it encounters an exception on the database you're
 getting
   the
   backup from. If you're running neo4j server the file would be
   neo4j-server-directory\data\graph.db\messages.log or if you run an
   embedded database it would be neo4j-database-directory\messages.log.
  That
   would could give hints about the problem.
  
   Are you seeing more/other stacktraces btw? Could you post full
  stacktraces?
  
   2011/5/20 Kevin Dieter kevin.die...@megree.com
  
Hi,
   
I am trying to set up a scheduled backup for my neo4j database and I
  have
been unable to get the backup to run.
   
See below for the commands I am running (first to do a full backup
 and
   then
incremental).
   
The weird thing is that I was able to run the full backup, and
   incremental
successfully last night using the exact same commands.
   
Any idea why I am getting the timeout exception?
   
Thanks,
   
Kevin
---
   
C:\cURLC:\neo4J\neo4j-enterprise-1.3-windows\bin\neo4jbackup -full
  -from
single://localhost:6362 -to c:/neo4J-backup
Performing full backup from 'single://localhost:6362'
Exception in thread main java.lang.RuntimeException:
 c:/neo4J-backup
already contains a database
   at org.neo4j.backup.OnlineBackup.full(OnlineBackup.java:69)
   at org.neo4j.backup.BackupTool.doBackup(BackupTool.java:119)
   at org.neo4j.backup.BackupTool.main(BackupTool.java:83)
   
C:\cURLC:\neo4J\neo4j-enterprise-1.3-windows\bin\neo4jbackup
   -incremental
-from single://localhost:6362 -to c:/neo4J-backup
Performing incremental backup from 'single://localhost:6362'
Couldn't connect to 'single://localhost:6362',
   org.neo4j.com.ComException:
org.jboss.netty.handler.queue.BlockingReadTimeoutException
___
Neo4j mailing list
User@lists.neo4j.org
https://lists.neo4j.org/mailman/listinfo/user
   
  
  
  
   --
   Mattias Persson, [matt...@neotechnology.com]
   Hacker, Neo Technology
   www.neotechnology.com
   ___
   Neo4j mailing list
   User@lists.neo4j.org
   https://lists.neo4j.org/mailman/listinfo/user
  
  ___
  Neo4j mailing list
  User@lists.neo4j.org
  https://lists.neo4j.org/mailman/listinfo/user
 



 --
 Mattias Persson, [matt...@neotechnology.com]
 Hacker, Neo Technology
 www.neotechnology.com
 ___
 Neo4j mailing list
 User@lists.neo4j.org
 https://lists.neo4j.org/mailman/listinfo/user

___
Neo4j mailing list
User@lists.neo4j.org
https://lists.neo4j.org/mailman/listinfo/user


Re: [Neo4j] ClosedChannelExceptions in highly concurrent environment

2011-05-23 Thread Jennifer Hickey
Hi Tobias,

Looks like the environment is still setup, so I should be able to attempt a 
repro with a patched version.  Let me know what you would like me to use.

Thanks,
Jennifer

From: user-boun...@lists.neo4j.org [user-boun...@lists.neo4j.org] On Behalf Of 
Tobias Ivarsson [tobias.ivars...@neotechnology.com]
Sent: Monday, May 16, 2011 11:01 PM
To: Neo4j user discussions
Subject: Re: [Neo4j] ClosedChannelExceptions in highly concurrent environment

Hi Jennifer,

Could you reproduce it on your side by doing the same kind of systems tests
again? If you could then I'd be very happy if you could try a patched
version that we have been working on and see if that fixes the issue.

Cheers,
Tobias

On Tue, May 17, 2011 at 2:49 AM, Jennifer Hickey jhic...@vmware.com wrote:

 Hi Tobias,
 Unfortunately I don't have an isolated test case, as I was doing a fairly
 involved system test at the time.  I may be able to have a colleague work on
 reproducing it at a later date (I've been diverted to something else for the
 moment).

 I was remote debugging with Eclipse, so I toggled a method breakpoint on
 Thread.interrupt() and then inspected the stack once the breakpoint was hit.

 Sorry I don't have more information at the moment.  I agree that
 eliminating the interrupts sounds like the best approach, if possible.

 Thanks,
 Jennifer
 
 From: user-boun...@lists.neo4j.org [user-boun...@lists.neo4j.org] On
 Behalf Of Tobias Ivarsson [tobias.ivars...@neotechnology.com]
 Sent: Thursday, April 28, 2011 6:23 AM
 To: Neo4j user discussions
 Subject: Re: [Neo4j] ClosedChannelExceptions in highly concurrent
 environment

 Hi Jennifer,

 I'd first like to thank you for the testing and analysis you've done. Very
 useful stuff. Do you think you could send some test code our way that
 reproduces this issue?

 This is actually the first time this issue has been reported, so I wouldn't
 say it is a common issue. My guess is that your thread volume triggered a
 rare condition that wouldn't be encountered otherwise.

 I'm also curious to know how you found the source of the interruptions.
 When
 I debug thread interruptions I've never been able to find out where the
 thread got interrupted from without doing tedious procedures of breakpoint
 +
 logging + trying to match thread ids. If you have a better method for doing
 that I'd very much like to know.

 I think we should focus the effort on fixing the interruption issue if we
 can. And I believe we would be able to do that if the interruptions do in
 fact originate from where you say they do. But the suggestion of being able
 to switch the lucene directory implementation is still interesting, but as
 you point out since it has issues on some platforms it would be better if
 we
 could be rid of the interruption issue.

 Cheers,
 Tobias

 On Thu, Apr 28, 2011 at 12:41 AM, Jennifer Hickey jhic...@vmware.com
 wrote:

  Hello,
  I've been running some tests w/approx 400 threads reading various indexed
  property values.  I'm running on 64 bit Linux.  I was frequently seeing
 the
  ClosedChannelException below.  The javadoc on Lucene's NIOFSDirectory
 states
  that Accessing this class either directly or indirectly from a thread
 while
  it's interrupted can close the underlying file descriptor immediately if
 at
  the same time the thread is blocked on IO. The file descriptor will
 remain
  closed and subsequent access to {@link NIOFSDirectory} will throw a
 {@link
  ClosedChannelException}.  If your application uses either {@link
  Thread#interrupt()} or {@link Future#cancel(boolean)} you should use
 {@link
  SimpleFSDirectory} in favor of {@link NIOFSDirectory}.
 
  A bit of debugging revealed that the Thread.interrupts were coming from
  Neo4j, specifically in RWLock and MappedPersistenceWindow.  So it seems
 like
  this would be a common problem, though perhaps I am missing something?
 
  SimpleFSDirectory seems a bit of a performance bottleneck, so I switched
 to
  MMapDirectory and the problem did go away.  I didn't see a way to switch
  implementations w/out modifying neo4j code, so I changed LuceneDataSource
 as
  follows:
 
   static Directory getDirectory( String storeDir,
 IndexIdentifier identifier ) throws IOException
  {
 MMapDirectory dir=new MMapDirectory(getFileDirectory( storeDir,
  identifier), null);
 if(MMapDirectory.UNMAP_SUPPORTED) {
 dir.setUseUnmap(true);
 }
 return dir;
   }
 
  So I'm wondering if others have seen this problem and/or if there is a
  recommended solution?  Our product runs on quite a few different
 operating
  systems, so I have some reservations about using MMapDirectory as well
  (javadoc speaks of a few caveats on Windows, 64 vs 32, etc). Also, I'd
  rather not maintain a patched version of the neo4j code if avoidable.
 
  Thanks!
  Jennifer
 
  Exception:
  Caused by: java.nio.channels.ClosedChannelException

[Neo4j] Some feedback about the installation on Ubuntu 10.04.2 (LTS)

2011-05-23 Thread Louis Opter
Hello,

I have installed Neo4j on Ubuntu 10.04.2 using the latest community edition
release (1.4.M02).

I created a neo4j user with an home in /opt/neo4j, unpacked the archive in
there and chowned everything to the neo4j user and group.

I have noticed some very questionable permissions in the archive with almost
every file in  (that is, setuid, setgid and sticky bits set) and almost
each directory in 777 too.

A simple `tar -zttf release.tar.gz | less' will confirm that.

Once launched, Neo4j created a lot of files in /tmp with open permissions (666)
and the most scary of them is a shared library: libjansi-1.5.so.

I wonder what will happen if I replace this library with an home brewed version.

Best regards

-- 
Louis Opter
___
Neo4j mailing list
User@lists.neo4j.org
https://lists.neo4j.org/mailman/listinfo/user


[Neo4j] Neo Index Framework Question

2011-05-23 Thread Rick Bullotta
I see in the LuceneTimeline how I can do a reverse query (e.g. most recent 
stuff first), but I don't see any way to do so in a generic numeric range 
query.  Does this exist at all today?  We have a need for a composite query 
(date between x and y and type = Cheese and mouseName = Mickey).  I 
know how I could tackle this with Lucene, but not with the Neo wrapper.

Thanks!

Rick


___
Neo4j mailing list
User@lists.neo4j.org
https://lists.neo4j.org/mailman/listinfo/user


Re: [Neo4j] Neo Index Framework Question

2011-05-23 Thread Rick Bullotta
Forgot to mention, I want the most recent matches first.  I was thinking I 
could do this via a sort after the fact, but that would require retrieving a 
ton of records first.  Then I thought about combining .sort(xxx) with 
.top(nnn), but again, I didn't know if it would be applied after a zillion 
matches in the numeric range occurred first.

Thanks for any advice.

-Original Message-
From: user-boun...@lists.neo4j.org [mailto:user-boun...@lists.neo4j.org] On 
Behalf Of Rick Bullotta
Sent: Monday, May 23, 2011 4:08 PM
To: Neo4j user discussions
Subject: [Neo4j] Neo Index Framework Question
Importance: High

I see in the LuceneTimeline how I can do a reverse query (e.g. most recent 
stuff first), but I don't see any way to do so in a generic numeric range 
query.  Does this exist at all today?  We have a need for a composite query 
(date between x and y and type = Cheese and mouseName = Mickey).  I 
know how I could tackle this with Lucene, but not with the Neo wrapper.

Thanks!

Rick


___
Neo4j mailing list
User@lists.neo4j.org
https://lists.neo4j.org/mailman/listinfo/user
___
Neo4j mailing list
User@lists.neo4j.org
https://lists.neo4j.org/mailman/listinfo/user


Re: [Neo4j] high IO waits on concurrent access to neo4j

2011-05-23 Thread Vincent Boulaye
Hi Peter,

Thanks for the reply. I made some more tests and here are the results:

The store files for the test take 20GB.
I increased the memorymapped to 3GB but this did not really improve the
results that much as the queries hit random parts of the store and are not
really supposed to be repeated often... So I guess that neo4j keeps loading
parts of the store into memory as the asked data is not already loaded.

Then I moved the store files to a SSD and the results are much better
indeed! It can now handle around 300 queries per second 100ms (reading
~13MB/S from the SSD). And the response times degrades much more gracefully
after that.

From what I read on the mailing list, a better solution would probably be to
implement cache sharding in order to redirect each query to a specific
instance that would be more likely to have the data in memory.
I think I'll try that next, but I have to find the time!

Regards,
Vincent




On Fri, May 20, 2011 at 3:31 PM, Peter Neubauer 
peter.neuba...@neotechnology.com wrote:

 Vincent,
 I think this is quite normal for your setup. Since you have not much
 memory,
 and a lot of data, you are hitting cold nodes pretty often, especially when
 the caches are full after a while. Then, it is a matter of how fast you can
 access the disk. How big are your store files?

 To improve IO, you either can increase RAM, or get faster disk IO by e.g.
 using SSD or even trying out setting up a RAM disk to verify this theory.

 Could you try that and report back?

 Cheers,

 /peter neubauer

 GTalk:  neubauer.peter
 Skype   peter.neubauer
 Phone   +46 704 106975
 LinkedIn   http://www.linkedin.com/in/neubauer
 Twitter  http://twitter.com/peterneubauer

 http://www.neo4j.org   - Your high performance graph database.
 http://startupbootcamp.org/- Öresund - Innovation happens HERE.
 http://www.thoughtmade.com - Scandinavia's coolest Bring-a-Thing party.


 On Wed, May 18, 2011 at 12:25 PM, Vincent Boulaye vboul...@gmail.com
 wrote:

  Hi,
 
  I am currently evaluating neo4j for a new project, and I am getting a lot
  of
  IO reads (and waits) during my tests. I'm wondering whether this is
  expected
  or not...
 
  Here are some more details about the test:
  The target application should handle around 5 billions nodes and as many
  relations.
  Half of the nodes will hold 5 small String/date properties the other half
  must hold 10 properties on average. (only 2 or 3  are indexed)
  Nowadays the nodes are distributed as small trees of around 100 nodes,
 but
  they will become more and more interconnected in the future.
 
  I did a first batch load with 100 million nodes, 100 million relations,
 400
  million properties.
  This took less than 2 hours on my test machine (core i7, 4GB ram), and I
  was
  quite happy at this point!
 
  Then I tried to test concurrent access to the data.
  I built a small web service that query a main node by an indexed
 property,
  then browse the tree of connected nodes (~100 nodes) and return them
  (reading ~400 properties to build the response).
 
  I use the embedded graph db, and I didn't give a lot of memory to neo4j
 for
  the memory mapping (~1GO)  because in the target application, I won't be
  able to put everything in memory anyway.
  The heap is configured at 1MB. The server is an ubuntu 10.10, using the
 sun
  jdk 1.6.21.
 
  When the test start, I suppose that all queries hit the memory because
 all
  queries answer in 50ms 90%percentile, which is perfect!.
  But then after a while when I reach around 30 concurrent clients (each
  making 1 query/s), the response time becomes erratic, half of the time
 the
  response still comes back in less than 100ms, but the other half is
 closer
  to 1s.
  In visualvm I see that several threads are often blocked (apparently in
  PersistenceWindowPool and usually for ~1s).
  And in vmstat I see a lot of disk reads (~3MB/s) and IO waits 10%.
 
  During my tests I played with the amount of mapped memory, I tried the
  different types of caches and the readonly graphdatabase, but the problem
  always appear after a while.
  I also tried neo4j 1.3 and 1.4M02 with the same results.
 
  Sometimes the application seems almost stable with reads ~1OOkB/s and IO
  wait 2% but this never last very long.
 
  I am wondering if this behaviour is normal and whether I am just supposed
  to
  put more RAM in the server or if there is something wrong in my setup ?
 
 
  Thanks  Regards,
  Vincent
  ___
  Neo4j mailing list
  User@lists.neo4j.org
  https://lists.neo4j.org/mailman/listinfo/user
 
 ___
 Neo4j mailing list
 User@lists.neo4j.org
 https://lists.neo4j.org/mailman/listinfo/user

___
Neo4j mailing list
User@lists.neo4j.org
https://lists.neo4j.org/mailman/listinfo/user


[Neo4j] question about remove and iterate in same transaction

2011-05-23 Thread Jose Angel Inda Herrera
hello list,
I wonder when a node will be removed in a transaction, since I have a 
transaction in which I delete a node in the graph, but I need to iterate 
lso nodes of the graph in the same transaction
thanks,
cheers
___
Neo4j mailing list
User@lists.neo4j.org
https://lists.neo4j.org/mailman/listinfo/user