Hi Dima, I have actually had what I think is the same issue a few times. I haven't figured out exactly what the issue is yet but this is where I got to.
Basically I somehow got: "Unable to rollback transaction. Some resources may be commited others not. Neo4j kernel should be SHUTDOWN for resource maintance and transaction recovery ---->" Then: org.neo4j.graphdb.TransactionFailureException: Unable to commit transaction Caused by: javax.transaction.HeuristicMixedException: Unable to rollback ---> error code in commit: -1 ---> error code for rollback: 0 At which point the TxManager is set to not ok and will not hand out another transaction. Since I haven't figured out whats causing this I proxy all calls for beginTx through some of my own code that watches for this and shuts down and starts the database. This is obviously not ideal, especially since it causes a database consistency check to occur and stops all database related work for the time that takes. When I was getting this I was running on 1.2 though and decided to upgrade (1.4.1) and see if I still get the issue before raising it. Haven't seen it since, but have only been running a few days. Cheers Bryce On Fri, Sep 2, 2011 at 8:17 PM, Dima Gutzeit <[email protected]>wrote: > Any thoughts on the matter ? > > It scares me that the database can stop processing requests like that, > unless I am doing something very illegal and wrong. > > Thanks in advance. > > Regards, > Dima Gutzeit. > > > > > On Thu, Sep 1, 2011 at 9:09 PM, Dima Gutzeit <[email protected] > >wrote: > > > Here is the story. I had some problem with my index, some inconsistency, > > which cause lots of those: > > > > org.neo4j.graphdb.NotFoundException: phone property not found for > > NodeImpl#115. > > at > > > org.neo4j.kernel.impl.core.Primitive.newPropertyNotFoundException(Primitive.java:172) > > ~[neo4j-kernel-1.4.jar:1.4] > > at > > org.neo4j.kernel.impl.core.Primitive.getProperty(Primitive.java:167) > > ~[neo4j-kernel-1.4.jar:1.4] > > at > > org.neo4j.kernel.impl.core.NodeProxy.getProperty(NodeProxy.java:145) > > ~[neo4j-kernel-1.4.jar:1.4] > > at > > > com.foo.module.graph.actors.BaseGraphServiceActor.nodeTo(BaseGraphServiceActor.java:89) > > ~[module-neo4j-1.0-SNAPSHOT.jar:na] > > at > > > com.foo.module.graph.actors.NodeManagerActor.updates(NodeManagerActor.java:118) > > ~[module-neo4j-1.0-SNAPSHOT.jar:na] > > at > com.foo.module.graph.actors.NodeManager$$ProxiedByAWDelegation$$ > > 1315857921056.aw > $original$_AW_$updates$_AW_$com_foo_module_graph_actors_NodeManager$$ProxiedByAWDelegation$$1315857921056(Unknown > > Source) [aspectwerkz-2.2.3.jar:na] > > at > > > com.foo.module.graph.actors.NodeManager$$ProxiedByAWDelegation$$1315857921056_1_ > > 2012754604_1561793389___AW_JoinPoint.proceed(Unknown Source) > > [aspectwerkz-2.2.3.jar:na] > > at > > > akka.actor.TypedActor$$anonfun$receive$1$$anonfun$apply$1$$anonfun$apply$2.apply(TypedActor.scala:227) > > [akka-typed-actor-1.2-RC5.jar:na] > > at scala.util.DynamicVariable.withValue(DynamicVariable.scala:57) > > [scala-library-2.9.0-1.jar:na] > > at > > > akka.actor.TypedActor$$anonfun$receive$1$$anonfun$apply$1.apply(TypedActor.scala:216) > > [akka-typed-actor-1.2-RC5.jar:na] > > at scala.util.DynamicVariable.withValue(DynamicVariable.scala:57) > > [scala-library-2.9.0-1.jar:na] > > at > > akka.actor.TypedActor$$anonfun$receive$1.apply(TypedActor.scala:215) > > [akka-typed-actor-1.2-RC5.jar:na] > > at > > akka.actor.TypedActor$$anonfun$receive$1.apply(TypedActor.scala:213) > > [akka-typed-actor-1.2-RC5.jar:na] > > at akka.actor.Actor$class.apply(Actor.scala:551) > > [akka-actor-1.2-RC5.jar:na] > > at akka.actor.TypedActor.apply(TypedActor.scala:114) > > [akka-typed-actor-1.2-RC5.jar:na] > > at akka.actor.LocalActorRef.invoke(ActorRef.scala:905) > > [akka-actor-1.2-RC5.jar:na] > > at > akka.dispatch.MessageInvocation.invoke(MessageHandling.scala:25) > > [akka-actor-1.2-RC5.jar:na] > > at > > > akka.dispatch.ExecutableMailbox$class.processMailbox(ExecutorBasedEventDrivenDispatcher.scala:216) > > [akka-actor-1.2-RC5.jar:na] > > at > > > akka.dispatch.ExecutorBasedEventDrivenDispatcher$$anon$4.processMailbox(ExecutorBasedEventDrivenDispatcher.scala:122) > > [akka-actor-1.2-RC5.jar:na] > > at > > > akka.dispatch.ExecutableMailbox$class.run(ExecutorBasedEventDrivenDispatcher.scala:188) > > [akka-actor-1.2-RC5.jar:na] > > at > > > akka.dispatch.ExecutorBasedEventDrivenDispatcher$$anon$4.run(ExecutorBasedEventDrivenDispatcher.scala:122) > > [akka-actor-1.2-RC5.jar:na] > > at > > > java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886) > > [na:1.6.0_25] > > at > > > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908) > > [na:1.6.0_25] > > at java.lang.Thread.run(Thread.java:662) [na:1.6.0_25] > > at > akka.dispatch.MonitorableThread.run(ThreadPoolBuilder.scala:184) > > [akka-actor-1.2-RC5.jar:na] > > > > it happened only one some of the operations. > > > > Over time all operations started to fail with: > > > > org.neo4j.graphdb.TransactionFailureException: Unable to begin > transaction > > at > > > org.neo4j.kernel.EmbeddedGraphDbImpl.beginTx(EmbeddedGraphDbImpl.java:393) > > ~[neo4j-kernel-1.4.jar:1.4] > > at > > > org.neo4j.kernel.EmbeddedGraphDatabase.beginTx(EmbeddedGraphDatabase.java:138) > > ~[neo4j-kernel-1.4.jar:1.4] > > at > > > com.foo.module.graph.actors.NodeManagerActor.promoteNode(NodeManagerActor.java:228) > > ~[module-neo4j-1.0-SNAPSHOT.jar:na] > > at > > > com.foo.module.graph.actors.NodeManagerActor.createNode(NodeManagerActor.java:55) > > ~[module-neo4j-1.0-SNAPSHOT.jar:na] > > at > com.foo.module.graph.actors.NodeManager$$ProxiedByAWDelegation$$ > > 1316234529667.aw > $original$_AW_$createNode$_AW_$com_foo_module_graph_actors_NodeManager$$ProxiedByAWDelegation$$1316234529667(Unknown > > Source) ~[aspectwerkz-2.2.3.jar:na] > > at > > > com.foo.module.graph.actors.NodeManager$$ProxiedByAWDelegation$$1316234529667_1_1717022187_920046141___AW_JoinPoint.proceed(Unknown > > Source) ~[aspectwerkz-2.2.3.jar:na] > > at > > > akka.actor.TypedActor$$anonfun$receive$1$$anonfun$apply$1$$anonfun$apply$2.apply(TypedActor.scala:227) > > ~[akka-typed-actor-1.2-RC5.jar:na] > > at scala.util.DynamicVariable.withValue(DynamicVariable.scala:57) > > [scala-library-2.9.0-1.jar:na] > > at > > > akka.actor.TypedActor$$anonfun$receive$1$$anonfun$apply$1.apply(TypedActor.scala:216) > > [akka-typed-actor-1.2-RC5.jar:na] > > at scala.util.DynamicVariable.withValue(DynamicVariable.scala:57) > > [scala-library-2.9.0-1.jar:na] > > at > > akka.actor.TypedActor$$anonfun$receive$1.apply(TypedActor.scala:215) > > [akka-typed-actor-1.2-RC5.jar:na] > > at > > akka.actor.TypedActor$$anonfun$receive$1.apply(TypedActor.scala:213) > > [akka-typed-actor-1.2-RC5.jar:na] > > at akka.actor.Actor$class.apply(Actor.scala:551) > > [akka-actor-1.2-RC5.jar:na] > > at akka.actor.TypedActor.apply(TypedActor.scala:114) > > [akka-typed-actor-1.2-RC5.jar:na] > > at akka.actor.LocalActorRef.invoke(ActorRef.scala:905) > > [akka-actor-1.2-RC5.jar:na] > > at > akka.dispatch.MessageInvocation.invoke(MessageHandling.scala:25) > > [akka-actor-1.2-RC5.jar:na] > > at > > > akka.dispatch.ExecutableMailbox$class.processMailbox(ExecutorBasedEventDrivenDispatcher.scala:216) > > [akka-actor-1.2-RC5.jar:na] > > at > > > akka.dispatch.ExecutorBasedEventDrivenDispatcher$$anon$4.processMailbox(ExecutorBasedEventDrivenDispatcher.scala:122) > > [akka-actor-1.2-RC5.jar:na] > > at > > > akka.dispatch.ExecutableMailbox$class.run(ExecutorBasedEventDrivenDispatcher.scala:188) > > [akka-actor-1.2-RC5.jar:na] > > at > > > akka.dispatch.ExecutorBasedEventDrivenDispatcher$$anon$4.run(ExecutorBasedEventDrivenDispatcher.scala:122) > > [akka-actor-1.2-RC5.jar:na] > > at > > > java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886) > > [na:1.6.0_25] > > at > > > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908) > > [na:1.6.0_25] > > at java.lang.Thread.run(Thread.java:662) [na:1.6.0_25] > > at > akka.dispatch.MonitorableThread.run(ThreadPoolBuilder.scala:184) > > [akka-actor-1.2-RC5.jar:na] > > Caused by: javax.transaction.SystemException: TM has encountered some > > problem, please perform neccesary action (tx recovery/restart) > > at > > org.neo4j.kernel.impl.transaction.TxManager.begin(TxManager.java:554) > > ~[neo4j-kernel-1.4.jar:1.4] > > at > > > org.neo4j.kernel.EmbeddedGraphDbImpl.beginTx(EmbeddedGraphDbImpl.java:388) > > ~[neo4j-kernel-1.4.jar:1.4] > > ... 23 common frames omitted > > > > > > > > Maybe its related and maybe not, not sure. > > > > > > Regards , > > > > Dima Gutzeit. > > > > > > > > > > On Thu, Sep 1, 2011 at 6:20 PM, Peter Neubauer < > > [email protected]> wrote: > > > >> Dima, > >> got the rest of the stacktrace? > >> > >> Cheers, > >> > >> /peter neubauer > >> > >> GTalk: neubauer.peter > >> Skype peter.neubauer > >> Phone +46 704 106975 > >> LinkedIn http://www.linkedin.com/in/neubauer > >> Twitter http://twitter.com/peterneubauer > >> > >> http://www.neo4j.org - Your high performance graph > >> database. > >> http://startupbootcamp.org/ - Öresund - Innovation happens HERE. > >> http://www.thoughtmade.com - Scandinavia's coolest Bring-a-Thing party. > >> > >> > >> On Thu, Sep 1, 2011 at 1:44 PM, Dima Gutzeit < > [email protected] > >> >wrote: > >> > >> > Any idea what can cause this: > >> > > >> > > >> > org.neo4j.graphdb.TransactionFailureException: Unable to begin > >> transaction > >> > at > >> > > >> > org.neo4j.kernel.EmbeddedGraphDbImpl.beginTx(EmbeddedGraphDbImpl.java:393) > >> > ~[neo4j-kernel-1.4.jar:1.4] > >> > at > >> > > >> > > >> > org.neo4j.kernel.EmbeddedGraphDatabase.beginTx(EmbeddedGraphDatabase.java:138) > >> > ~[neo4j-kernel-1.4.jar:1.4] > >> > Caused by: javax.transaction.SystemException: TM has encountered some > >> > problem, please perform neccesary action (tx recovery/restart) > >> > at > >> > org.neo4j.kernel.impl.transaction.TxManager.begin(TxManager.java:554) > >> > ~[neo4j-kernel-1.4.jar:1.4] > >> > at > >> > > >> > org.neo4j.kernel.EmbeddedGraphDbImpl.beginTx(EmbeddedGraphDbImpl.java:388) > >> > ~[neo4j-kernel-1.4.jar:1.4] > >> > ... 22 common frames omitted > >> > _______________________________________________ > >> > Neo4j mailing list > >> > [email protected] > >> > https://lists.neo4j.org/mailman/listinfo/user > >> > > >> _______________________________________________ > >> Neo4j mailing list > >> [email protected] > >> https://lists.neo4j.org/mailman/listinfo/user > >> > > > > > _______________________________________________ > Neo4j mailing list > [email protected] > https://lists.neo4j.org/mailman/listinfo/user > _______________________________________________ Neo4j mailing list [email protected] https://lists.neo4j.org/mailman/listinfo/user
