On 23/03/17 15:07, Robert Varga wrote: > I finally managed to find > some logs at > https://logs.opendaylight.org/releng/jenkins092/netvirt-csit-3node-openstack-newton-nodl-v2-upstream-transparent-carbon/376/archives/. > The sheer amount of exceptions makes reasoning about what is going on > very hard.
There seems to be an issue with RaftActor replication around index
assignment. The root cause could be something happening elsewhere, but
the stack trace indicates a mismatch should not be occuring:
2017-03-21 13:28:32,894 | WARN | ult-dispatcher-3 |
AbstractReplicatedLogImpl | 231 -
org.opendaylight.controller.sal-akka-raft - 1.5.0.SNAPSHOT |
member-2-shard-topology-operational: Cannot append new entry - new index
3485 is not greater than the last index 3485
java.lang.Exception: stack trace
at
org.opendaylight.controller.cluster.raft.AbstractReplicatedLogImpl.append(AbstractReplicatedLogImpl.java:128)[231:org.opendaylight.controller.sal-akka-raft:1.5.0.SNAPSHOT]
at
org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.appendAndPersist(ReplicatedLogImpl.java:101)[231:org.opendaylight.controller.sal-akka-raft:1.5.0.SNAPSHOT]
at
org.opendaylight.controller.cluster.raft.RaftActor.persistData(RaftActor.java:544)[231:org.opendaylight.controller.sal-akka-raft:1.5.0.SNAPSHOT]
at
org.opendaylight.controller.cluster.datastore.Shard.persistPayload(Shard.java:465)[237:org.opendaylight.controller.sal-distributed-datastore:1.5.0.SNAPSHOT]
at
org.opendaylight.controller.cluster.datastore.ShardDataTree.replicatePayload(ShardDataTree.java:438)[237:org.opendaylight.controller.sal-distributed-datastore:1.5.0.SNAPSHOT]
at
org.opendaylight.controller.cluster.datastore.ShardDataTree.abortTransaction(ShardDataTree.java:658)[237:org.opendaylight.controller.sal-distributed-datastore:1.5.0.SNAPSHOT]
at
org.opendaylight.controller.cluster.datastore.AbstractShardDataTreeTransaction.abort(AbstractShardDataTreeTransaction.java:75)[237:org.opendaylight.controller.sal-distributed-datastore:1.5.0.SNAPSHOT]
at
org.opendaylight.controller.cluster.datastore.ShardTransaction.closeTransaction(ShardTransaction.java:80)[237:org.opendaylight.controller.sal-distributed-datastore:1.5.0.SNAPSHOT]
at
org.opendaylight.controller.cluster.datastore.ShardTransaction.handleReceive(ShardTransaction.java:66)[237:org.opendaylight.controller.sal-distributed-datastore:1.5.0.SNAPSHOT]
at
org.opendaylight.controller.cluster.datastore.ShardReadTransaction.handleReceive(ShardReadTransaction.java:38)[237:org.opendaylight.controller.sal-distributed-datastore:1.5.0.SNAPSHOT]
at
org.opendaylight.controller.cluster.common.actor.AbstractUntypedActor.onReceive(AbstractUntypedActor.java:28)[230:org.opendaylight.controller.sal-clustering-commons:1.5.0.SNAPSHOT]
at
org.opendaylight.controller.cluster.common.actor.MeteringBehavior.apply(MeteringBehavior.java:104)[230:org.opendaylight.controller.sal-clustering-commons:1.5.0.SNAPSHOT]
at
akka.actor.ActorCell$$anonfun$become$1.applyOrElse(ActorCell.scala:544)[204:com.typesafe.akka.actor:2.4.17]
at
akka.actor.Actor$class.aroundReceive(Actor.scala:497)[204:com.typesafe.akka.actor:2.4.17]
at
akka.actor.UntypedActor.aroundReceive(UntypedActor.scala:95)[204:com.typesafe.akka.actor:2.4.17]
at
akka.actor.ActorCell.receiveMessage(ActorCell.scala:526)[204:com.typesafe.akka.actor:2.4.17]
at
akka.actor.ActorCell.invoke(ActorCell.scala:495)[204:com.typesafe.akka.actor:2.4.17]
at
akka.dispatch.Mailbox.processMailbox(Mailbox.scala:257)[204:com.typesafe.akka.actor:2.4.17]
at
akka.dispatch.Mailbox.run(Mailbox.scala:224)[204:com.typesafe.akka.actor:2.4.17]
at
akka.dispatch.Mailbox.exec(Mailbox.scala:234)[204:com.typesafe.akka.actor:2.4.17]
at
scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)[200:org.scala-lang.scala-library:2.11.8.v20160304-115712-1706a37eb8]
at
scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)[200:org.scala-lang.scala-library:2.11.8.v20160304-115712-1706a37eb8]
at
scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)[200:org.scala-lang.scala-library:2.11.8.v20160304-115712-1706a37eb8]
at
scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)[200:org.scala-lang.scala-library:2.11.8.v20160304-115712-1706a37eb8]
https://bugs.opendaylight.org/show_bug.cgi?id=8061 tracks this.
Bye,
Robert
signature.asc
Description: OpenPGP digital signature
_______________________________________________ openflowplugin-dev mailing list [email protected] https://lists.opendaylight.org/mailman/listinfo/openflowplugin-dev
