That can happen if you had more than one active Sharding Coordinator
writing to the same journal table, for example if you had a network
partition and used auto-downing that caused the cluster to be split into
two separate clusters. These checks are there to find this problem.
On Fri, Jan 13, 2017 at 6:01 AM, Richard Ney <kamisama....@gmail.com> wrote:
> I'm seeing a scenario where a cluster member is killed by Marathon due to
> out of control memory growth because a persistent actor stops processing
> message. When Marathon kills the cluster member the cluster role doesn't
> recover due to the shard coordinators having issue. My log is full
> exceptions. Wondering if the first one is a possible bug due to the
> requirement failed.
> 2017-01-13 04:47:25.626 [ERROR]
> [reportCompute] [eplworkerslave12.lhr.manhattan.aspect-cloud.net:31871]
> [PersistentShardCoordinator] Exception in receiveRecover when replaying
> event type
> with sequence number  for persistenceId [/sharding/reportCompute.
> java.lang.IllegalArgumentException: requirement failed: Region
> worktypes#447621404] already registered: State(Map(),Map(Actor[akka.tcp://
> sharding/reportCompute.mr427.worktypes#447621404] ->
> at scala.Predef$.require(Predef.scala:224)
> at akka.cluster.sharding.ShardCoordinator$Internal$State.updated(
> at akka.cluster.sharding.PersistentShardCoordinator$$
> at scala.runtime.AbstractPartialFunction.apply(
> at akka.persistence.Eventsourced$$anon$3$$anonfun$1.
> Along have a large number of these messages:
> [ReplayFilter] Invalid replayed event [sequenceNr=5,
> writerUUID=59b217ca-b6f6-4725-aa92-e5930d734daa]. There was already a
> newer writer whose last replayed event was [sequenceNr=5,
> writerUUID=c3a77da7-08c4-489c-b158-6c717270713d] for the same
> persistenceId [/sharding/reportCompute.pens.interactionsCoordinator].Perhaps,
> the old writer kept journaling messages after the new writer created, or
> duplicate persistentId for different entities?
> [ShardRegion] Trying to register to coordinator at
> [Some(ActorSelection[Anchor(akka://manhattan/), Path(/system/sharding/
> reportCompute.pens.worktypesCoordinator/singleton/coordinator)])], but no
> acknowledgement. Total  buffered messages.
> >>>>>>>>>> Read the docs: http://akka.io/docs/
> >>>>>>>>>> Check the FAQ: http://doc.akka.io/docs/akka/
> >>>>>>>>>> Search the archives: https://groups.google.com/group/akka-user
> You received this message because you are subscribed to the Google Groups
> "Akka User List" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to akka-user+unsubscr...@googlegroups.com.
> To post to this group, send email to email@example.com.
> Visit this group at https://groups.google.com/group/akka-user.
> For more options, visit https://groups.google.com/d/optout.
Akka Tech Lead
Lightbend <http://www.lightbend.com/> - Reactive apps on the JVM
>>>>>>>>>> Read the docs: http://akka.io/docs/
>>>>>>>>>> Check the FAQ:
>>>>>>>>>> Search the archives: https://groups.google.com/group/akka-user
You received this message because you are subscribed to the Google Groups "Akka
User List" group.
To unsubscribe from this group and stop receiving emails from it, send an email
To post to this group, send email to firstname.lastname@example.org.
Visit this group at https://groups.google.com/group/akka-user.
For more options, visit https://groups.google.com/d/optout.