[
https://issues.apache.org/jira/browse/GEODE-7012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16896522#comment-16896522
]
ASF subversion and git services commented on GEODE-7012:
--------------------------------------------------------
Commit 1b7d7fefb4dca03fec8ac01df5a466ff716a0018 in geode's branch
refs/heads/develop from Dan Smith
[ https://gitbox.apache.org/repos/asf?p=geode.git;h=1b7d7fe ]
GEODE-7012: Execute the StartupMessage in the waiting pool (#3844)
Until we get a response to a StartupMessage, we end up blocking up high
priority thread pool threads. So the StartupMessage should be processed
in a different, unbounded threadpool to avoid a distributed deadlock.
Also, added unit tests for StartupMessage and StartupResponseMessage
excercising getProcessorType() to guard against future unintended alteration.
> Distributed deadlock with StartupMessages if executor pools get full
> --------------------------------------------------------------------
>
> Key: GEODE-7012
> URL: https://issues.apache.org/jira/browse/GEODE-7012
> Project: Geode
> Issue Type: Bug
> Affects Versions: 1.10.0
> Reporter: Dan Smith
> Assignee: Ernest Burghardt
> Priority: Major
> Time Spent: 50m
> Remaining Estimate: 0h
>
> We hit a distributed deadlock in one of our tests where two members are hung
> sending startup messages to each other.
> It turns out that until a member gets a response to a StartupMessage, it is
> in a state where it blocks all outgoing messages. At the same time, the
> member is receiving an attempting to respond to other messages, but those
> responses get blocked. If too many messages come in before the
> StartupResponseMessage, this ends up filling up the
> ClusterDistributionManager.highPriorityPool.
> If two members are trying to start up at the same time, and they both fill up
> the highPriorityPool, they both will fail to process each other's
> StartupMessage, because that message is executed in the same pool.
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)