Gary Tully created ARTEMIS-4314:
-----------------------------------
Summary: Federation, support consumerWindowSize zero and federate
in batches only when the local queue is empty
Key: ARTEMIS-4314
URL: https://issues.apache.org/jira/browse/ARTEMIS-4314
Project: ActiveMQ Artemis
Issue Type: Improvement
Components: Federation
Affects Versions: 2.28.0
Reporter: Gary Tully
Assignee: Gary Tully
Fix For: 2.29.0
Dual queue federation, where clusters federate in both direction can suffer
from message flip flopping once the priority adjustment kicks in.
If there is a large backlog, the lower priority federation consumer is in play
once all of the local consumer credit is exhausted and the backlog can drain to
the other cluster.
If demand is low there, the process can repeat. limiting the rate of the
federation consumer can help but it is not ideal b/c when there is no local
demand, we want to have a high rate of migration.
A possible solution is to have the federation consumer manage its own credit
and only flow messages when the local queue is empty. Then flow a batch of
messages, and await again that the local queue is empty. In this way, there is
no thundering heard effect, but there is also fast migration of messages once
there is demand.
the consumerWindowSize=0 is already in play for consumer.receive calls and
there is already a defaultConsumerWindowSize for an address. These can be
combined to realise batchFederationOnEmpty semantics.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
