Hello everyone,
I would like to ask for the advise on the following.
I have cluster of Ignite nodes serving single cache. The cache is populated
from multiple Kafka topics (topics, not partitions) . To balance the Kafka
load, every node is handling subset of the topics.
I need the mechanism where, in case of node leaving the cluster, the
"orphaned" topics will get distributed equally across the cluster. The same
should apply to node joining the cluster - in that case new node should
acquire some topics relieving other nodes in the cluster.
I was thinking about using topology events and some shared state based
on the cache with the key being Kafka's topic (something similar to
http://apache-ignite-users.70518.x6.nabble.com/Equal-Distribution-of-data-among-Ignite-instances-td10602.html)
, but I was wondering if there were other options to solve that.
Thank you in advance,
zbyszek
--
View this message in context:
http://apache-ignite-users.70518.x6.nabble.com/Equally-distributing-Kafka-topics-within-the-cluster-tp16377.html
Sent from the Apache Ignite Users mailing list archive at Nabble.com.
