Hello, >From this link on stackoverflow, https://stackoverflow.com/questions/40981743/does-apache-helix-support-partition-split-and-merge, I understand that helix do not support out of the box partition split and merge functionality.
I have a use case similar to topic and topic subscriptions in a typical messaging framework. 1. Currently I model a topic as a resource in helix and it's partitioned. 2. Some of these topics could become hot-topic and may co-exist with other topics, on the same node, thus experiencing the bottleneck. Which topic could be a hot-spot is *not* known ahead of time. 3. Thus the partition to which this hot-topic belongs to is a candidate for splitting, such that the original partition could be served from multiple nodes. 4. I was thinking of a complicated approach of achieving split via hierarchical logical resource arrangement. 1. monitoring current load of a partition, based on #of current subscribers, 2. upon a certain threshold, on the fly, create a helix resource that represents the hot-partition and add participants(nodes) to it. 3. by doing this, I try to achieve further sub-division within the original partition. Are there any recommendations on how to use a helix for partition splitting ? Thanks, Santosh
