[
https://issues.apache.org/jira/browse/KUDU-2823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16841961#comment-16841961
]
Alexey Serbin commented on KUDU-2823:
-------------------------------------
[~helifu], thanks the update!
OK, it seems we can attribute the original high skew to the addition of those
new tablet servers. The good news is that the rebalancing of the cluster
helped to make the skew smaller.
Anyway, I think it would be nice to add a test to make sure adding partitions
doesn't increase the skew a lot. At least, right now we don't have such a
test, IIRC. Meanwhile, feel free to add more information on your observations
over the skew upon adding new range partitions.
Thank you!
> Rebalance range partition
> -------------------------
>
> Key: KUDU-2823
> URL: https://issues.apache.org/jira/browse/KUDU-2823
> Project: Kudu
> Issue Type: Improvement
> Reporter: HeLifu
> Assignee: Xu Yao
> Priority: Major
>
> Right now we will add new range every day for a fact table which has
> range+hash partitions, and then rebalance it as soon as possible. It seems
> that not only the new added tablets of this table but also the historical
> tablets will be rebalanced. But the historical tablets already have data, so
> they are heavy to move and it will increase the disk and network suddenly.
> So, I think it will be good to rebalance the new added range partitions.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
