swuferhong commented on issue #380: URL: https://github.com/apache/fluss/issues/380#issuecomment-3141860825
Hi, @LB-Yu . Sorry for the slow reply. The dynamic partition feature we introduced in Fluss-0.7 currently shows good performance in dynamic partition creation. However, for extremely large multi-fields partitioned tables, early morning switching still puts pressure on the cluster. Nevertheless, I still believe optimizing partition creation efficiency is a better solution than defining custom auto-partitioning logic. Custom pre-creation logic for multi-fields partitions may introduce greater complexity and can be difficult for users to enumerate. Therefore, I think our future direction should focus on continuing to optimize partition creation efficiency, like batch register Zookeeper and async register Zookeeper, etc. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
