BsoBird commented on issue #3627: URL: https://github.com/apache/paimon/issues/3627#issuecomment-2217159590
>I believe data administrators can perform data migration operations based on demand. Data consistency is indeed a consideration, it can be achived by using atomic swaps. I don’t think this is an unavoidable issue. So, are you saying that the administrator needs to constantly stop writing to the flink, then perform a data migration while the writing is stopped, and then resume writing to the flink after the migration is complete?Because each re-location can only process a small amount of data.It's not an automated process. If that's what you mean, I'm sure no data manager would want to take on such a responsibility.That's why I assumed from the outset that you would use compaction for such functionality. @zhongyujiang -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
