zhuxiangyi commented on PR #10098: URL: https://github.com/apache/paimon/pull/10098#issuecomment-5997832237
@JingsongLi thanks, agreed. The conversion should not make the Data Evolution code harder to understand, and this PR changes too much of the existing Data Evolution core logic for that. Our use case: in production we have a very large wide append table that needed to become a Data Evolution table. The launch was urgent and there was no way to convert it in place, so we had to rewrite all of its data into a new Data Evolution table. A metadata-only conversion would have avoided that rewrite. I'll redesign it so that the conversion stays outside the existing Data Evolution read/write/commit paths as much as possible, and split it into small PRs that are easy to review. I'll keep this PR as a draft until then. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
