RussellSpitzer opened a new pull request #2379: URL: https://github.com/apache/iceberg/pull/2379
Hey everyone, I've been thinking a while about redoing some thing in the RewriteDatafiles code to try to let everyone have a bit more flexibility with different means of running datafile compactions. I did some work rewriting the proposal previously submitted by @aokolnychyi and wrote up a prototype of how I can of imagine some of it working. https://docs.google.com/document/d/1aXo1VzuXxSuqcTzMLSQdnivMVgtLExgDWUFMvWeXRxc/edit?ts=600b0432#heading=h.rz9lj3frnyw7 If you are interested please take a look at the design doc ^ and then check out the PR. I'm hoping that with this kind of new api we'll be able to introduce a variety of mechanisms for dealing with many files. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
