RussellSpitzer opened a new issue #4302: URL: https://github.com/apache/iceberg/issues/4302
After thinking about this for a while I think this is only true for V1 tables and we probably have a bug in V2 tables in our group by partition code in base rewrite action [here](https://github.com/RussellSpitzer/iceberg/blob/c6e68d832113266994c0eb06d342e032fc9cbca3/core/src/main/java/org/apache/iceberg/actions/BaseRewriteDataFilesAction.java#L264-L265). Consider ``` So for example say I have a V1 table, Columns A, B I first partition on a spec1 = Identity<A> then i drop that and partition on B spec2 = Void<A>, Identity<B> In V2 it works like this spec1 = Identity<A> spec2 = Identity<B> ``` In this case while the specs have the same shape, the values do not mean the same thing so our grouping is going to be incorrect. _Originally posted by @RussellSpitzer in https://github.com/apache/iceberg/pull/4279#discussion_r821187987_ -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
