mxm commented on issue #14251: URL: https://github.com/apache/iceberg/issues/14251#issuecomment-3414484438
Thanks you for reporting this bug @zncleon! I did a lot of digging because I couldn't figure out how a DeleteFile could end up as a DataFile. There isn't any obvious bug where we might mix up the two. However, I've found the issue which isn't exactly obvious. We create these so called DeletaManifests which contain the paths to the temporary manifest files which we combine later during commit. What we see in the error you reported is that a "delete manifest" ended up getting used as a regular "data manifest". This is caused accidentally reusing the same manifest paths, due to a caching issue with the code that generates these paths. Fix is here: https://github.com/apache/iceberg/pull/14358 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
