rdblue commented on issue #4621: URL: https://github.com/apache/iceberg/issues/4621#issuecomment-1111379942
@hangc0276 if you're guaranteeing that each partition is written by only one writer (which I think is given) then you should be able to accomplish this already because you process records in order within a partition to the file, then when you read they have the same order. The challenge is what to do when a partition is split across multiple files within a snapshot, right? The easy solution is not to split partitions across files, but you could also look at file metadata to see which one has the lowest `ledgerId, entryId` pair. I think you should be able to do this without much trouble. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
