RussellSpitzer commented on pull request #1774: URL: https://github.com/apache/iceberg/pull/1774#issuecomment-727594475
Wouldn't we need to also eliminate the pre-sorting from the Spark write to benefit from this? As is all the rows that go into Partitioned writer are assumed to be pre grouped already so a fan out wouldn't really help. Maybe I'm missing something ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
