andrei-ionescu commented on issue #3564: URL: https://github.com/apache/iceberg/issues/3564#issuecomment-982723080
@RussellSpitzer, are you saying that in the future the sorting won't be needed because the distribution (or repartition) will be implemented inside the Iceberg data source (writer)? Did I get that right? If so, I think there will be other use cases where the sorting will be necessary for other purposes. For example sort in Spark by `col_a`, `col_b` and `col_c` but partition in Iceberg only by `col_a` and `col_b`. In this case the two sorting actions should match. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
