RussellSpitzer commented on issue #3564:
URL: https://github.com/apache/iceberg/issues/3564#issuecomment-984089046
Already Closed files can be ignored as well if you switch to the fan out
writer at the cost of potentially writing more files. In the current version It
would make sense to just sort using the Iceberg partitioning algorithm rather
than the Spark built in. IE Covert to UTC then get the date from that, I think
spark does have a to UTC date somewhere...
I believe we are targeting the distribution required code in the 13.0
release.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
