ericsun2 commented on issue #417: URL: https://github.com/apache/iceberg/issues/417#issuecomment-700959643
I am not trying to change how Iceberg serialize TIMESTAMP type. I am hoping that Iceberg can maximize the expressiveness and CBO/planner efficiency with clearer and more straightforward partition spec. For example, 1. express the epoch offset precision in partition spec **without** adding an extra derived physical field in the data file 2. convert value to epoch millisecond during ETL as an extra field, then use this new field in partition spec 1. express the time zone in partition spec **without** adding an extra derived physical field in the data file 2. convert value to TIMESTAMP in a particular time zone during ETL as an extra field, then use this new field in partition spec If we want to make the most of the hidden partition style, I still favor option (1) a bit more :-) ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
