andygrove commented on issue #7212: URL: https://github.com/apache/datafusion-comet/issues/7212#issuecomment-7052528946
Update: the upstream fix is apache/iceberg-rust#3632, which closes iceberg-rust#3611 and also iceberg-rust#3616 (INT64 nanosecond timestamps read 1000x too large). It makes the INT96 coercion set the UTC timezone for `timestamptz` columns, so projection no longer drops them. It assigns field ids from the name mapping before it coerces, so the no-ids plus name-mapping case here is covered. mbutrovich confirmed in the review that a Comet-style filtered scan on that branch returns correct values. The PR is approved by one reviewer and the review rounds are done, and it is waiting on a re-review. Until the iceberg-rust pin includes #3632, this stays open. The pin in #7249 is based on `b154603a`, the commit where this was reproduced, so the DF 56 build will have the same bug. Once the pin moves, this issue needs a regression test for the repro above. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
