andygrove commented on issue #7212:
URL: 
https://github.com/apache/datafusion-comet/issues/7212#issuecomment-7052528946

   Update: the upstream fix is apache/iceberg-rust#3632, which closes 
iceberg-rust#3611 and also iceberg-rust#3616 (INT64 nanosecond timestamps read 
1000x too large). It makes the INT96 coercion set the UTC timezone for 
`timestamptz` columns, so projection no longer drops them. It assigns field ids 
from the name mapping before it coerces, so the no-ids plus name-mapping case 
here is covered. mbutrovich confirmed in the review that a Comet-style filtered 
scan on that branch returns correct values. The PR is approved by one reviewer 
and the review rounds are done, and it is waiting on a re-review.
   
   Until the iceberg-rust pin includes #3632, this stays open. The pin in #7249 
is based on `b154603a`, the commit where this was reproduced, so the DF 56 
build will have the same bug. Once the pin moves, this issue needs a regression 
test for the repro above.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to