ypsah commented on issue #46183: URL: https://github.com/apache/arrow/issues/46183#issuecomment-2817232884
While the bug appears to have existed for numerous versions and its impact must have been limited until now, [apache/iceberg-python](https://github.com/apache/iceberg-python)'s particular usage of `pyarrow` makes it a more concrete issue now: partitioned datasets include the partition columns (making it more likely that a whole fragment includes only `0.0`). This is how I initially encountered this issue, and mistakenly attributed it to `apache/iceberg-python`: https://github.com/apache/iceberg-python/issues/1937. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@arrow.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
