lirui-apache commented on issue #4997:
URL: https://github.com/apache/iceberg/issues/4997#issuecomment-1650970214
Thanks @RussellSpitzer and @puchengy for your inputs. In my above example, I
guess casting the column or the literal have different semantics, e.g. both
`cast('123' as int) = 123` and `cast('0123' as int) = 123` yield true, but
`'0123' = cast(123 as string)` is false. We can educate users not to write such
filters, but sometimes the query is generated by BI tools and users may not
have control over that. So I suppose we'll have to implement split level
filtering in spark like what trino does.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
