clairemcginty commented on issue #1452:
URL: https://github.com/apache/parquet-java/issues/1452#issuecomment-2271436067
`contains()` and `not(contains())` have been added, the only operation
missing now is `size()`.
Probably we want to be able to express eq/lt/gt operations here, i.e.
`size(arrayColumn("foo"), lt(5))`.
I think the bulk of the implementation logic will be at the record-level
(`IncrementallyUpdatedFilterPredicate`).
DictionaryFilter/StatisticsFilter/RowGroupFilter can probably do some very
basic filtering (i.e. if user wants to filter to `size(col, eq(0))`, we can
pass/fail the row groups if there are any values present), but not much more.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
