larry77 opened a new pull request, #49256:
URL: https://github.com/apache/arrow/pull/49256
This PR adds support for dplyr::filter_out() in the Arrow R dplyr backend.
The implementation reuses the existing filter() machinery and extends
set_filters() with an `exclude` flag. When exclude = TRUE, the predicate
is transformed to match dplyr semantics (drop rows where predicate is TRUE,
keep rows where predicate is FALSE or NA).
Multiple filter_out() predicates are combined before exclusion so that
filter_out(a, b) matches dplyr semantics (i.e. drop rows where a & b is
TRUE).
This works for arrow_table(), RecordBatchReader, and open_dataset(), and
preserves lazy evaluation for larger-than-memory datasets.
Tests are added to verify basic behavior, NA handling, and multiple
predicates.
Note: local test run hits a with_language() locale issue ('.cache' not
found),
which appears environment-specific and unrelated to these changes.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
