alamb opened a new issue #420:
URL: https://github.com/apache/arrow-datafusion/issues/420


   **Is your feature request related to a problem or challenge? Please describe 
what you are trying to do.**
   
   While evaluating queries against data stored in containers / multiple files, 
it is helpful to prune entire files using statistics (see #363 for more 
details). DataFusion has this logic already for `==`, `<`, `<=`, `>` and `>=` 
operators in the pruning predicate. 
   
   However, as @NGA-TRAN  noticed, there is no support for `!=` at the moment. 
   
   
https://github.com/apache/arrow-datafusion/blob/14f1eebef068a9e65f556ed74d2b6d98376c97f4/datafusion/src/physical_plan/parquet.rs#L683
   
   **Describe the solution you'd like**
   Add support and tests for `!=` in predicate pruning logic
   
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
[email protected]


Reply via email to