Ben-Zvi opened a new pull request #1783: DRILL-7240: Catch runtime pruning filter-match exceptions and do not prune these rowgroups URL: https://github.com/apache/drill/pull/1783 The basic change is simple: Catch exceptions thrown by the `match()` method checking the filter predicate over a rowgroup's statistics, and just avoid pruning that rowgroup. The current known case of such exception has to do with type casting (Long-Integer). In that case an INFO message is logged (only once per fragment). Note the case of mixed rowgroups/files, where some have the "correct" type and some don't - in that case the rowgroups with the "correct" type (i.e. no exception) would be pruned as needed (I tested that). In case other exception ever shows up, it would log a WARN message (so eventually this failure could be analyzed).
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services
