szehon-ho commented on PR #56195: URL: https://github.com/apache/spark/pull/56195#issuecomment-4569404257
I was just testing PartitionPredicate with @aokolnychyi ([SPARK-55596](https://issues.apache.org/jira/browse/SPARK-55596) and realized i missed this case. I should check the 'pushedPredicates' instead of return value of 'pushPredicate(Predicate)' in deciding what to pushdown the second pass. Otherwise, I will re-push partially pushed predicates . @huaxingao sorry i think this needs to go into 4.2 as its a day0 bug. @cloud-fan can you help take a look? Thanks -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
