yikf commented on PR #37254: URL: https://github.com/apache/spark/pull/37254#issuecomment-1192739675
> can you briefly explain your idea? Do you keep a range for each column and update the range when seeing a comparison? Then use the range to update the column comparison predicate? Yea, if capture a `and` conjunction and both it's `left` and `right` are `BinaryComparisonExpression`, we optimize this predicate as following step: - Normal `and` left and right comparison expression, to keep `Attribute` is left side and `literal` is right side. - If both comparison expression left child is semantic equal and right child is foldable, we compute a range for comparison left side. - Then update this column comparison predicate by this range. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
