hotienvu commented on pull request #29661: URL: https://github.com/apache/spark/pull/29661#issuecomment-688741730
Updated with some details. We have a job where the values in the IN clause are machine-generated hence the range can be arbitrary but dense at the same time which is hard to look at. having a simplified range checks helps. This alone may not be that useful, but if we can detect and compact the range, it would be nice e.g. 1,3,4,5,6,9,10,11 => 1, 3..6, 9..11 ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
