gengliangwang commented on pull request #29831: URL: https://github.com/apache/spark/pull/29831#issuecomment-706152111
> FileSourceScanExec uses the partition filters when listing files, but the filters do nothing because unnecessary partitions are already pruned in advance, so the filters are mainly used for explain output in this case Actually, the partition filters can contain dynamic partition pruning filters. So the description is wrong here. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
