cchighman commented on pull request #28841: URL: https://github.com/apache/spark/pull/28841#issuecomment-695157152
> @cchighman I like the idea of such filtering. > How about we follow the approach of the option `pathGlobFilter`: https://github.com/apache/spark/pull/24518/files#diff-e458973c0425211675054a6e6d742957R59 > > The modification time is also available in `FileStatus` Because there is a lot of info in this PR, I wanted to quote key reviewer feedback to help illustrate this change better. With @gengliangwang's feedback, _modifiedBefore__ and _modifiedAfter_ options were introduced with solid alignment to existing practices. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
