Github user gaborgsomogyi commented on the issue:
https://github.com/apache/spark/pull/22952
@HeartSaVioR It was tested with S3 and the trick is to have HUGE amount of
files. Listing files is pathologically bad as @steveloughran stated, glob is
even worse.--- --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
