Github user gaborgsomogyi commented on the issue:
https://github.com/apache/spark/pull/22952
@HeartSaVioR
I've taken a look at the possibilities:
*
[GlobExpander](https://github.com/apache/hadoop/blob/a55d6bba71c81c1c4e9d8cd11f55c78f10a548b0/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/GlobExpander.java#L63)
is private
* `globStatus` recursively is not an option because of it's poor performance
* `globStatus` with limited scope can be an option but there are cases
where it might take some execution time
* Print warnings and not moving files is an option which seems feasible
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]