Github user zsxwing commented on the issue:
https://github.com/apache/spark/pull/22952
> @zsxwing Btw, how do you think about addressing background move/deletion
(I had thought and
Yeah, this can be done in a separate ticket.
I was playing with `org.apache.hadoop.fs.GlobFilter` to see how to detect
the overlap. But one major issue is before getting the target path, we don't
know whether a path will match [the glob
pattern](https://self-learning-java-tutorial.blogspot.com/2016/01/hadoop-java-globbing.html)
or not.
The worst case, we can check the overlap when parsing the options for a
normal path. For glob path, we can use `GlobFilter/GlobPattern` to check before
doing the rename, in which case we can just use the target path.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
