Github user steveloughran commented on the issue:
https://github.com/apache/spark/pull/19487
Looking a bit more at this. I see it handles """ as well as empty, and also
other forms of invalid URI which Path can't handle today ("multiple colons
except with file:// on windows, etc). And as long as you don't call
`absPathStagingDir` you don't get an exception there.
do you actually want the code to downgrade if an invalid URI is passed in,
that is: only skip if the path is empty/null, but not for other things like a
path of "::::::::::" ? As there you may want to reject it. In which case you'd
change the `hasValidPath` query to just looking at the string, and reinstate
the test for the path with an invalid non-empty URI
BTW, "test:" is possibly a valid path for "the home directory in the
schema 'test'.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
