GitHub user misutoth opened a pull request:
https://github.com/apache/spark/pull/20853
[SPARK-23729][SS] Glob resolution is done without the fragment part which
is meant to be the remote name
## What changes were proposed in this pull request?
Firstly, glob resolution will not result in swallowing the remote name part
(that is preceded by the `#` sign) in case of `--files` or `--archives` options
Moreover in the special case of multiple resolutions when the remote naming
does not make sense and error is returned.
## How was this patch tested?
Enhanced current test and wrote additional test for the error case
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/misutoth/spark glob-with-remote-name
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/20853.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #20853
----
commit 50b5ad1289fabffe4f661d0b44fcc9ef3ecd2367
Author: Mihaly Toth <misutoth@...>
Date: 2018-03-18T06:04:15Z
[SPARK-23729][SS] Glob resolution is done without the fragment part which
is meant to be the remote name
In case glob resolution results multiple items for a file with a remote
name, an error is displayed.
----
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
