[
https://issues.apache.org/jira/browse/SPARK-23729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin resolved SPARK-23729.
------------------------------------
Resolution: Fixed
Assignee: Mihaly Toth
Fix Version/s: 2.4.0
2.3.1
> Glob resolution breaks remote naming of files/archives
> ------------------------------------------------------
>
> Key: SPARK-23729
> URL: https://issues.apache.org/jira/browse/SPARK-23729
> Project: Spark
> Issue Type: Bug
> Components: Spark Submit
> Affects Versions: 2.3.0
> Reporter: Mihaly Toth
> Assignee: Mihaly Toth
> Priority: Major
> Labels: regression
> Fix For: 2.3.1, 2.4.0
>
>
> Given one uses {{spark-submit}} with either of the {{\-\-archives}} or the
> {{\-\-files}} parameters, in case the file name actually contains glob
> patterns, the rename part ({{...#nameAs}}) of the filename will eventually be
> ignored.
> Thinking over the resolution cases, if the resolution results in multiple
> files, it does not make sense to send all of them under the same remote name.
> So this should then result in an error.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
