Github user nandanrao commented on the pull request:
https://github.com/apache/spark/pull/8349#issuecomment-209915765
Am I missing something? I get the same error as @viesti, hitting the if
statement in [line
309](https://github.com/apache/spark/blob/master/core/src/main/scala/org/apache/spark/deploy/SparkSubmit.scala#L309):
```
if (args.isPython && !isYarnCluster)
```
Which comes before any of the logic in this PR, is this "still in the
works?" Would be happy to help get this working if it is. Right now it does not
allow me to submit non-local py-files or python scripts to a Mesos cluster:
```
Error: Only local python files are supported: Parsed arguments:
master mesos://[path-to-my-mesos-dispatcher]
deployMode cluster
executorMemory null
executorCores null
totalExecutorCores null
propertiesFile null
driverMemory null
driverCores null
driverExtraClassPath null
driverExtraLibraryPath null
driverExtraJavaOptions null
supervise false
queue null
numExecutors null
files null
pyFiles
https://s3-eu-west-1.amazonaws.com/path/to/my/py-files/lib.zip, ...[extra JARS]
archives null
mainClass null
primaryResource s3://path/to//__main__.py
name __main__.py
```
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
