Github user dragos commented on the pull request:
https://github.com/apache/spark/pull/8669#issuecomment-165044532
I admit it is very surprising. Here's what I see
Driver page on the Mesos dispatcher (note that `spark.executor.uri` is set,
but also `SPARK_HOME` -- which is wrong, since it's an absolute path on my
machine):
<img width="1080" alt="screen shot 2015-12-16 at 10 22 26"
src="https://cloud.githubusercontent.com/assets/133742/11837079/f76fcf50-a3de-11e5-991b-a91082e2be2e.png";>
And here is the log. Note that the executor is fetched correctly, but the
submit script is calculated relative to SPARK_HOME:
```
I1216 09:18:44.974624 464 fetcher.cpp:369] Fetching URI
'/var/spark/spark-1.6.0-bin-hadoop2.6.tgz'
I1216 09:18:44.974628 464 fetcher.cpp:243] Fetching directly into the
sandbox directory
I1216 09:18:44.974639 464 fetcher.cpp:180] Fetching URI
'/var/spark/spark-1.6.0-bin-hadoop2.6.tgz'
I1216 09:18:44.974652 464 fetcher.cpp:160] Copying resource with
command:cp '/var/spark/spark-1.6.0-bin-hadoop2.6.tgz'
'/tmp/mesos/slaves/ac7d8645-030b-4c99-a47f-2e02379d8c41-S1/frameworks/ac7d8645-030b-4c99-a47f-2e02379d8c41-0002/executors/driver-20151216101839-0001/runs/ab128426-95fa-4a3e-82f6-9c5b4baba816/spark-1.6.0-bin-hadoop2.6.tgz'
I1216 09:18:46.351866 464 fetcher.cpp:76] Extracting with command: tar -C
'/tmp/mesos/slaves/ac7d8645-030b-4c99-a47f-2e02379d8c41-S1/frameworks/ac7d8645-030b-4c99-a47f-2e02379d8c41-0002/executors/driver-20151216101839-0001/runs/ab128426-95fa-4a3e-82f6-9c5b4baba816'
-xf
'/tmp/mesos/slaves/ac7d8645-030b-4c99-a47f-2e02379d8c41-S1/frameworks/ac7d8645-030b-4c99-a47f-2e02379d8c41-0002/executors/driver-20151216101839-0001/runs/ab128426-95fa-4a3e-82f6-9c5b4baba816/spark-1.6.0-bin-hadoop2.6.tgz'
I1216 09:18:48.625231 464 fetcher.cpp:84] Extracted
'/tmp/mesos/slaves/ac7d8645-030b-4c99-a47f-2e02379d8c41-S1/frameworks/ac7d8645-030b-4c99-a47f-2e02379d8c41-0002/executors/driver-20151216101839-0001/runs/ab128426-95fa-4a3e-82f6-9c5b4baba816/spark-1.6.0-bin-hadoop2.6.tgz'
into
'/tmp/mesos/slaves/ac7d8645-030b-4c99-a47f-2e02379d8c41-S1/frameworks/ac7d8645-030b-4c99-a47f-2e02379d8c41-0002/executors/driver-20151216101839-0001/runs/ab128426-95fa-4a3e-82f6-9c5b4baba816'
I1216 09:18:48.625273 464 fetcher.cpp:446] Fetched
'/var/spark/spark-1.6.0-bin-hadoop2.6.tgz' to
'/tmp/mesos/slaves/ac7d8645-030b-4c99-a47f-2e02379d8c41-S1/frameworks/ac7d8645-030b-4c99-a47f-2e02379d8c41-0002/executors/driver-20151216101839-0001/runs/ab128426-95fa-4a3e-82f6-9c5b4baba816/spark-1.6.0-bin-hadoop2.6.tgz'
I1216 09:18:48.666476 539 logging.cpp:172] INFO level logging started!
I1216 09:18:48.667392 539 exec.cpp:134] Version: 0.25.0
I1216 09:18:48.669401 545 exec.cpp:208] Executor registered on slave
ac7d8645-030b-4c99-a47f-2e02379d8c41-S1
bin/spark-submit: line 27:
/Users/dragos/workspace/Spark/dev/rc-tests/spark-1.6.0-bin-hadoop2.6/bin/spark-class:
No such file or directory
```
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
![https://cloud.githubusercontent.com/assets/133742/11837079/f76fcf50-a3de-11e5-991b-a91082e2be2e.png"](https://cloud.githubusercontent.com/assets/133742/11837079/f76fcf50-a3de-11e5-991b-a91082e2be2e.png"){kind=link}