Github user felixcheung commented on the issue:
https://github.com/apache/spark/pull/16596
so what I found earlier was that when java is not there spark-submit would
attempt to launch an empty string, which would not do anything.
the issue is that since we are doing fire-and-wait-to-connect, on the
R-side we don't know that nothing is being run, and we keep waiting until it
times out. I think we need to change to launch and poll for status, so that we
can tell if the command has failed immediately.
but from a preliminary look that seems somewhat challenging to do in R -
`shell` doesn't provide this capability to check on the child process.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
