Github user dragos commented on the pull request:
https://github.com/apache/spark/pull/3861#issuecomment-78400835
I'd like to take a shot at making the external shuffle service a "daemon".
Just to make sure I understand the requirements:
- the shuffle service is launched manually on cluster machines
- it does not care about `spark.shuffle.service.enabled`, if it's started
-- it just starts
- it should not depend on Spark or Scala -- this is the part I'd like to
get confirmation. If that's the case, it means we can't use helper scripts like
`spark-submit` or `spark-class` that would simplify loading configuration files
/cc @tnachen
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
