Github user chu11 commented on the pull request:
https://github.com/apache/spark/pull/472#issuecomment-54339335
The use case is to the user to specify an alternate set of configuration
easily when running Spark. In our particular case, users may be
running/launching Spark on different clusters/hardware
at any point in time, so setting SPARK_CONF_DIR to point to the location of
that particular node/hardware's spark-env.sh would be convenient.
Specifying an alternate config file can be done a million ways.
SPARK_CONF_DIR would seem the most familiar, given that most other major Apache
projects have similar environment variables (HADOOP_CONF_DIR, HBASE_CONF_DIR,
etc.).
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
