Re: What is a best practice for passing environment variables to Spark workers?

2015-07-10 Thread Dmitry Goldenberg
>> spark-defaults.conf since they're already set in the system init scripts, >> so >> why duplicate. >> >> I suppose one approach would be to namespace all my vars to start with a >> well-known prefix, then cycle through the env in the driver and stuff all >

What is a best practice for passing environment variables to Spark workers?

2015-07-09 Thread dgoldenberg
quot;some-value"); Thanks. -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/What-is-a-best-practice-for-passing-environment-variables-to-Spark-workers-tp23751.html Sent from the Apache Spark User List mailing list archive at Nabble.com. --