Re: How to propagate R_LIBS to sparkr executors

2016-11-17 Thread Felix Cheung
Have you tried spark.executorEnv.R_LIBS? spark.apache.org/docs/latest/configuration.html#runtime-environment _ From: Rodrick Brown <rodr...@orchard-app.com<mailto:rodr...@orchard-app.com>> Sent: Wednesday, November 16, 2016 1:01 PM Subject: How to prop

How to propagate R_LIBS to sparkr executors

2016-11-16 Thread Rodrick Brown
I’m having an issue with a R module not getting picked up on the slave nodes in mesos. I have the following environment value R_LIBS set and for some reason this environment is only set in the driver context and not the executor is their a way to pass environment values down the executor level