Hi all,
Can spark set worker node environment like linux,eg:
--conf
spark.yarn.appMasterEnv.PYTHONPATH=./feature-server:$PYTHONPATH ?
It is not working like linux shell.
I just want to add a path to PYTHONPATH on worker node rather than cover it.
Thanks for any answer!
