Github user holdenk commented on the issue:
https://github.com/apache/spark/pull/13599
So for what its worth I made a quick POC of supporting similar
functionality without requiring any changes to Spark its self (
https://github.com/nteract/coffee_boat ) which should also work in standalone
mode. I'm going to poke at it a bit more and explore if pex might be better
than conda (although given the packages most folks want conda seems better).
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]