Github user fhoering commented on the issue:
https://github.com/apache/spark/pull/22422
It turns out all this can be tailored by tuning the existing environment
variables. It is enough to generate the pex file with a generic entry point
that does the redirection to the custom module and then even the existing code
work: `Arrays.asList(pythonExec, "-m", workerModule)`
Will close this PR.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
