Github user zjffdu commented on the pull request:
https://github.com/apache/spark/pull/11211#issuecomment-184526617
PYTHONHASHSEED is set in script spark-submit no matter what version of
python. And it would only be set in executor when python version is greater
than 3.3. PYTHONHASHSEED is introduced in python 3.2.3
(https://docs.python.org/3.3/using/cmdline.html). I am not sure the purpose of
disable random hash, just feel that we can set PYTHONHASHSEED as 0 in all the
cases since it looks like there's no case we want to enable the random of hash.
And it's also fine to set it in python 2, because it is only introduced after
3.2.3
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
