Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/21598
All the behavior changes need very careful reviews and discussions.
Whenever we decide to make a behavior change, we should document it in the
migration guide and provide a conf to revert it back to the original behavior.
Before the release, the whole community can review the changes again and decide
whether any change we should revert or adjust. Based on my understanding, the
decision is made case by case. For this specific case, we do not have a very
strong reason to change the default value. Thus, we can keep it unchanged.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
