Github user rdblue commented on the issue:
https://github.com/apache/spark/pull/20645
I like the `ConfigBuilder` approach. That would make this much more useful.
I'll add an implementation like that.
I think append option syntax would be confusing for users and
administrators. We need to make sure it is not easy to overwrite the default
options and we can't expect users to know they need to append, and how to do
it. Administrators could add `++=` options, but then we would be applying these
in the wrong order to get the behavior we're after, which is bad because order
matters in some cases. I like the two-property approach better because it is
simpler and more predictable.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]