Github user BryanCutler commented on the issue:
https://github.com/apache/spark/pull/21427
I agree with you @HyukjinKwon but we have had lots of discussion here and
are still split, so let's just add the config. There is still the off chance
that someone upgrading from 2.3.0 (without the experimental tag) has one of
these corner cases. I'll try to implement it how @ueshin suggested so that we
have a general way to pass configs to the worker. That way, it won't be a
disruptive change when we decide to remove it in the future.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]