Github user icexelloss commented on the issue: https://github.com/apache/spark/pull/21427 @HyukjinKwon I agree with you 99% people will mostly certainly not use the config. I think @gatorsmile 's concern is that in the rare case that some people are actually depending on the existing behavior, they at least have an easy way to fallback. I think this is the similar situation as: https://github.com/apache/spark/blob/master/sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala#L1156 Going forward we should probably remove all these configuration at some point (maybe when pandas_udf and toPandas are out of experimental?), @gatorsmile WDYT?
--- --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org