HyukjinKwon commented on pull request #35001: URL: https://github.com/apache/spark/pull/35001#issuecomment-1000569949
> I feel this could be a bit confused. Users may thought the value `abc` doesn't take effect for the conf `spark.abc.new`. However, it does. The thing is, it's actually the second set doesn't take effect here rather than the value itself. This actually was already there. The problem here is that users, for example, might pass some source specific options that Spark side does not now. Maybe we can filter out Spark's runtime configuration here though. Let me take a look while I am here. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
