mridulm commented on PR #53488: URL: https://github.com/apache/spark/pull/53488#issuecomment-3698375700
> * This is not for SQL config only. I mentioned this in the `README.md`: `Currently, SQL configs go in sql.textproto. New categories can have their own files.` This is great ! > * As of today, I don't think users can override spark core configs or static sql configs via public APIs. So this "feature" is already there. Users can override spark core configs - both at time of submission, and before session creation (via the `SparkConf` passed into SparkContext). > * Quite some boolean configs define their default values as `Utils.isTesting`. To avoid having to add Scala entries (e.g. the ones in `SQLConf`) for them, `test_default` is added to handle such use cases with the new text file based framework. Sounds good ! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
