mridulm commented on PR #53488:
URL: https://github.com/apache/spark/pull/53488#issuecomment-3686681301
Very promising !
A few high level thoughts:
* Is this specific only to sql ? current formulation appears to assume yes.
If yes:
* Should it be under `sql/config` instead ?
* If no (preferable), handling for core, common/* modules would be
something to consider.
* cluster vs session could get impacted by this as well (how to
specify/differentiate from common/core configs).
* Since we are relooking at configs - one 'feature' to consider would be
enforcement of cluster defaults, which users cannot override (like security
configs, event file location, etc).
* It is not clear what the usecase for `test_default` is.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]