pan3793 commented on PR #48822: URL: https://github.com/apache/spark/pull/48822#issuecomment-2483711846
After touching the code, I realized the `options` propagation is inconsistent in `DataFrame`, `DataFrameV2`, and `SQL`, and `SessionConfigSupport` also does not take effect on `SQL` cases (I think this is a bigger issue that should be fixed independently), I updated the code with assertions and add some test cases for DataFrame API. @szehon-ho @cloud-fan please take a look when you have time, thanks in advance. (the CI failures look irrelevant) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
