Ngone51 commented on pull request #29559: URL: https://github.com/apache/spark/pull/29559#issuecomment-682340522
@c21 @maropu Thank you for your comments. `spark.sql.adaptive.optimizer.excludedRule` doesn't have a real use case yet, but I think it's quite intuitive to follow the normal optimizer given the same reason(more flexible for users). I also think it can be very useful for developers to write certain tests in AQE. For example, If they want to avoid applying the rule `DemoteBroadcastHashJoin`. Previously, they have to tweak the size of the test data and the partition num, which can be troublesome. With this configuration, they can just exclude the rule easily. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
