HyukjinKwon commented on issue #23556: [SPARK-26626][SQL] Maximum size for repeatedly substituted aliases in SQL expressions URL: https://github.com/apache/spark/pull/23556#issuecomment-475163854 If there is not anything I missed, -1 from me. Because: 1. We already have a general mechanism to disable a specific rule 2. It does some automatic stuff but still requires rough estimation to set the value - sounds virtually no diff if we disable the rule based upon a rough estimation for the job 3. If the issue is related with driver side's memory, the value has to have some logic related with it. Looks that's missing.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
