Github user viirya commented on the issue:
https://github.com/apache/spark/pull/19082
> The regression caused by spark.sql.codegen.hugeMethodLimit shows the
potential regression caused by horizontal cuts, although
spark.sql.codegen.hugeMethodLimit does nothing.
`hugeMethodLimit` just affects if wholestage codegen is enabled. The
regression is possibly caused by we completely disable wholestage codegen when
detecting maybe one huge method. The regression of disabled wholestage codegen
is larger than the affect of huge method.
I didn't know how you link it to so-called "horizontal cuts" or split
generated code.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
