GitHub user mgaido91 opened a pull request:
https://github.com/apache/spark/pull/19860
[SPARK-22669][SQL] Avoid unnecessary function calls in code generation
## What changes were proposed in this pull request?
In many parts of the codebase for code generation, we are splitting the
code to avoid exceptions due to the 64KB method size limit. This is generating
a lot of methods which are called every time, even though sometime this is not
needed. As pointed out here:
https://github.com/apache/spark/pull/19752#discussion_r153081547, this is a not
negligible overhead which can be avoided.
The PR applies the same approach used in #19752 also to the other places
where this was feasible.
## How was this patch tested?
existing UTs.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/mgaido91/spark SPARK-22669
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/19860.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #19860
----
commit ce74fb8baff13332bed8c64db6c2a49be815f81f
Author: Marco Gaido <[email protected]>
Date: 2017-12-01T12:55:58Z
[SPARK-22669][SQL] Avoid unnecessary function calls in code generation
----
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
