Github user kiszk commented on the issue:
https://github.com/apache/spark/pull/19082
The whole-stage codegen has two advantages according to [this
paper](http://www.vldb.org/pvldb/vol4/p539-neumann.pdf).
1. enable compiler optimizations among operations (3. in page 2)
2. pass data in a row using a set of scalar values instead of using an
iterator (1. and 2. in page 2)
When method inlining is disabled (I assume each method is compiled), we
will miss advantage 1. We can still enjoy advantage 2 by passing data without
creating an iterator. IMHO, This is better than disabling whole-stage codegen.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
