Github user maropu commented on the issue:
https://github.com/apache/spark/pull/19082
I checked `q66` has two warnings on the current
master(83488cc3180ca18f829516f550766efb3095881e);
```
17/10/06 07:32:26 INFO WholeStageCodegenExec: Found too long generated
codes and JIT optimization might not work: the bytecode size (13420) is above
the limit 8000, and the whole-stage codegen was disabled for this plan. To
avoid this, you can raise the limit `spark.sql.codegen.hugeMethodLimit`:
17/10/06 07:37:51 INFO WholeStageCodegenExec: Found too long generated
codes and JIT optimization might not work: the bytecode size (16634) is above
the limit 15000, and the whole-stage codegen was disabled for this plan. To
avoid this, you can raise the limit `spark.sql.codegen.hugeMethodLimit`:
```
So, I run bench with `hugeMethodLimit=8000 or 20000`;
```
OpenJDK 64-Bit Server VM 1.8.0_141-b16 on Linux 4.9.38-16.35.amzn1.x86_64
Intel(R) Xeon(R) CPU E5-2676 v3 @ 2.40GHz
TPCDS Snappy: Best/Avg Time(ms) Rate(M/s)
Per Row(ns) Relative
------------------------------------------------------------------------------------------------
q66 (hugeMethodLimit=8000) 15905 / 15990 0.7
1452.0 1.0X
OpenJDK 64-Bit Server VM 1.8.0_141-b16 on Linux 4.9.38-16.35.amzn1.x86_64
Intel(R) Xeon(R) CPU E5-2676 v3 @ 2.40GHz
TPCDS Snappy: Best/Avg Time(ms) Rate(M/s)
Per Row(ns) Relative
------------------------------------------------------------------------------------------------
q66 (hugeMethodLimit=20000) 7524 / 7638 1.5
686.9 1.0X
```
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
