LuciferYang commented on PR #48466:
URL: https://github.com/apache/spark/pull/48466#issuecomment-2576504614
- before this one : commit f3b2535d8d92c2210501f15c5845dd589414ffe3 with
`numCols=330`
```
OpenJDK 64-Bit Server VM 17.0.13+11-LTS on Linux 6.8.0-1017-azure
AMD EPYC 7763 64-Core Processor
from_json as subExpr in Filter: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
subExprElimination false, codegen: true 2766 3046
284 0.0 27655915.4 1.0X
subExprElimination false, codegen: false 2884 2940
51 0.0 28837016.0 1.0X
subExprElimination true, codegen: true 886 901
25 0.0 8860269.8 3.1X
subExprElimination true, codegen: false 854 857
3 0.0 8539656.4 3.2X
```
- after this one: commit 2a1301133138ba0d5e2d969fc6428153903ffff1 with
`numCols=330`
```
OpenJDK 64-Bit Server VM 17.0.13+11-LTS on Linux 6.8.0-1017-azure
AMD EPYC 7763 64-Core Processor
from_json as subExpr in Filter: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
subExprElimination false, codegen: true 3314 3570
277 0.0 33143936.7 1.0X
subExprElimination false, codegen: false 2823 3027
193 0.0 28234617.4 1.2X
subExprElimination true, codegen: true 3501 3579
68 0.0 35009514.9 0.9X
subExprElimination true, codegen: false 841 865
28 0.0 8409037.4 3.9X
```
It seems that there is a performance regression in the `withFilter` scenario
with `subExprElimination true, codegen: true`, showing `3501, 3579, 68, 0.0,
35009514.9, 0.9X`.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
