GitHub user HyukjinKwon opened a pull request:
https://github.com/apache/spark/pull/21855
[SPARK-22499][FOLLOWUP][SQL] Reduce input string expressions for Least and
Greatest to reduce time
## What changes were proposed in this pull request?
It's minor and trivial but looks 2000 input is good enough to reproduce and
test in SPARK-22499.
## How was this patch tested?
Manually bring the change and tested.
Locally tested: 1m 29s 134ms -> 3m 21s 288ms
Given the latest successful build took:
```
ArithmeticExpressionSuite:
- SPARK-22499: Least and greatest should not generate codes beyond 64KB (7
minutes, 49 seconds)
```
I expect it's going to save 4ish mins.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/HyukjinKwon/spark minor-fix-suite
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/21855.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #21855
----
commit 0efe041c03b4c6d97dae2d6d7425c05bb6272bc6
Author: hyukjinkwon <gurwls223@...>
Date: 2018-07-24T06:33:31Z
Reduce input string expressions for Least and Greatest to reduce time
----
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
