GitHub user wangyum reopened a pull request:
https://github.com/apache/spark/pull/22636
[SPARK-25629][TEST] Reduce ParquetFilterSuite: filter pushdown test time
costs in Jenkins
## What changes were proposed in this pull request?
Only test these 4 cases is enough:
https://github.com/apache/spark/blob/be2238fb502b0f49a8a1baa6da9bc3e99540b40e/sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetWriteSupport.scala#L269-L279
## How was this patch tested?
Manual tests on my local machine.
before:
```
- filter pushdown - decimal (13 seconds, 683 milliseconds)
```
after:
```
- filter pushdown - decimal (9 seconds, 713 milliseconds)
```
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/wangyum/spark SPARK-25629
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/22636.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #22636
----
commit e40d79ce33941800408a0697e433ea4d0b20b3b5
Author: Yuming Wang <yumwang@...>
Date: 2018-10-05T02:41:28Z
Reduce iteration times
----
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
