GitHub user liutang123 opened a pull request:
https://github.com/apache/spark/pull/19464
Spark 22233
## What changes were proposed in this pull request?
add spark.hadoop.filterOutEmptySplit confituration to allow user to filter
out empty split in HadoopRDD.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/liutang123/spark SPARK-22233
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/19464.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #19464
----
commit 2317bfdf18fc1a7b21cd43e0ec12f5e957fb1895
Author: liutang123 <[email protected]>
Date: 2017-06-21T04:27:42Z
Merge pull request #1 from apache/master
20170521 pull request
commit e3f993959fabdb80b966a42bf40d1cb5c6b44d95
Author: liulijia <[email protected]>
Date: 2017-09-28T06:12:04Z
Merge branch 'master' of https://github.com/apache/spark
commit 8f57d43b6bf127fc67e3e391d851efae3a859206
Author: liulijia <[email protected]>
Date: 2017-10-10T02:16:18Z
Merge branch 'master' of https://github.com/apache/spark
commit 39999610f78837f4a5623f6d47b9feab1e565ed6
Author: liulijia <[email protected]>
Date: 2017-10-10T10:19:29Z
allow user to filter empty split in HadoopRDD
----
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
