GitHub user dilipbiswal opened a pull request:
https://github.com/apache/spark/pull/9830
[SPARK-11544][SQL] sqlContext doesn't use PathFilter
Apply the user supplied pathfilter while retrieving the files from fs.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/dilipbiswal/spark spark-11544
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/9830.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #9830
----
commit e2aa8ba30dae54761e0dd0870389a2604cf35efb
Author: Dilip Biswal <[email protected]>
Date: 2015-11-08T22:34:08Z
[SPARK-11544] sqlContext doesn't use PathFilter
commit fba713a1520e0f44249184c891527e89553f0a65
Author: Dilip Biswal <[email protected]>
Date: 2015-11-12T07:58:23Z
code review comments
commit 85d4e3dee1a6c525faf5e5702c051bb02ed41898
Author: Dilip Biswal <[email protected]>
Date: 2015-11-16T06:06:48Z
Code review comments from Yin
commit e69c5382eca39c0ef9c912268f10f160f41dca52
Author: Dilip Biswal <[email protected]>
Date: 2015-11-16T06:44:09Z
Fix test failure
commit 144cdb02224e986e8f0e13e8c0a6ce09140335cf
Author: Dilip Biswal <[email protected]>
Date: 2015-11-16T19:39:18Z
Code review comments from Lian
commit f6df5c8a333da1ad8029c6b018dc52db4c2c488a
Author: Dilip Biswal <[email protected]>
Date: 2015-11-19T03:28:49Z
Fix test failures against older version of hadoop
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
