GitHub user liancheng opened a pull request:
https://github.com/apache/spark/pull/7441
[SPARK-9095] [SQL] [WIP] Removes the old Parquet support
(This PR is still a WiP and contains changes made in #7396. It should be
merged after #7396.)
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/liancheng/spark spark-9095
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/7441.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #7441
----
commit 32e5f0d78e2e780fb2ac2205170e019cc08e5eda
Author: Cheng Lian <[email protected]>
Date: 2015-07-01T23:32:44Z
Moves schema merging to executor side
Removes some dead code
Parallelizes input paths listing
commit b1646aa87ec41c381c87023ec50ff22c1ec8998c
Author: Cheng Lian <[email protected]>
Date: 2015-07-14T15:29:50Z
Should allow empty input paths
commit 3c580f16f7356a05588df3f98867ee2101428b18
Author: Cheng Lian <[email protected]>
Date: 2015-07-14T23:02:01Z
Fixes test failure caused by making "mergeSchema" default to "false"
commit ff32cd0ebd58e471b6f5111aee4f1847d06f36ba
Author: Cheng Lian <[email protected]>
Date: 2015-07-15T04:17:25Z
Excludes directories while listing leaf files
commit 5598efc9707657fb31da71b1999d07164e26e218
Author: Cheng Lian <[email protected]>
Date: 2015-07-16T10:39:27Z
Uses ParquetInputFormat[InternalRow] instead of ParquetInputFormat[Row]
commit 978c604d0279f1454c939a3b66971f617136d844
Author: Cheng Lian <[email protected]>
Date: 2015-07-16T10:11:43Z
Removes old Parquet support
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
