GitHub user HyukjinKwon opened a pull request:
https://github.com/apache/spark/pull/10805
[SPARK-12871][SQL] Support to specify the option for compression codec.
https://issues.apache.org/jira/browse/SPARK-12871
This PR added an option to support to specify compression codec.
This adds the option `codec` as an alias `compression` as filed in
[SPARK-12668 ](https://issues.apache.org/jira/browse/SPARK-12668).
Note that I did not add configurations for Hadoop 1.x as this `CsvRelation`
is using Hadoop 2.x API.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/HyukjinKwon/spark SPARK-12420
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/10805.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #10805
----
commit 06774ad552f8cc39a437a1caa1ef2aceb174b0de
Author: hyukjinkwon <[email protected]>
Date: 2016-01-18T09:53:35Z
Support for compress option
commit 5e1611d74f3ccc33705c3aa134f41382e2150508
Author: hyukjinkwon <[email protected]>
Date: 2016-01-18T10:26:01Z
Correct Scala style and add an alias for codec as compression.
commit d154f025ccfb46c809598e1d688754e1e9603f0e
Author: hyukjinkwon <[email protected]>
Date: 2016-01-18T10:29:31Z
Move back some codes changed unintentionally.
commit 5b57fc246b11f90f082104dc04e53f194123ab35
Author: hyukjinkwon <[email protected]>
Date: 2016-01-18T10:33:46Z
Remove Hadoop 1.x configurations
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
