GitHub user HyukjinKwon opened a pull request:
https://github.com/apache/spark/pull/10858
[SPARK-12872][SQL] Support to specify the option for compression codec for
JSON datasource
https://issues.apache.org/jira/browse/SPARK-12872
This PR makes the JSON datasource can compress output by option instead of
manually setting Hadoop configurations.
For reflecting codec by names, it is similar with
https://github.com/apache/spark/pull/10805.
As `CSVCompressionCodecs` can be shared with other datasources, it became a
separate class to share as `CompressionCodecs`.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/HyukjinKwon/spark SPARK-12872
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/10858.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #10858
----
commit 5bf407f34ccc634c25d675fca2174cae38a6cd38
Author: hyukjinkwon <[email protected]>
Date: 2016-01-21T01:25:22Z
Support to specify the option for compression codec for JSON datasource
commit 5022ccd2d6ceb3ba18ad397df5debf1ae4865a0d
Author: hyukjinkwon <[email protected]>
Date: 2016-01-21T01:26:51Z
Remove newlines
commit fbeee5673a37795a9b2387b069c0663485d0a252
Author: hyukjinkwon <[email protected]>
Date: 2016-01-21T01:33:27Z
Update imports
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
