GitHub user maropu opened a pull request:
https://github.com/apache/spark/pull/13372
[SPARK-15585][SQL] Fix NULL handling along with a spark-csv behaivour
## What changes were proposed in this pull request?
This pr fixes the behaviour of `format("csv").option("quote", null)` along
with one of spark-csv.
Also, it explicitly sets default values for CSV options in python.
## How was this patch tested?
Added tests in CSVSuite.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/maropu/spark SPARK-15585
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/13372.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #13372
----
commit 472e756af20254ab13a933bfb0ed5a40f5550c9b
Author: Takeshi YAMAMURO <[email protected]>
Date: 2016-05-27T07:01:28Z
Return u0 if we set null at quote in csv options
commit 12f4f8902906396aaae118bceb8b1bf66c40025a
Author: Takeshi YAMAMURO <[email protected]>
Date: 2016-05-28T05:12:16Z
Explicitly set defalut values for csv options in python
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
