GitHub user MaxGekk opened a pull request:
https://github.com/apache/spark/pull/22626
[SPARK-25638][SQL] Adding new function - to_csv()
## What changes were proposed in this pull request?
New functions takes a struct and converts it to a CSV strings using passed
CSV options. It accepts the same CSV options as CSV data source does.
## How was this patch tested?
Added `CsvExpressionsSuite`, `CsvFunctionsSuite` as well as R, Python and
SQL tests similar to tests for `to_json()`
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/MaxGekk/spark-1 to_csv
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/22626.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #22626
----
commit 357140bccbc827ed9057c8f315901c8f8aad2b89
Author: Maxim Gekk <maxim.gekk@...>
Date: 2018-09-30T13:50:18Z
First prototype
commit 19f58a403b248f936e30091fedd5eac17eb24f25
Author: Maxim Gekk <maxim.gekk@...>
Date: 2018-09-30T15:03:04Z
CSV Expressions tests
commit 209a95119186a55d37f2c338129682c22e1e2518
Author: Maxim Gekk <maxim.gekk@...>
Date: 2018-10-03T19:08:19Z
Merge remote-tracking branch 'origin/master' into to_csv
commit f7f82e9aa4653fd722447640a4642edff5e11acc
Author: Maxim Gekk <maxim.gekk@...>
Date: 2018-10-03T20:45:41Z
Adding to_csv and tests
commit 7928dea941eab9e08d31079e2fea5b338cd5c6c4
Author: Maxim Gekk <maxim.gekk@...>
Date: 2018-10-03T21:05:15Z
SQL tests
commit 124dcbc31f5500d0dd6286439b5d5a846a24aea3
Author: Maxim Gekk <maxim.gekk@...>
Date: 2018-10-03T21:29:36Z
Adding to_csv to PySpark
commit 73b4a22050a03d96db920b12d8c60ceec2f97d63
Author: Maxim Gekk <maxim.gekk@...>
Date: 2018-10-04T09:22:24Z
Support R
commit 91512d790123a6d32a8dc8a3961349ba6a3e01df
Author: Maxim Gekk <maxim.gekk@...>
Date: 2018-10-04T09:38:38Z
2.5 -> 3.0
----
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
