Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/21254#discussion_r186322250
--- Diff:
sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/json/JsonSuite.scala
---
@@ -2313,6 +2313,25 @@ class JsonSuite extends QueryTest with
SharedSQLContext with TestJsonData {
}
}
+ test("SPARK-23723: write json in UTF-16/32 with multiline off") {
+ Seq("UTF-16", "UTF-32").foreach { encoding =>
+ withTempPath { path =>
+ val ds = spark.createDataset(Seq(
+ ("a", 1), ("b", 2), ("c", 3))
+ ).repartition(2)
--- End diff --
we don't have to repartition though.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
