Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/20885#discussion_r176821110
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/json/JSONOptions.scala
---
@@ -85,6 +85,38 @@ private[sql] class JSONOptions(
val multiLine =
parameters.get("multiLine").map(_.toBoolean).getOrElse(false)
+ val charset: Option[String] = Some("UTF-8")
+
+ /**
+ * A sequence of bytes between two consecutive json records. Format of
the option is:
+ * selector (1 char) + delimiter body (any length) | sequence of chars
--- End diff --
I'm afraid of defining our own rule here, is there any standard we can
follow?
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
