Github user MaxGekk commented on a diff in the pull request:
https://github.com/apache/spark/pull/21182#discussion_r186257363
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/json/JSONOptions.scala
---
@@ -136,4 +138,6 @@ private[sql] class JSONOptions(
allowBackslashEscapingAnyCharacter)
factory.configure(JsonParser.Feature.ALLOW_UNQUOTED_CONTROL_CHARS,
allowUnquotedControlChars)
}
+
+ val textOptions = ListMap(parameters.toList: _*)
--- End diff --
The test fails on serialization of the `textOptions` value because the
former one refers to `transient` parameters. I add the `@transient` annotation
to `textOptions` (it should be safe because `textOptions` is using on the
driver only and shouldn't be serialized).
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
