Uroš Bojanić created SPARK-58745:
------------------------------------
Summary: Document missing JSON and XML data source options
Key: SPARK-58745
URL: https://issues.apache.org/jira/browse/SPARK-58745
Project: Spark
Issue Type: Documentation
Components: Documentation
Affects Versions: 4.3.0
Reporter: Uroš Bojanić
Several read/write options are registered in the JSON and XML data sources but
are absent from the option tables in the documentation.
This adds rows for the JSON options pretty and
writeNonAsciiCharacterAsCodePoint, and the XML options indent, multiLine,
prefersDecimal and preferDate. Each default and description is taken from
source: for example indent defaults to XmlOptions.DEFAULT_INDENT (four spaces),
multiLine defaults to true for XML, and preferDate is disabled when
spark.sql.legacy.timeParserPolicy is set to LEGACY.
The gap was found by diffing the newOption registrations in JSONOptions and
XmlOptions against the documented option names. After this change the JSON
table is complete; the XML table still omits useLegacyXMLParser, a legacy
parser-implementation switch, which is left undocumented on purpose.
Documentation only.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
