Maxim Gekk created SPARK-25447:
----------------------------------
Summary: Support JSON options by schema_of_json
Key: SPARK-25447
URL: https://issues.apache.org/jira/browse/SPARK-25447
Project: Spark
Issue Type: Improvement
Components: SQL
Affects Versions: 2.4.0
Reporter: Maxim Gekk
The function schema_of_json doesn't accept any options currently but the
options can impact on schema inferring. Need to support the same options that
from_json() can use on schema inferring. Here is examples of options that could
impact on schema inferring:
* primitivesAsString
* prefersDecimal
* allowComments
* allowUnquotedFieldNames
* allowSingleQuotes
* allowNumericLeadingZeros
* allowNonNumericNumbers
* allowBackslashEscapingAnyCharacter
* allowUnquotedControlChars
Below is possible signature:
{code:scala}
def schema_of_json(e: Column, options: java.util.Map[String, String]): Column
{code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
