[
https://issues.apache.org/jira/browse/SPARK-53281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Philo He updated SPARK-53281:
-----------------------------
Description:
In the current version of Spark, the JSON parser is designed to be compatible
with Hive, which means that some behaviors may not adhere strictly to standard
JSON compliance. For instance, SPARK-30330[#SPARK-30330] permits the use of
single quotes in JSON parsing for functions such as {{get_json_object}} and
{{{}json_tuple{}}}. Additionally, there are other instances where the behavior
diverges from standard JSON practices.
To address these inconsistencies, we propose introducing a configuration option
that allows users to choose between legacy behavior and standard compliance.
This approach ensures that existing workflows remain unaffected while providing
the flexibility to adopt standard JSON practices if desired.
> Support standard JSON parsing
> -----------------------------
>
> Key: SPARK-53281
> URL: https://issues.apache.org/jira/browse/SPARK-53281
> Project: Spark
> Issue Type: Improvement
> Components: Spark Core
> Affects Versions: 4.1.0
> Reporter: Philo He
> Priority: Major
>
> In the current version of Spark, the JSON parser is designed to be compatible
> with Hive, which means that some behaviors may not adhere strictly to
> standard JSON compliance. For instance, SPARK-30330[#SPARK-30330] permits the
> use of single quotes in JSON parsing for functions such as
> {{get_json_object}} and {{{}json_tuple{}}}. Additionally, there are other
> instances where the behavior diverges from standard JSON practices.
>
> To address these inconsistencies, we propose introducing a configuration
> option that allows users to choose between legacy behavior and standard
> compliance. This approach ensures that existing workflows remain unaffected
> while providing the flexibility to adopt standard JSON practices if desired.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
