srielau commented on code in PR #59167:
URL: https://github.com/apache/spark/pull/59167#discussion_r4169973562
##########
sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala:
##########
@@ -6801,10 +6801,10 @@ object SQLConf {
val MAP_KEY_DEDUP_POLICY = buildConf("spark.sql.mapKeyDedupPolicy")
.doc("The policy to deduplicate map keys in built-in functions: CreateMap,
MapFromArrays, " +
"MapFromEntries, StringToMap, MapConcat and TransformKeys. The policy
also applies in " +
- "schema-driven XML parsing, including from_xml and the XML data source,
when CHAR/VARCHAR " +
- "keys normalize to the same value. " +
+ "schema-driven JSON and XML parsing (from_json, from_xml, and the JSON
and XML data " +
Review Comment:
Addressing the summary nit: this description now covers schema-driven JSON
and XML (`from_json`, `from_xml`, and both data sources), and the exact-repeat
last-wins carve-out names raw JSON or XML keys.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
