[
https://issues.apache.org/jira/browse/SPARK-53718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
shaoqinzhou updated SPARK-53718:
--------------------------------
Component/s: SQL
(was: Optimizer)
> Add a new Optimizer rule to flatten nested MapConcat expressions
> ----------------------------------------------------------------
>
> Key: SPARK-53718
> URL: https://issues.apache.org/jira/browse/SPARK-53718
> Project: Spark
> Issue Type: Improvement
> Components: SQL
> Affects Versions: 4.1.0
> Reporter: shaoqinzhou
> Priority: Major
>
> Add a new Optimizer rule to flatten nested MapConcat expressions in two ways:
> 1. Flattens nested MapConcat expressions into a single MapConcat
> Example:
> {code:java}
> map_concat(map('a', 'a1'), map_concat(map('b', 'b1'), map('c', 'c1'))) →
> map_concat(map('a', 'a1'), map('b', 'b1'), map('c', 'c1')) {code}
> 2. Extracts the child directly when MapConcat has only one child
> Example:
> {code:java}
> map_concat(map('a', 'a1')) → map('a', 'a1') {code}
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
