[
https://issues.apache.org/jira/browse/SPARK-37450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17448878#comment-17448878
]
Apache Spark commented on SPARK-37450:
--
User 'viirya' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-37450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17448824#comment-17448824
]
L. C. Hsieh commented on SPARK-37450:
-
Okay, it sounds like a possible optimization case, although I
[
https://issues.apache.org/jira/browse/SPARK-37450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17448412#comment-17448412
]
Jiri Humpolicek commented on SPARK-37450:
-
thanks for answer. Maybe I don't know internals of
[
https://issues.apache.org/jira/browse/SPARK-37450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17448328#comment-17448328
]
L. C. Hsieh commented on SPARK-37450:
-
Hmm, this is the optimized plan.
{code}
== Optimized Logical
[
https://issues.apache.org/jira/browse/SPARK-37450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17448326#comment-17448326
]
L. C. Hsieh commented on SPARK-37450:
-
Thanks [~hyukjin.kwon]. I will take a look.
> Spark SQL
[
https://issues.apache.org/jira/browse/SPARK-37450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17448320#comment-17448320
]
Hyukjin Kwon commented on SPARK-37450:
--
cc [~viirya] FYI
> Spark SQL reads unnecessary nested
[
https://issues.apache.org/jira/browse/SPARK-37450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17448001#comment-17448001
]
Jiri Humpolicek commented on SPARK-37450:
-
same situation with {{size}} function:
{code:scala}
