[
https://issues.apache.org/jira/browse/SPARK-34857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tim Armstrong updated SPARK-34857:
----------------------------------
Environment: (was: I see this in an explain plan
{noformat}
(12) Filter
Input [3]: [c1#2410L, c2#2419, c3#2422]
Condition : AtLeastNNulls(n, c1#2410L)
I expect it to be AtLeastNNonNulls and n to have the actual value.
{noformat}
Proposed fix is to change
https://github.com/databricks/runtime/blob/09ad623c458c40cbaa0dbb4b9f600d96531d35f5/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/nullExpressions.scala#L384
to
{noformat}
override def toString: String = s"AtLeastNNonNulls(${n},
${children.mkString(",")})"
{noformat}
Or maybe it's OK to remove and use a default implementation?)
> AtLeastNNonNulls does not show up correctly in explain
> ------------------------------------------------------
>
> Key: SPARK-34857
> URL: https://issues.apache.org/jira/browse/SPARK-34857
> Project: Spark
> Issue Type: Bug
> Components: SQL
> Affects Versions: 3.1.1
> Reporter: Tim Armstrong
> Priority: Major
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
