[
https://issues.apache.org/jira/browse/SPARK-46707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-46707:
-----------------------------------
Labels: pull-request-available (was: )
> Introduce throwable field to mark expressions that may throw a runtime
> exception
> --------------------------------------------------------------------------------
>
> Key: SPARK-46707
> URL: https://issues.apache.org/jira/browse/SPARK-46707
> Project: Spark
> Issue Type: Improvement
> Components: SQL
> Affects Versions: 3.5.0
> Reporter: Kelvin Jiang
> Priority: Major
> Labels: pull-request-available
>
> For predicate pushdown, currently it is possible that we push down a filter
> that ends up being evaluated on more rows than before it was pushed down
> (e.g. if we push the filter through a selective join). In this case, it is
> possible that we now evaluate the filter on a row that will cause a runtime
> error to be thrown, when prior to pushing this would not have happened.
> If we mark certain expressions as throwable, we can avoid pushing these
> through joins, filters, and aggregations to avoid this.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
