[
https://issues.apache.org/jira/browse/SPARK-37019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Adam Binford updated SPARK-37019:
---------------------------------
Description:
Currently all of the higher order functions use CodegenFallback. We can improve
the performance of these by adding proper codegen support, so the function as
well as all children can be codegen'd, and it can participate in
WholeStageCodegen.
This ticket is for adding support to array-based higher-order functions.
was:
Currently all of the higher order functions use CodegenFallback. We can improve
the performance of these by adding proper codegen support, so the function as
well as all children can be codegen'd, and it can participate in
WholeStageCodegen.
This ticket is for adding support to ArrayTransform as the first step.
Summary: Add Codegen support to array higher-order-functions (was: Add
Codegen support to ArrayTransform)
> Add Codegen support to array higher-order-functions
> ---------------------------------------------------
>
> Key: SPARK-37019
> URL: https://issues.apache.org/jira/browse/SPARK-37019
> Project: Spark
> Issue Type: Improvement
> Components: SQL
> Affects Versions: 3.2.0
> Reporter: Adam Binford
> Priority: Major
>
> Currently all of the higher order functions use CodegenFallback. We can
> improve the performance of these by adding proper codegen support, so the
> function as well as all children can be codegen'd, and it can participate in
> WholeStageCodegen.
> This ticket is for adding support to array-based higher-order functions.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
