Holden Karau created SPARK-55211:
------------------------------------
Summary: Create an optimizer rule to choose when to use transpiled
Key: SPARK-55211
URL: https://issues.apache.org/jira/browse/SPARK-55211
Project: Spark
Issue Type: Sub-task
Components: SQL
Affects Versions: 4.3
Reporter: Holden Karau
Extend the optimizer so:
It chooses transpiled expressions when they preserve chaining
It avoids transpilation when it would introduce extra serialization or stage
breaks
It can mix transpiled and native UDFs safely
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]