Holden Karau created SPARK-44578:
------------------------------------
Summary: Support pushing down UDFs in DSv2
Key: SPARK-44578
URL: https://issues.apache.org/jira/browse/SPARK-44578
Project: Spark
Issue Type: Improvement
Components: SQL
Affects Versions: 3.5.0, 4.0.0
Reporter: Holden Karau
Assignee: Holden Karau
We should consider trying to add support for pushing down UDFS to the storage
engine. While most of the time this might not make sense, some storage engines
expose their own UDFS like bucketing or day transformers, which we would
ideally push down to them.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]