Jing Zhan created SPARK-60765:
---------------------------------
Summary: SPIP: Extend DSv2 push-down with join, set operation, and
window function support
Key: SPARK-60765
URL: https://issues.apache.org/jira/browse/SPARK-60765
Project: Spark
Issue Type: Epic
Components: SQL
Affects Versions: 4.4.0
Reporter: Jing Zhan
SPIP document:
https://docs.google.com/document/d/1ah8u-1vxPvgqpjw0qzRNXz0Oo-X8tEzlK9ngmg7EPXU/edit
Extends DSv2 push-down past the single-table operators, building on SPARK-52187.
A source with its own engine can take joins, set operations, and window
functions
and return only the result rows. Sources can decline any push, and Spark falls
back to local execution.
--
This message was sent by Atlassian Jira
(v10.3.26#10030026)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
