Huaxin Gao created SPARK-40946:
----------------------------------
Summary: Introduce a new DataSource V2 interface
SupportsPushDownClusterKeys
Key: SPARK-40946
URL: https://issues.apache.org/jira/browse/SPARK-40946
Project: Spark
Issue Type: Sub-task
Components: SQL
Affects Versions: 3.4.0
Reporter: Huaxin Gao
A mix-in interface for ScanBuilder. Data sources can implement this interface
to push down all the join or aggregate keys to data sources. A return value
true indicates that data source will return input partitions following the
clustering keys. Otherwise, a false return value indicates the data source
doesn't make such a guarantee, even though it may still report a partitioning
that may or may not be compatible with the given clustering keys, and it's
Spark's responsibility to group the input partitions whether it can be applied.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
