[
https://issues.apache.org/jira/browse/SPARK-59710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-59710:
----------------------------------
Parent: SPARK-60712
Issue Type: Sub-task (was: Bug)
> Join pushdown of JDBC data source does not handle partitioning well
> -------------------------------------------------------------------
>
> Key: SPARK-59710
> URL: https://issues.apache.org/jira/browse/SPARK-59710
> Project: Spark
> Issue Type: Sub-task
> Components: SQL
> Affects Versions: 4.1.3
> Reporter: Uros Stankovic
> Assignee: Uros Stankovic
> Priority: Minor
> Labels: pull-request-available
> Fix For: 4.4.0
>
>
> When we use JDBC DSv2 join pushdown, I noticed two bugs:
> - When I specify partitioning options, query fails with error "Options query
> and partition_coumn can not be specified together". It is expected that query
> runs successfully even join and partitioning can't be supported that easily.
> - Partial aggregate pushdown optimizer rule can pushdown AVG to SUM/COUNT
> with multiple partitions, in that case, incorrect result is returned in some
> cases.
--
This message was sent by Atlassian Jira
(v10.3.26#10030026)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
