[ 
https://issues.apache.org/jira/browse/HIVE-21385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16785855#comment-16785855
 ] 

Jesus Camacho Rodriguez commented on HIVE-21385:
------------------------------------------------

I would say it depends. For instance, Aggregate may not increase data size, but 
it may not reduce it much, and we would prevent reading in parallel using JDBC. 
The advantage of keeping those operators in the Hive plan is that we can read 
in parallel and compute aggregation/sort/union using Hive parallel operators 
too.
For the time being, I believe disabling pushdown completely (already there) and 
disabling operators that may prevent reading in parallel gives the user enough 
flexibility.

> Allow disabling pushdown of non-splittable computation to JDBC sources
> ----------------------------------------------------------------------
>
>                 Key: HIVE-21385
>                 URL: https://issues.apache.org/jira/browse/HIVE-21385
>             Project: Hive
>          Issue Type: Improvement
>          Components: CBO, StorageHandler
>            Reporter: Jesus Camacho Rodriguez
>            Assignee: Jesus Camacho Rodriguez
>            Priority: Major
>         Attachments: HIVE-21385.01.patch, HIVE-21385.patch
>
>
> Until pushdown is cost-based decision, we will be able to enable / disable 
> pushdown of operators that prevent reading results from the JDBC connection 
> in parallel.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to