[
https://issues.apache.org/jira/browse/HIVE-20381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Matt McCline reassigned HIVE-20381:
-----------------------------------
Assignee: (was: Matt McCline)
> Vectorization: Reduce dedup of GroupBy + PTF turns off vectorization
> --------------------------------------------------------------------
>
> Key: HIVE-20381
> URL: https://issues.apache.org/jira/browse/HIVE-20381
> Project: Hive
> Issue Type: Bug
> Components: Vectorization
> Affects Versions: 3.1.0, 4.0.0
> Reporter: Gopal V
> Priority: Major
>
> One of the PTF Reducers in Query51 is not vectorized because there's a reduce
> deduplication which combines a group-by and a windowing shuffle.
> {code}
> | Reducer 8 |
> | Execution mode: llap |
> | Reduce Vectorization: |
> | enabled: true |
> | enableConditionsMet:
> hive.vectorized.execution.reduce.enabled IS true, hive.execution.engine tez
> IN [tez, spark] IS true |
> | notVectorizedReason: PTF operator: Only PTF directly under
> reduce-shuffle is supported |
> | vectorized: false
> {code}
> It vectorizes all PTF vertices (after HIVE-20367), with {{ set
> hive.optimize.reducededuplication=false;}}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
