[
https://issues.apache.org/jira/browse/HIVE-26655?focusedWorklogId=853151&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-853151
]
ASF GitHub Bot logged work on HIVE-26655:
-----------------------------------------
Author: ASF GitHub Bot
Created on: 27/Mar/23 11:48
Start Date: 27/Mar/23 11:48
Worklog Time Spent: 10m
Work Description: ayushtkn commented on code in PR #4158:
URL: https://github.com/apache/hive/pull/4158#discussion_r1149193455
##########
ql/src/java/org/apache/hadoop/hive/ql/exec/vector/expressions/aggregates/VectorUDAFBloomFilterMerge.java:
##########
@@ -602,4 +602,11 @@ public void assignRowColumn(VectorizedRowBatch batch, int
batchIndex, int column
Aggregation bfAgg = (Aggregation) agg;
outputColVector.setVal(batchIndex, bfAgg.bfBytes, 0, bfAgg.bfBytes.length);
}
+
+ /**
+ * Let's clone the batch when we're working in parallel, see HIVE-26655.
+ */
+ public boolean batchNeedsClone() {
+ return numThreads > 0;
+ }
Review Comment:
just a quick pass, if thread count is 1, you still need a clone? for
parallel execution it should be more than 1 thread? or some catch?
Issue Time Tracking
-------------------
Worklog Id: (was: 853151)
Time Spent: 0.5h (was: 20m)
> VectorUDAFBloomFilterMerge should take care of safe batch handling when
> working in parallel
> -------------------------------------------------------------------------------------------
>
> Key: HIVE-26655
> URL: https://issues.apache.org/jira/browse/HIVE-26655
> Project: Hive
> Issue Type: Sub-task
> Reporter: Sungwoo Park
> Assignee: László Bodor
> Priority: Major
> Labels: pull-request-available
> Time Spent: 0.5h
> Remaining Estimate: 0h
>
> When tested with 100GB ORC tables, the number of rows returned by query 17 is
> not stable. It returns fewer rows than the correct result (55 rows).
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
