gianm commented on issue #18040:
URL: https://github.com/apache/druid/issues/18040#issuecomment-2923767866
The deepest cause of the "Index 180 out of bounds for length 129" error is
this, which I think can only happen if the `unionMap` is corrupted somehow,
which I think can only happen if a `SketchBufferAggregator` is being used by
two threads at once. That would be a violation of the contract of
`BufferAggregator`, which is not thread safe.
@TessaIO if you disable parallel combining (`numParallelCombineThreads: 1`)
do you still see this problem? I wonder if it is some issue with that feature.
I think `1` (i.e. no parallel combining) is the default.
```
Caused by: java.lang.ArrayIndexOutOfBoundsException: Index 180 out of bounds
for length 129
at
it.unimi.dsi.fastutil.ints.Int2ObjectOpenHashMap.get(Int2ObjectOpenHashMap.java:284)
~[fastutil-core-8.5.4.jar:?]
at
org.apache.druid.query.aggregation.datasketches.theta.SketchBufferAggregatorHelper.get(SketchBufferAggregatorHelper.java:66)
~[?:?]
at
org.apache.druid.query.aggregation.datasketches.theta.SketchBufferAggregator.get(SketchBufferAggregator.java:64)
~[?:?]
at
org.apache.druid.query.groupby.epinephelinae.StreamingMergeSortedGrouper$1.next(StreamingMergeSortedGrouper.java:438)
~[druid-processing-32.0.0.jar:32.0.0]
at
org.apache.druid.query.groupby.epinephelinae.StreamingMergeSortedGrouper$1.next(StreamingMergeSortedGrouper.java:387)
~[druid-processing-32.0.0.jar:32.0.0]
at
org.apache.druid.java.util.common.CloseableIterators$1.next(CloseableIterators.java:78)
~[druid-processing-32.0.0.jar:32.0.0]
at
org.apache.druid.query.groupby.epinephelinae.CloseableGrouperIterator.next(CloseableGrouperIterator.java:53)
~[druid-processing-32.0.0.jar:32.0.0]
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
