FrankChen021 commented on issue #10799:
URL: https://github.com/apache/druid/issues/10799#issuecomment-842054643
This problem can be reproduced very easily by executing query given in the
doc as below
```
{
"queryType": "movingAverage",
"dataSource": "wikipedia",
"granularity": {
"type": "period",
"period": "PT30M"
},
"intervals": [
"2015-09-12T00:00:00Z/2015-09-13T00:00:00Z"
],
"aggregations": [
{
"name": "delta30Min",
"fieldName": "delta",
"type": "longSum"
}
],
"averagers": [
{
"name": "trailing30MinChanges",
"fieldName": "delta30Min",
"type": "longMean",
"buckets": 7
}
]
}
```
After execution, HTTP response shows
```
{
"error": "Resource limit exceeded",
"errorMessage": "url[http://localhost:8083/druid/v2/] timed out or max
bytes limit reached.",
"errorClass": "org.apache.druid.query.ResourceLimitExceededException",
"host": "localhost:8083"
}
```
And in the broker.log, there're exception messages showing
```
java.lang.ClassCastException: org.apache.druid.java.util.common.NonnullPair
cannot be cast to java.util.concurrent.ConcurrentHashMap
at
org.apache.druid.query.context.ResponseContext$Key.lambda$static$3(ResponseContext.java:133)
~[druid-processing-0.19.0.jar:0.19.0]
at java.util.HashMap.merge(HashMap.java:1254) ~[?:1.8.0_252]
at
org.apache.druid.query.context.ResponseContext.add(ResponseContext.java:335)
~[druid-processing-0.19.0.jar:0.19.0]
at
org.apache.druid.client.DirectDruidClient$1.handleResponse(DirectDruidClient.java:247)
~[druid-server-0.19.0.jar:0.19.0]
at
org.apache.druid.java.util.http.client.NettyHttpClient$1.messageReceived(NettyHttpClient.java:224)
[druid-core-0.19.0.jar:0.19.0]
at
org.jboss.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70)
[netty-3.10.6.Final.jar:?]
at
org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564)
[netty-3.10.6.Final.jar:?]
at
org.jboss.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:791)
[netty-3.10.6.Final.jar:?]
at
org.jboss.netty.handler.timeout.ReadTimeoutHandler.messageReceived(ReadTimeoutHandler.java:184)
[netty-3.10.6.Final.jar:?]
at
org.jboss.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70)
[netty-3.10.6.Final.jar:?]
at
org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564)
[netty-3.10.6.Final.jar:?]
at
org.jboss.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:791)
[netty-3.10.6.Final.jar:?]
at
org.jboss.netty.handler.codec.http.HttpContentDecoder.messageReceived(HttpContentDecoder.java:108)
[netty-3.10.6.Final.jar:?]
at
org.jboss.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70)
[netty-3.10.6.Final.jar:?]
at
org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564)
[netty-3.10.6.Final.jar:?]
at
org.jboss.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:791)
[netty-3.10.6.Final.jar:?]
at
org.jboss.netty.channel.Channels.fireMessageReceived(Channels.java:296)
[netty-3.10.6.Final.jar:?]
at
org.jboss.netty.handler.codec.frame.FrameDecoder.unfoldAndFireMessageReceived(FrameDecoder.java:459)
[netty-3.10.6.Final.jar:?]
at
org.jboss.netty.handler.codec.replay.ReplayingDecoder.callDecode(ReplayingDecoder.java:536)
[netty-3.10.6.Final.jar:?]
at
org.jboss.netty.handler.codec.replay.ReplayingDecoder.messageReceived(ReplayingDecoder.java:435)
[netty-3.10.6.Final.jar:?]
at
org.jboss.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70)
[netty-3.10.6.Final.jar:?]
at
org.jboss.netty.handler.codec.http.HttpClientCodec.handleUpstream(HttpClientCodec.java:92)
[netty-3.10.6.Final.jar:?]
at
org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564)
[netty-3.10.6.Final.jar:?]
at
org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:559)
[netty-3.10.6.Final.jar:?]
at
org.jboss.netty.channel.Channels.fireMessageReceived(Channels.java:268)
[netty-3.10.6.Final.jar:?]
at
org.jboss.netty.channel.Channels.fireMessageReceived(Channels.java:255)
[netty-3.10.6.Final.jar:?]
at
org.jboss.netty.channel.socket.nio.NioWorker.read(NioWorker.java:88)
[netty-3.10.6.Final.jar:?]
at
org.jboss.netty.channel.socket.nio.AbstractNioWorker.process(AbstractNioWorker.java:108)
[netty-3.10.6.Final.jar:?]
at
org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:337)
[netty-3.10.6.Final.jar:?]
at
org.jboss.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:89)
[netty-3.10.6.Final.jar:?]
at
org.jboss.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178)
[netty-3.10.6.Final.jar:?]
at
org.jboss.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)
[netty-3.10.6.Final.jar:?]
at
org.jboss.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42)
[netty-3.10.6.Final.jar:?]
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
[?:1.8.0_252]
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[?:1.8.0_252]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_252]
2021-05-17T06:49:34,777 WARN [HttpClient-Netty-Worker-5]
org.apache.druid.java.util.http.client.pool.ResourcePool - Resource at
key[http://localhost:8083] was returned multiple times?
2021-05-17T06:49:34,776 WARN [ForkJoinPool-1-worker-5]
org.apache.druid.client.JsonParserIterator - Query
[ce9e10ec-6da8-479e-879c-5eb4c094408c] to host [localhost:8083] interrupted
org.apache.druid.query.ResourceLimitExceededException:
url[http://localhost:8083/druid/v2/] timed out or max bytes limit reached.
at
org.apache.druid.client.JsonParserIterator.init(JsonParserIterator.java:153)
[druid-server-0.19.0.jar:0.19.0]
at
org.apache.druid.client.JsonParserIterator.hasNext(JsonParserIterator.java:95)
[druid-server-0.19.0.jar:0.19.0]
at
org.apache.druid.java.util.common.guava.BaseSequence.makeYielder(BaseSequence.java:89)
[druid-core-0.19.0.jar:0.19.0]
at
org.apache.druid.java.util.common.guava.BaseSequence.toYielder(BaseSequence.java:69)
[druid-core-0.19.0.jar:0.19.0]
at
org.apache.druid.java.util.common.guava.MappedSequence.toYielder(MappedSequence.java:49)
[druid-core-0.19.0.jar:0.19.0]
at
org.apache.druid.java.util.common.guava.ParallelMergeCombiningSequence$ResultBatch.fromSequence(ParallelMergeCombiningSequence.java:869)
[druid-core-0.19.0.jar:0.19.0]
at
org.apache.druid.java.util.common.guava.ParallelMergeCombiningSequence$SequenceBatcher.block(ParallelMergeCombiningSequence.java:920)
[druid-core-0.19.0.jar:0.19.0]
at
java.util.concurrent.ForkJoinPool.managedBlock(ForkJoinPool.java:3313)
[?:1.8.0_252]
at
org.apache.druid.java.util.common.guava.ParallelMergeCombiningSequence$SequenceBatcher.getBatchYielder(ParallelMergeCombiningSequence.java:909)
[druid-core-0.19.0.jar:0.19.0]
at
org.apache.druid.java.util.common.guava.ParallelMergeCombiningSequence$YielderBatchedResultsCursor.initialize(ParallelMergeCombiningSequence.java:1017)
[druid-core-0.19.0.jar:0.19.0]
at
org.apache.druid.java.util.common.guava.ParallelMergeCombiningSequence$PrepareMergeCombineInputsAction.compute(ParallelMergeCombiningSequence.java:721)
[druid-core-0.19.0.jar:0.19.0]
at
java.util.concurrent.RecursiveAction.exec(RecursiveAction.java:189)
[?:1.8.0_252]
at java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:289)
[?:1.8.0_252]
at
java.util.concurrent.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1056)
[?:1.8.0_252]
at
java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1692)
[?:1.8.0_252]
at
java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:157)
[?:1.8.0_252]
2021-05-17T06:49:34,778 WARN [HttpClient-Netty-Worker-5]
org.apache.druid.java.util.http.client.pool.ResourcePool - Resource at
key[http://localhost:8083] was returned multiple times?
2021-05-17T06:49:34,778 WARN
[qtp1096742104-119[movingAverage_[wikipedia]_ce9e10ec-6da8-479e-879c-5eb4c094408c]]
org.apache.druid.server.QueryLifecycle - Exception while processing queryId
[ce9e10ec-6da8-479e-879c-5eb4c094408c]
(QueryInterruptedException{msg=url[http://localhost:8083/druid/v2/] timed out
or max bytes limit reached., code=Resource limit exceeded,
class=org.apache.druid.query.ResourceLimitExceededException,
host=localhost:8083})
```
No exception shows in historical.log.
I will continue to investigate the root cause.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
