Ramana Inukonda Nagaraj created DRILL-638:
---------------------------------------------
Summary: Out of memory errors after merge on 5/4
Key: DRILL-638
URL: https://issues.apache.org/jira/browse/DRILL-638
Project: Apache Drill
Issue Type: Bug
Reporter: Ramana Inukonda Nagaraj
Priority: Critical
Repro: Execute a number of queries, we hit this when we ran the smoke test
suite and later tried to execute another smoke test suite. In serial not
parallel. All queries fail with below error:
Once the drillbit reaches the state mentioned query submission fail through
all means. Only way to solve this is to restart the drillbit.
Query failed: org.apache.drill.exec.rpc.RpcException: Remote failure while
running query.[error_id: "60bd6817-3724-4658-8dda-a47c09bec11c"
endpoint {
address: "drillats2.qa.lab"
java.sql.SQLException: exception while executing query
user_port: 31010
at net.hydromatic.avatica.Helper.createException(Helper.java:40)
control_port: 31011
data_port: 31012
at
net.hydromatic.avatica.AvaticaConnection.executeQueryInternal(AvaticaConnection.java:406)
}
at
net.hydromatic.avatica.AvaticaStatement.executeQueryInternal(AvaticaStatement.java:350)
error_type: 0
message: "Failure while setting up query. < OutOfMemoryException:[ You
attempted to create a new child allocator with initial reservation 20000000 but
only 9698266 bytes of memory were available. ]"
at
net.hydromatic.avatica.AvaticaStatement.executeQuery(AvaticaStatement.java:78)
]
at
org.apache.drill.test.framework.GenericQueryDispatcher.dispatchQueryJDBC(GenericQueryDispatcher.java:88)
at
org.apache.drill.test.framework.DrillTestBase$RunThread.run(DrillTestBase.java:269)
Caused by: java.sql.SQLException: Failure while trying to get next result batch.
at org.apache.drill.jdbc.DrillCursor.next(DrillCursor.java:101)
at org.apache.drill.jdbc.DrillResultSet.execute(DrillResultSet.java:89)
at org.apache.drill.jdbc.DrillResultSet.execute(DrillResultSet.java:43)
at
net.hydromatic.avatica.AvaticaConnection.executeQueryInternal(AvaticaConnection.java:404)
... 4 more
Caused by: org.apache.drill.exec.rpc.RpcException: Remote failure while running
query.[error_id: "60bd6817-3724-4658-8dda-a47c09bec11c"
endpoint {
address: "drillats2.qa.lab"
user_port: 31010
control_port: 31011
data_port: 31012
}
error_type: 0
message: "Failure while setting up query. < OutOfMemoryException:[ You
attempted to create a new child allocator with initial reservation 20000000 but
only 9698266 bytes of memory were available. ]"
]
at
org.apache.drill.exec.rpc.user.QueryResultHandler.batchArrived(QueryResultHandler.java:72)
at
org.apache.drill.exec.rpc.user.UserClient.handleReponse(UserClient.java:84)
at
org.apache.drill.exec.rpc.BasicClientWithConnection.handle(BasicClientWithConnection.java:52)
at
org.apache.drill.exec.rpc.BasicClientWithConnection.handle(BasicClientWithConnection.java:34)
at
org.apache.drill.exec.rpc.RpcBus$InboundHandler.decode(RpcBus.java:154)
at
org.apache.drill.exec.rpc.RpcBus$InboundHandler.decode(RpcBus.java:139)
at
io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:89)
at
io.netty.channel.DefaultChannelHandlerContext.invokeChannelRead(DefaultChannelHandlerContext.java:334)
at
io.netty.channel.DefaultChannelHandlerContext.fireChannelRead(DefaultChannelHandlerContext.java:320)
at
io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at
io.netty.channel.DefaultChannelHandlerContext.invokeChannelRead(DefaultChannelHandlerContext.java:334)
at
io.netty.channel.DefaultChannelHandlerContext.fireChannelRead(DefaultChannelHandlerContext.java:320)
at
io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:173)
at
io.netty.channel.DefaultChannelHandlerContext.invokeChannelRead(DefaultChannelHandlerContext.java:334)
at
io.netty.channel.DefaultChannelHandlerContext.fireChannelRead(DefaultChannelHandlerContext.java:320)
at
io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:86)
at
io.netty.channel.DefaultChannelHandlerContext.invokeChannelRead(DefaultChannelHandlerContext.java:334)
at
io.netty.channel.DefaultChannelHandlerContext.fireChannelRead(DefaultChannelHandlerContext.java:320)
at
io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:785)
at
io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:100)
at
io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:497)
at
io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:465)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:359)
at
io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:101)
at java.lang.Thread.run(Thread.java:744)
--
This message was sent by Atlassian JIRA
(v6.2#6252)
