[
https://issues.apache.org/jira/browse/DRILL-650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13991535#comment-13991535
]
Steven Phillips commented on DRILL-650:
---------------------------------------
It would be very helpful if you could include more information about the remote
failure. The stack traces you include here are client side stack traces that
don't tell us anything about the actual failure. The useful part here is this:
Remote failure while running query.[error_id:
"8136e657-1366-476e-ba67-0cfa2aeda169"
endpoint
{ address: "drillats2.qa.lab" user_port: 31010 control_port: 31011 data_port:
31012 }
error_type: 0
message: "Failure while setting up Foreman. < AssertionError"
]
This tells us that there was a remote failure on node drillats2.qa.lab. You
should be able to find a log message corresponding to this failure on that
node. You can use the error id to find the correct error message.
If you have lilith running, you can find it there. Otherwise, the drillbit
should be logging to a local file. There is currently a bug with logging, but
DRILL-652 addresses this. You can manually modify the scripts if you want to
get file logging.
> Left outer join sometimes fails sometimes with Failure while setting up
> Foreman error
> --------------------------------------------------------------------------------------
>
> Key: DRILL-650
> URL: https://issues.apache.org/jira/browse/DRILL-650
> Project: Apache Drill
> Issue Type: Bug
> Reporter: Ramana Inukonda Nagaraj
>
> Have been seeing this sporadically. Does not happen on a clean drill install
> or on a recently restarted drillbit.
> select c.C_custkey,c.C_NAME,o.O_ORDERKEY from customer c left outer join
> orders o on c.c_custkey = o.o_custkey
> Query failed: org.apache.drill.exec.rpc.RpcException: Remote failure while
> running query.[error_id: "8136e657-1366-476e-ba67-0cfa2aeda169"
> endpoint {
> address: "drillats2.qa.lab"
> user_port: 31010
> control_port: 31011
> java.sql.SQLException: exception while executing query
> data_port: 31012
> }
> at net.hydromatic.avatica.Helper.createException(Helper.java:40)
> at
> net.hydromatic.avatica.AvaticaConnection.executeQueryInternal(AvaticaConnection.java:406)
> error_type: 0
> at
> net.hydromatic.avatica.AvaticaStatement.executeQueryInternal(AvaticaStatement.java:350)
> message: "Failure while setting up Foreman. < AssertionError"
> ]
> at
> net.hydromatic.avatica.AvaticaStatement.executeQuery(AvaticaStatement.java:78)
> at
> org.apache.drill.test.framework.GenericQueryDispatcher.dispatchQueryJDBC(GenericQueryDispatcher.java:88)
> at
> org.apache.drill.test.framework.DrillTestBase$RunThread.run(DrillTestBase.java:269)
> Caused by: java.sql.SQLException: Failure while trying to get next result
> batch.
> at org.apache.drill.jdbc.DrillCursor.next(DrillCursor.java:101)
> at org.apache.drill.jdbc.DrillResultSet.execute(DrillResultSet.java:89)
> at org.apache.drill.jdbc.DrillResultSet.execute(DrillResultSet.java:43)
> at
> net.hydromatic.avatica.AvaticaConnection.executeQueryInternal(AvaticaConnection.java:404)
> ... 4 more
> Caused by: org.apache.drill.exec.rpc.RpcException: Remote failure while
> running query.[error_id: "8136e657-1366-476e-ba67-0cfa2aeda169"
> endpoint {
> address: "drillats2.qa.lab"
> user_port: 31010
> control_port: 31011
> data_port: 31012
> }
> error_type: 0
> message: "Failure while setting up Foreman. < AssertionError"
> ]
> at
> org.apache.drill.exec.rpc.user.QueryResultHandler.batchArrived(QueryResultHandler.java:72)
> at
> org.apache.drill.exec.rpc.user.UserClient.handleReponse(UserClient.java:80)
> at
> org.apache.drill.exec.rpc.BasicClientWithConnection.handle(BasicClientWithConnection.java:52)
> at
> org.apache.drill.exec.rpc.BasicClientWithConnection.handle(BasicClientWithConnection.java:34)
> at
> org.apache.drill.exec.rpc.RpcBus$InboundHandler.decode(RpcBus.java:154)
> at
> org.apache.drill.exec.rpc.RpcBus$InboundHandler.decode(RpcBus.java:139)
> at
> io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:89)
> at
> io.netty.channel.DefaultChannelHandlerContext.invokeChannelRead(DefaultChannelHandlerContext.java:334)
> at
> io.netty.channel.DefaultChannelHandlerContext.fireChannelRead(DefaultChannelHandlerContext.java:320)
> at
> io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
> at
> io.netty.channel.DefaultChannelHandlerContext.invokeChannelRead(DefaultChannelHandlerContext.java:334)
> at
> io.netty.channel.DefaultChannelHandlerContext.fireChannelRead(DefaultChannelHandlerContext.java:320)
> at
> io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:173)
> at
> io.netty.channel.DefaultChannelHandlerContext.invokeChannelRead(DefaultChannelHandlerContext.java:334)
> at
> io.netty.channel.DefaultChannelHandlerContext.fireChannelRead(DefaultChannelHandlerContext.java:320)
> at
> io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:86)
> at
> io.netty.channel.DefaultChannelHandlerContext.invokeChannelRead(DefaultChannelHandlerContext.java:334)
> at
> io.netty.channel.DefaultChannelHandlerContext.fireChannelRead(DefaultChannelHandlerContext.java:320)
> at
> io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:785)
> at
> io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:100)
> at
> io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:497)
> at
> io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:465)
> at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:359)
> at
> io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:101)
> at java.lang.Thread.run(Thread.java:744)
--
This message was sent by Atlassian JIRA
(v6.2#6252)
