Aman Sinha created DRILL-1630:
---------------------------------
Summary: CorruptedFrameException when querying larger data set
Key: DRILL-1630
URL: https://issues.apache.org/jira/browse/DRILL-1630
Project: Apache Drill
Issue Type: Bug
Components: Execution - RPC
Affects Versions: 0.6.0
Reporter: Aman Sinha
When querying a private data set that has about 4B row fact table of CSV data
and doing left outer joins with 6 dimension tables, one of which has 40M rows,
I have seen the following 2 types of CorruptedFrameException. The first one
occurred on a 4 node cluster, but the second stack trace is from a single node
execution.
{code}
2014-10-29 21:01:48,279 [BitServer-6] ERROR o.a.d.exec.rpc.RpcExceptionHandler
- Exception in pipeline. Closing channel between local /10.10.100.173:31012
and remote /10.10.100.174:48664
io.netty.handler.codec.CorruptedFrameException: Received a message of length 0.
at
org.apache.drill.exec.rpc.ProtobufLengthDecoder.decode(ProtobufLengthDecoder.java:74)
~[drill-java-exec-0.7.0-incubating-SNAPSHOT-rebuffed.jar:0.7.0-incubating-SNAPSHOT]
at
org.apache.drill.exec.rpc.data.DataProtobufLengthDecoder.decode(DataProtobufLengthDecoder.java:38)
~[drill-java-exec-0.7.0-incubating-SNAPSHOT-rebuffed.jar:0.7.0-incubating-SNAPSHOT]
{code}
and
{code}
2014-10-29 06:33:03,988 [BitServer-5] ERROR o.a.d.exec.rpc.RpcExceptionHandler
- Exception in pipeline. Closing channel between local /10.10.100.171:31012
and remote /10.10.100.171:46069
io.netty.handler.codec.CorruptedFrameException: Expected to read a tag of 10
but actually received a value of 53. Happened after reading 271790 message.
at org.apache.drill.exec.rpc.RpcDecoder.checkTag(RpcDecoder.java:126)
~[drill-java-exec-0.7.0-incubating-SNAPSHOT-rebuffed.jar:0.7.0-incubating-SNAPSHOT]
at org.apache.drill.exec.rpc.RpcDecoder.decode(RpcDecoder.java:61)
~[drill-java-exec-0.7.0-incubating-SNAPSHOT-rebuffed.jar:0.7.0-incubating-SNAPSHOT]
at org.apache.drill.exec.rpc.RpcDecoder.decode(RpcDecoder.java:35)
~[drill-java-exec-0.7.0-incubating-SNAPSHOT-rebuffed.jar:0.7.0-incubating-SNAPSHOT]
at
io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:89)
~[netty-codec-4.0.20.Final.jar:4.0.20.Final]
at
io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:332)
[netty-transport-4.0.20.Final.jar:4.0.20.Final]
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
