I would not be surprised if your data has schema change from string to list. Ideally, we should log at which column we hit to this problem and display a better message suggesting use of union types.
Can you try enabling union types? ALTER SESSION/SYSTEM SET `exec.enable_union_type` = true; -Hanifi On Tue, Feb 23, 2016 at 8:44 PM, Árpád Tamási <[email protected]> wrote: > Hi, > > Drill crashes in mongo queries after returning 65536 rows. I select a > nested field which is always a string and always exists. > Any ideas? > > org.apache.drill.common.exceptions.UserRemoteException: SYSTEM ERROR: > IllegalStateException: You tried to start when you are using a ValueWriter > of type NullableVarCharWriterImpl. > > Fragment 0:0 > > [Error Id: ef4abfe7-63d4-4925-be02-fdddf0983c1e on 10.0.0.8:31010] > at > org.apache.drill.exec.rpc.user.QueryResultHandler.resultArrived(QueryResultHandler.java:119) > ~[drill-java-exec-1.5.0.jar:1.5.0] > at > org.apache.drill.exec.rpc.user.UserClient.handleReponse(UserClient.java:113) > ~[drill-java-exec-1.5.0.jar:1.5.0] > at > org.apache.drill.exec.rpc.BasicClientWithConnection.handle(BasicClientWithConnection.java:46) > ~[drill-rpc-1.5.0.jar:1.5.0] > at > org.apache.drill.exec.rpc.BasicClientWithConnection.handle(BasicClientWithConnection.java:31) > ~[drill-rpc-1.5.0.jar:1.5.0] > at org.apache.drill.exec.rpc.RpcBus.handle(RpcBus.java:67) > ~[drill-rpc-1.5.0.jar:1.5.0] > at > org.apache.drill.exec.rpc.RpcBus$RequestEvent.run(RpcBus.java:374) > ~[drill-rpc-1.5.0.jar:1.5.0] > at > org.apache.drill.common.SerializedExecutor$RunnableProcessor.run(SerializedExecutor.java:89) > ~[drill-rpc-1.5.0.jar:1.5.0] > at > org.apache.drill.exec.rpc.RpcBus$SameExecutor.execute(RpcBus.java:252) > ~[drill-rpc-1.5.0.jar:1.5.0] > at > org.apache.drill.common.SerializedExecutor.execute(SerializedExecutor.java:123) > ~[drill-rpc-1.5.0.jar:1.5.0] > at > org.apache.drill.exec.rpc.RpcBus$InboundHandler.decode(RpcBus.java:285) > ~[drill-rpc-1.5.0.jar:1.5.0] > at > org.apache.drill.exec.rpc.RpcBus$InboundHandler.decode(RpcBus.java:257) > ~[drill-rpc-1.5.0.jar:1.5.0] > at > io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:89) > ~[netty-codec-4.0.27.Final.jar:4.0.27.Final] > at > io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:339) > ~[netty-transport-4.0.27.Final.jar:4.0.27.Final] > at > io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:324) > ~[netty-transport-4.0.27.Final.jar:4.0.27.Final] > at > io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:254) > ~[netty-handler-4.0.27.Final.jar:4.0.27.Final] > at > io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:339) > ~[netty-transport-4.0.27.Final.jar:4.0.27.Final] > at > io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:324) > ~[netty-transport-4.0.27.Final.jar:4.0.27.Final] > at > io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:103) > ~[netty-codec-4.0.27.Final.jar:4.0.27.Final] > at > io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:339) > ~[netty-transport-4.0.27.Final.jar:4.0.27.Final] > at > io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:324) > ~[netty-transport-4.0.27.Final.jar:4.0.27.Final] > at > io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:242) > ~[netty-codec-4.0.27.Final.jar:4.0.27.Final] > at > io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:339) > ~[netty-transport-4.0.27.Final.jar:4.0.27.Final] > at > io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:324) > ~[netty-transport-4.0.27.Final.jar:4.0.27.Final] > at > io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:86) > ~[netty-transport-4.0.27.Final.jar:4.0.27.Final] > at > io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:339) > ~[netty-transport-4.0.27.Final.jar:4.0.27.Final] > at > io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:324) > ~[netty-transport-4.0.27.Final.jar:4.0.27.Final] > at > io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:847) > ~[netty-transport-4.0.27.Final.jar:4.0.27.Final] > at > io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:618) > ~[netty-transport-native-epoll-4.0.27.Final-linux-x86_64.jar:na] > at > io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:329) > ~[netty-transport-native-epoll-4.0.27.Final-linux-x86_64.jar:na] > at > io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:250) > ~[netty-transport-native-epoll-4.0.27.Final-linux-x86_64.jar:na] > at > io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:111) > ~[netty-common-4.0.27.Final.jar:4.0.27.Final] > at java.lang.Thread.run(Thread.java:745) ~[na:1.8.0_72] > > <https://samebug.io/> > Árpád Tamási | CTO > +36 70 381 9620 | [email protected] <mailto:[email protected]> > | <http://linkedin.com/in/arpadtamasi> <skype:rpatprogos> >
