HI All
I am facing following issue when I am trying to query alluxio deployed in
docker having host name from Drill.
Scenario is as follows
. Docker has been started with hostname tomcat on machine xyz.us.abc.com
. Alluxio has been started inside this docker and alluxio master running
on port 19998
. I have configured storage plug-in in Drill with name alluxio mapped to
xyz.us.abc.com:19998
. Drill is able to connect to alluxio when I run use alluxio;
. I am also able to see files present inside allusion when I run show
files in alluxio
. When I execute queries on these files present in alluxio, I get unknown
host exception with following stack trace
. File has required permission and ownership to run from Drill
. Issue here is that we have started docker with host name. Previously I
was able to query alluxio, when we used to start docker without hostname
. I tried multiple work around to fix this issue. But still not able to
fix it
Any input on following issue will be useful
Caused by: java.io.IOException: java.lang.RuntimeException:
java.net.UnknownHostException: tomcat
at
org.apache.drill.exec.store.parquet.Metadata$MetadataGatherer.convertToIOException(Metadata.java:320)
~[drill-java-exec-1.11.0.jar:1.11.0]
at
org.apache.drill.exec.store.TimedRunnable.getValue(TimedRunnable.java:79)
~[drill-java-exec-1.11.0.jar:1.11.0]
at
org.apache.drill.exec.store.TimedRunnable.run(TimedRunnable.java:173)
~[drill-java-exec-1.11.0.jar:1.11.0]
at
org.apache.drill.exec.store.parquet.Metadata.getParquetFileMetadata_v3(Metadata.java:293)
~[drill-java-exec-1.11.0.jar:1.11.0]
at
org.apache.drill.exec.store.parquet.Metadata.getParquetTableMetadata(Metadata.java:270)
~[drill-java-exec-1.11.0.jar:1.11.0]
at
org.apache.drill.exec.store.parquet.Metadata.getParquetTableMetadata(Metadata.java:131)
~[drill-java-exec-1.11.0.jar:1.11.0]
at
org.apache.drill.exec.store.parquet.ParquetGroupScan.init(ParquetGroupScan.java:748)
~[drill-java-exec-1.11.0.jar:1.11.0]
at
org.apache.drill.exec.store.parquet.ParquetGroupScan.<init>(ParquetGroupScan.java:226)
~[drill-java-exec-1.11.0.jar:1.11.0]
at
org.apache.drill.exec.store.parquet.ParquetGroupScan.<init>(ParquetGroupScan.java:186)
~[drill-java-exec-1.11.0.jar:1.11.0]
at
org.apache.drill.exec.store.parquet.ParquetFormatPlugin.getGroupScan(ParquetFormatPlugin.java:170)
~[drill-java-exec-1.11.0.jar:1.11.0]
at
org.apache.drill.exec.store.parquet.ParquetFormatPlugin.getGroupScan(ParquetFormatPlugin.java:66)
~[drill-java-exec-1.11.0.jar:1.11.0]
at
org.apache.drill.exec.store.dfs.FileSystemPlugin.getPhysicalScan(FileSystemPlugin.java:144)
~[drill-java-exec-1.11.0.jar:1.11.0]
at
org.apache.drill.exec.store.AbstractStoragePlugin.getPhysicalScan(AbstractStoragePlugin.java:100)
~[drill-java-exec-1.11.0.jar:1.11.0]
at
org.apache.drill.exec.planner.logical.DrillTable.getGroupScan(DrillTable.java:85)
~[drill-java-exec-1.11.0.jar:1.11.0]
at
org.apache.drill.exec.planner.logical.DrillScanRel.<init>(DrillScanRel.java:90)
~[drill-java-exec-1.11.0.jar:1.11.0]
... 18 common frames omitted
Caused by: java.lang.RuntimeException: java.net.UnknownHostException: tomcat
at
com.google.common.base.Throwables.propagate(Throwables.java:160)
~[guava-18.0.jar:na]
at
alluxio.util.network.NetworkAddressUtils.getRpcPortSocketAddress(NetworkAddressUtils.java:560)
~[alluxio-core-client-spark-1.2.0-jar-with-dependencies.jar:na]
at
alluxio.client.file.FileSystemWorkerClient.<init>(FileSystemWorkerClient.java:85)
~[alluxio-core-client-spark-1.2.0-jar-with-dependencies.jar:na]
at
alluxio.client.file.FileSystemContext.createWorkerClient(FileSystemContext.java:91)
~[alluxio-core-client-spark-1.2.0-jar-with-dependencies.jar:na]
at
alluxio.client.block.DelegatedUnderStoreBlockInStream.<init>(DelegatedUnderStoreBlockInStream.java:54)
~[alluxio-core-client-spark-1.2.0-jar-with-dependencies.jar:na]
at
alluxio.client.block.UnderStoreBlockInStream$Factory.create(UnderStoreBlockInStream.java:92)
~[alluxio-core-client-spark-1.2.0-jar-with-dependencies.jar:na]
at
alluxio.client.file.FileInStream.createUnderStoreBlockInStream(FileInStream.java:288)
~[alluxio-core-client-spark-1.2.0-jar-with-dependencies.jar:na]
at
alluxio.client.file.FileInStream.updateBlockInStream(FileInStream.java:518)
~[alluxio-core-client-spark-1.2.0-jar-with-dependencies.jar:na]
at
alluxio.client.file.FileInStream.updateStreams(FileInStream.java:415)
~[alluxio-core-client-spark-1.2.0-jar-with-dependencies.jar:na]
at
alluxio.client.file.FileInStream.close(FileInStream.java:147)
~[alluxio-core-client-spark-1.2.0-jar-with-dependencies.jar:na]
at
alluxio.hadoop.HdfsFileInputStream.close(HdfsFileInputStream.java:108)
~[alluxio-core-client-spark-1.2.0-jar-with-dependencies.jar:na]
at
java.io.FilterInputStream.close(FilterInputStream.java:181) ~[na:1.8.0_111]
at
org.apache.parquet.hadoop.ParquetFileReader.readFooter(ParquetFileReader.java:457)
~[parquet-hadoop-1.8.1-drill-r0.jar:1.8.1-drill-r0]
at
org.apache.parquet.hadoop.ParquetFileReader.readFooter(ParquetFileReader.java:412)
~[parquet-hadoop-1.8.1-drill-r0.jar:1.8.1-drill-r0]
at
org.apache.drill.exec.store.parquet.Metadata.getParquetFileMetadata_v3(Metadata.java:373)
~[drill-java-exec-1.11.0.jar:1.11.0]
at
org.apache.drill.exec.store.parquet.Metadata.access$100(Metadata.java:81)
~[drill-java-exec-1.11.0.jar:1.11.0]
at
org.apache.drill.exec.store.parquet.Metadata$MetadataGatherer.runInner(Metadata.java:312)
~[drill-java-exec-1.11.0.jar:1.11.0]
at
org.apache.drill.exec.store.parquet.Metadata$MetadataGatherer.runInner(Metadata.java:300)
~[drill-java-exec-1.11.0.jar:1.11.0]
at
org.apache.drill.exec.store.TimedRunnable.run(TimedRunnable.java:56)
~[drill-java-exec-1.11.0.jar:1.11.0]
at
org.apache.drill.exec.store.TimedRunnable$LatchedRunnable.run(TimedRunnable.java:98)
~[drill-java-exec-1.11.0.jar:1.11.0]
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
~[na:1.8.0_111]
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
~[na:1.8.0_111]
... 3 common frames omitted
Caused by: java.net.UnknownHostException: tomcat
at java.net.InetAddress.getAllByName0(InetAddress.java:1280)
~[na:1.8.0_111]
at java.net.InetAddress.getAllByName(InetAddress.java:1192)
~[na:1.8.0_111]
at java.net.InetAddress.getAllByName(InetAddress.java:1126)
~[na:1.8.0_111]
at java.net.InetAddress.getByName(InetAddress.java:1076)
~[na:1.8.0_111]
at
alluxio.util.network.NetworkAddressUtils.resolveHostName(NetworkAddressUtils.java:473)
~[alluxio-core-client-spark-1.2.0-jar-with-dependencies.jar:na]
at
alluxio.util.network.NetworkAddressUtils.getFqdnHost(NetworkAddressUtils.java:497)
~[alluxio-core-client-spark-1.2.0-jar-with-dependencies.jar:na]
at
alluxio.util.network.NetworkAddressUtils.getRpcPortSocketAddress(NetworkAddressUtils.java:556)
~[alluxio-core-client-spark-1.2.0-jar-with-dependencies.jar:na]
... 23 common frames omitted
2017-10-26 02:21:11,699 [Client-1] INFO o.a.d.j.i.DrillCursor$ResultsListener
- [#2] Query failed:
org.apache.drill.common.exceptions.UserRemoteException: SYSTEM ERROR:
UnknownHostException: tomcat
[Error Id: 5d0b7607-b9fd-4546-9fe9-755137680735 on xyz.us.abc.com:31010]
at
org.apache.drill.exec.rpc.user.QueryResultHandler.resultArrived(QueryResultHandler.java:123)
[drill-java-exec-1.11.0.jar:1.11.0]
at
org.apache.drill.exec.rpc.user.UserClient.handle(UserClient.java:368)
[drill-java-exec-1.11.0.jar:1.11.0]
at
org.apache.drill.exec.rpc.user.UserClient.handle(UserClient.java:90)
[drill-java-exec-1.11.0.jar:1.11.0]
at
org.apache.drill.exec.rpc.RpcBus$InboundHandler.decode(RpcBus.java:274)
[drill-rpc-1.11.0.jar:1.11.0]
at
org.apache.drill.exec.rpc.RpcBus$InboundHandler.decode(RpcBus.java:244)
[drill-rpc-1.11.0.jar:1.11.0]
at
io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:89)
[netty-codec-4.0.27.Final.jar:4.0.27.Final]
at
io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:339)
[netty-transport-4.0.27.Final.jar:4.0.27.Final]
at
io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:324)
[netty-transport-4.0.27.Final.jar:4.0.27.Final]
at
io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:254)
[netty-handler-4.0.27.Final.jar:4.0.27.Final]
at
io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:339)
[netty-transport-4.0.27.Final.jar:4.0.27.Final]
at
io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:324)
[netty-transport-4.0.27.Final.jar:4.0.27.Final]
at
io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:103)
[netty-codec-4.0.27.Final.jar:4.0.27.Final]
at
io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:339)
[netty-transport-4.0.27.Final.jar:4.0.27.Final]
at
io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:324)
[netty-transport-4.0.27.Final.jar:4.0.27.Final]
at
io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:242)
[netty-codec-4.0.27.Final.jar:4.0.27.Final]
at
io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:339)
[netty-transport-4.0.27.Final.jar:4.0.27.Final]
at
io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:324)
[netty-transport-4.0.27.Final.jar:4.0.27.Final]
at
io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:86)
[netty-transport-4.0.27.Final.jar:4.0.27.Final]
at
io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:339)
[netty-transport-4.0.27.Final.jar:4.0.27.Final]
at
io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:324)
[netty-transport-4.0.27.Final.jar:4.0.27.Final]
at
io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:847)
[netty-transport-4.0.27.Final.jar:4.0.27.Final]
at
io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:131)
[netty-transport-4.0.27.Final.jar:4.0.27.Final]
at
io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:511)
[netty-transport-4.0.27.Final.jar:4.0.27.Final]
at
io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:468)
[netty-transport-4.0.27.Final.jar:4.0.27.Final]
at
io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:382)
[netty-transport-4.0.27.Final.jar:4.0.27.Final]
at
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:354)
[netty-transport-4.0.27.Final.jar:4.0.27.Final]
at
io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:111)
[netty-common-4.0.27.Final.jar:4.0.27.Final]
at java.lang.Thread.run(Thread.java:745) [na:1.8.0_111]
Regards
Chetan
