*would it be an issue to use DNS to point to the specific IP of the namenode as the current active namenode may failover to the standby namenode with another IP?* - I would assume so unless you rely on a dynamic DNS backbone of some sort.
*Is there any similar parameters that can be used to tell Drill to find HDFS cluster ID using Zeekeeper query?* - I don't think so. [1] I would use an IP address in case name resolution keeps consistently failing. -Hanifi 1: https://github.com/apache/drill/blob/master/contrib/storage-hive/core/src/main/java/org/apache/drill/exec/store/hive/HiveStoragePluginConfig.java On Tue, Jun 16, 2015 at 3:55 AM, Arthur Chan <[email protected]> wrote: > Hi, > > for Hbase config, I can use "hbase.zookeeper.quorum" to tell Drill to find > Hbase via Zookeeper as follows: > > "hbase.zookeeper.quorum": "xxx.xxx.xx1,xxx.xxx.xx2,xxx.xxx.xx3", > "hbase.zookeeper.property.clientPort": "2181" > > Q: Is there any similar parameters that can be used to tell Drill to find > HDFS cluster ID using Zeekeeper query? > like "hive.zookeeper.quorum": "xxx.xxx.xx1,xxx.xxx.xx2,xxx.xxx.xx3", > "hive.zookeeper.property.clientPort": "2181" > ? > > > > On Tue, Jun 16, 2015 at 5:49 PM, Arthur Chan <[email protected]> > wrote: > > > Hi, > > > > Here is a Hadoop Cluster with HA, would it be an issue to use DNS to > point > > to the specific IP of the namenode as the current active namenode may > fail > > over to the standby namenode with another IP? > > > > Please help. > > Regards > > > > > > On Tue, Jun 16, 2015 at 2:59 AM, Hanifi Gunes <[email protected]> > wrote: > > > >> Looks like name resolution fails. Make sure you a valid logical DNS > >> entry *mycluster > >> *pointing to a physical host. > >> > >> On Mon, Jun 15, 2015 at 5:06 AM, Arthur Chan <[email protected]> > >> wrote: > >> > >> > Hi, > >> > > >> > I just installed DRILL, and trying my first query from Drill to get > data > >> > from HIVE, however, I got the following error: > >> > > >> > org.apache.drill.common.exceptions.UserRemoteException: SYSTEM ERROR: > >> > java.net.UnknownHostException: mycluster > >> > > >> > > >> > Information about my Hive/Hadoop > >> > > >> > Hive: 1.1.0 > >> > > >> > Hadoop: 2.6.0 cluster with HA, the hdfs cluster name is "mycluster" > >> > > >> > > >> > Below is my configuration: > >> > > >> > { > >> > > >> > "type": "hive", > >> > > >> > "enabled": true, > >> > > >> > "configProps": { > >> > > >> > "hive.metastore.uris": "thrift://x.x.x.x:9083 > >> > <http://192.168.0.31:9083/>", > >> > > >> > "hive.metastore.sasl.enabled": "false", > >> > > >> > "hive.metastore.warehouse.dir": "/user/hadoop/hive/warehouse", > >> > > >> > "fs.default.name": "hdfs:///mycluster" > >> > > >> > } > >> > > >> > } > >> > > >> > > >> > > >> > Please help! > >> > > >> > Regards > >> > > >> > > > > >
