Same issue here. As suggested, I am working it around, by directly
specifying the active namenode's ip in DFS storage plug-in.
However, when I use hive storage plugin I still get:
Error: SYSTEM ERROR: UnknownHostException: denominator
even though I configured fs.default.name to also point to the active
namenode's ip:
{
> "type": "hive",
> "enabled": true,
> "configProps": {
...
"fs.default.name": "hdfs://ACTIVE_NAMENODES_IP:8020",
}
> }
So I guess that behind the scenes there's still some fetching of the
configuration from core-site.xml/hdfs-site.xml. Any idea how to work around
this? Otherwise, it seems impossible to use hive plugin on a HA configured
cluster. Maybe someone could elaborate on the suggestion of passing custom
hdfs-site.xml to Drill's classpath?
Best,
Jakub
On 19 August 2015 at 22:17, Abhishek Girish <[email protected]>
wrote:
> Drill should work on Cloudera and other distributions. You can refer to
> https://drill.apache.org/docs/file-system-storage-plugin/ for details on
> configuring a distributed file system plug-in.
>
> Can you try specifying the IP address of the primary namenode instead of
> "nameservice-ha" in the DFS storage plug-in? I understand that you have HA
> configured, but I don't think there is a way to specify that in Drill,
> afaik.
>
> I remember reading in one of the old threads here that you could copy the
> hdfs-site.xml into Drill classpath - but I'm not sure how exactly that
> works. Someone else can comment.
>
> -Abhishek
>
> On Wed, Aug 19, 2015 at 11:08 AM, Naveen Madhire <[email protected]>
> wrote:
>
> > Hi,
> >
> > I installed Apache Drill to run on a Cloudera cluster which has HA.
> >
> > However, hive queries are failing with "Unknown Host exception -
> > nameservice-ha" error because Drill is unable to resolve nameservice-ha
> > which is part of Cloudera.
> >
> > Is this a known issue or I can do some setup to make it work?
> >
> >
> > Thanks,
> > Naveen
> >
>
--
Jakub Kukul
Data Engineer
[email protected]
phone: +49 30 69817113
mbr targeting GmbH
Hobrechtstr. 65 | 12047 Berlin
Amtsgericht Charlottenburg | HRB 136489B
Geschäftsführer: Pablo Metz, Christoph Tavan
