Re: Unable to setup hive plugin in Drill 1.11.0

[Anup Tiwari]

Also forgot to mention that we are using Drill 1.10 with 2.1 on our one of
clusters and it is working properly. Just the change is in Hadoop Version and we
are using MySQL community version 5.7.16. Please find below details :-
Apache Drill Version : 1.10.0MySQL Community :5.7.16Apache Hive : 2.1.1Apache
Hadoop : 2.7.3
So does this mean the issue is with hadoop version ? As i can seehadoop 2.7.1
related jars in 3rdparty jar of drill.  






On Tue, Feb 13, 2018 11:33 AM, Anup Tiwari anup.tiw...@games24x7.com  wrote:
Hi Sorabh,
Thanks for reply. We are using below combination :-
Apache Drill Version : 1.11.0MySQL Percona : 5.6.35-81.0Apache Hive : 2.1.1
Apache Hadoop : 2.8.0
As you have mentioned that Drill 1.11 with hive 2.1 combination is not supported
so do we have any link from where i can get an idea of which combination is
supported? Also does not supported means we can't use this combination(i mean
don't we have any workaround)?  






On Tue, Feb 13, 2018 12:57 AM, Sorabh Hamirwasia shamirwa...@mapr.com  wrote:
Hi Anup,





From the stack trace which you have shared it looks like you are trying to use

Hive2.1 with drill-1.11.0. This s not a supported combination[1]. There is a
PR[2] open for it in 1.13 though.







Also from the stack trace it's pointing towards an invalid field in HiveConf
METASTORE_BATCH_RETRIEVE_OBJECTS_MAX which got introduced in hive-2.1 only.







java.lang.Thread.run(Thread.java:745) [na:1.8.0_72]Caused by:




java.lang.NoSuchFieldError: METASTORE_BATCH_RETRIEVE_OBJECTS_MAX at




org.apache.hadoop.hive.metastore.HiveMetaStoreClient.(HiveMetaStoreClient.java:222)




~[hive-metastore-2.1.1.jar:2.1.1] at




org.apache.hadoop.hive.metastore.HiveMetaStoreClient.(HiveMetaStoreClient.java:210)




~[hive-metastore-2.1.1.jar:2.1.1] at




org.apache.drill.exec.store.hive.DrillHiveMetaStoreClient.(DrillHiveMetaStoreClient.java:140)







Usually any error/exxception should get logged into drillbit.out as well. May be
you can try seeing there.







[1]: https://github.com/apache/drill/blob/1.11.0/pom.xml#L51




[2]: https://github.com/apache/drill/pull/







Thanks,

Sorabh









From: Anup Tiwari 

Sent: Monday, February 12, 2018 9:21 AM

To: user@drill.apache.org

Subject: Re: Unable to setup hive plugin in Drill 1.11.0




I don't know where to look for logs as i have tried multiple time creating

hive plugin. But one time i can see below stack is printed in drillbit.log(i

don't know if it came due to plugin creation or not as i have tried multiple

time but nothing got printed in drillbit.log except below which is present in

logs only once) :-

Error

org.apache.drill.common.exceptions.ExecutionSetupException: Failure setting up

new storage plugin configuration for config org.apache.drill.exec.

store.hive.HiveStoragePluginConfig@f149f108 at

org.apache.drill.exec.store.StoragePluginRegistryImpl.create(StoragePluginRegistryImpl.java:354)

~[drill-java-exec-1.11.0.jar:1.11.0] at

org.apache.drill.exec.store.StoragePluginRegistryImpl.createOrUpdate(StoragePluginRegistryImpl.java:238)

~[drill-java-exec-1.11.0.jar:1.11.0] at

org.apache.drill.exec.store.StoragePluginRegistryImpl.getPlugin(StoragePluginRegistryImpl.java:289)

~[drill-java-exec-1.11.0.jar:1.11.0] at

org.apache.drill.exec.server.rest.StorageResources.getStoragePluginJSON(StorageResources.java:101)

[drill-java-exec-1.11.0.jar:1.11.0] at

org.apache.drill.exec.server.rest.StorageResources.getStoragePlugin(StorageResources.java:115)

[drill-java-exec-1.11.0.jar:1.11.0] at

sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.8.0_72]

 at

sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)

~[na:1.8.0_72] at

sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

~[na:1.8.0_72] at java.lang.reflect.Method.invoke(Method.java:498)

~[na:1.8.0_72] at

org.glassfish.jersey.server.model.internal.ResourceMethodInvocationHandlerFactory$1.invoke(ResourceMethodInvocationHandlerFactory.java

:81) [jersey-server-2.8.jar:na] at

org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher$1.run(AbstractJavaResourceMethodDispatcher.java:151)

[jersey-server-2.8.jar:na] at

org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.invoke(AbstractJavaResourceMethodDispatcher.java:171)

 [jersey-server-2.8.jar:na] at

org.glassfish.jersey.server.model.internal.JavaResourceMethodDispatcherProvider$TypeOutInvoker.doDispatch(JavaResourceMethodDispatcher

Provider.java:195) [jersey-server-2.8.jar:na] at

org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.dispatch(AbstractJavaResourceMethodDispatcher.java:104

) [jersey-server-2.8.jar:na] at

org.glassfish.jersey.server.model.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:387)

[jersey-server-2.8.jar:na] at

Re: Unable to setup hive plugin in Drill 1.11.0

[Anup Tiwari]

Hi Sorabh,
Thanks for reply. We are using below combination :-
Apache Drill Version : 1.11.0MySQL Percona : 5.6.35-81.0Apache Hive : 2.1.1
Apache Hadoop : 2.8.0
As you have mentioned that Drill 1.11 with hive 2.1 combination is not supported
so do we have any link from where i can get an idea of which combination is
supported? Also does not supported means we can't use this combination(i mean
don't we have any workaround)?  






On Tue, Feb 13, 2018 12:57 AM, Sorabh Hamirwasia shamirwa...@mapr.com  wrote:
Hi Anup,





From the stack trace which you have shared it looks like you are trying to use

Hive2.1 with drill-1.11.0. This s not a supported combination[1]. There is a
PR[2] open for it in 1.13 though.







Also from the stack trace it's pointing towards an invalid field in HiveConf
METASTORE_BATCH_RETRIEVE_OBJECTS_MAX which got introduced in hive-2.1 only.







java.lang.Thread.run(Thread.java:745) [na:1.8.0_72]Caused by:




java.lang.NoSuchFieldError: METASTORE_BATCH_RETRIEVE_OBJECTS_MAX at




org.apache.hadoop.hive.metastore.HiveMetaStoreClient.(HiveMetaStoreClient.java:222)




~[hive-metastore-2.1.1.jar:2.1.1] at




org.apache.hadoop.hive.metastore.HiveMetaStoreClient.(HiveMetaStoreClient.java:210)




~[hive-metastore-2.1.1.jar:2.1.1] at




org.apache.drill.exec.store.hive.DrillHiveMetaStoreClient.(DrillHiveMetaStoreClient.java:140)







Usually any error/exxception should get logged into drillbit.out as well. May be
you can try seeing there.







[1]: https://github.com/apache/drill/blob/1.11.0/pom.xml#L51




[2]: https://github.com/apache/drill/pull/







Thanks,

Sorabh









From: Anup Tiwari 

Sent: Monday, February 12, 2018 9:21 AM

To: user@drill.apache.org

Subject: Re: Unable to setup hive plugin in Drill 1.11.0




I don't know where to look for logs as i have tried multiple time creating

hive plugin. But one time i can see below stack is printed in drillbit.log(i

don't know if it came due to plugin creation or not as i have tried multiple

time but nothing got printed in drillbit.log except below which is present in

logs only once) :-

Error

org.apache.drill.common.exceptions.ExecutionSetupException: Failure setting up

new storage plugin configuration for config org.apache.drill.exec.

store.hive.HiveStoragePluginConfig@f149f108 at

org.apache.drill.exec.store.StoragePluginRegistryImpl.create(StoragePluginRegistryImpl.java:354)

~[drill-java-exec-1.11.0.jar:1.11.0] at

org.apache.drill.exec.store.StoragePluginRegistryImpl.createOrUpdate(StoragePluginRegistryImpl.java:238)

~[drill-java-exec-1.11.0.jar:1.11.0] at

org.apache.drill.exec.store.StoragePluginRegistryImpl.getPlugin(StoragePluginRegistryImpl.java:289)

~[drill-java-exec-1.11.0.jar:1.11.0] at

org.apache.drill.exec.server.rest.StorageResources.getStoragePluginJSON(StorageResources.java:101)

[drill-java-exec-1.11.0.jar:1.11.0] at

org.apache.drill.exec.server.rest.StorageResources.getStoragePlugin(StorageResources.java:115)

[drill-java-exec-1.11.0.jar:1.11.0] at

sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.8.0_72]

 at

sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)

~[na:1.8.0_72] at

sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

~[na:1.8.0_72] at java.lang.reflect.Method.invoke(Method.java:498)

~[na:1.8.0_72] at

org.glassfish.jersey.server.model.internal.ResourceMethodInvocationHandlerFactory$1.invoke(ResourceMethodInvocationHandlerFactory.java

:81) [jersey-server-2.8.jar:na] at

org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher$1.run(AbstractJavaResourceMethodDispatcher.java:151)

[jersey-server-2.8.jar:na] at

org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.invoke(AbstractJavaResourceMethodDispatcher.java:171)

 [jersey-server-2.8.jar:na] at

org.glassfish.jersey.server.model.internal.JavaResourceMethodDispatcherProvider$TypeOutInvoker.doDispatch(JavaResourceMethodDispatcher

Provider.java:195) [jersey-server-2.8.jar:na] at

org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.dispatch(AbstractJavaResourceMethodDispatcher.java:104

) [jersey-server-2.8.jar:na] at

org.glassfish.jersey.server.model.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:387)

[jersey-server-2.8.jar:na] at

org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:331)

[jersey-server-2.8.jar:na] at

org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:103)

[jersey-server-2.8.jar:na] at

org.glassfish.jersey.server.ServerRuntime$1.run(ServerRuntime.java:269)

[jersey-server-2.8.jar:na] at

org.glassfish.jersey.internal.Errors$1.call(Errors.java:271)

[jersey-common-2.8.jar:na] at

org.glassfish.jersey.internal.Errors$1.call(Errors.java:267)

[jersey-common-2.8.jar:na] at

Re: Drill on AWS

[Francis McGregor-Macdonald]

Hi Brandon,

I created a quick gist, hopefully it comes across clearly.

https://gist.github.com/fmcmac/a35738376d111fdca45057bd0fb4c79e

Any improvements greatly appreciated and happy to update it based on
feedback.

Regards,
Francis

On Tue, Feb 13, 2018 at 11:11 AM, Brandon Gmail 
wrote:

> Hey Francis,
>
> Yes please! That option will work. I would appreciate any documentation
> you might have.
>
> > On Feb 12, 2018, at 2:51 PM, Francis McGregor-Macdonald <
> fran...@mc-mac.com> wrote:
> >
> > Hi Brandon,
> >
> > I recently went through this challenge and found it easier in the end to
> > install SSM with a bootstrap and then use ssm.send_command
> > with AWS-RunRemoteScript once the cluster was in place.
> >
> > This way I can use the AWS installed Zookeeper. The remote script is
> pretty
> > much a facsimile of the Drill Install instructions.
> >
> > If that option would work happy to share.
> >
> > On Tue, Feb 13, 2018 at 9:22 AM, Brandon Gmail 
> > wrote:
> >
> >> Does anyone have an updated bootstrap script for drill on AWS EMR? Their
> >> repository is over 3 years old, and I’m flailing at figuring this out
> on my
> >> own. Any help would be appreciated.
> >>
> >> Thanks,
> >> Brandon
> >>
>
>

Re: Drill on AWS

[Brandon Gmail]

Hey Francis,

Yes please! That option will work. I would appreciate any documentation you 
might have.

> On Feb 12, 2018, at 2:51 PM, Francis McGregor-Macdonald  
> wrote:
> 
> Hi Brandon,
> 
> I recently went through this challenge and found it easier in the end to
> install SSM with a bootstrap and then use ssm.send_command
> with AWS-RunRemoteScript once the cluster was in place.
> 
> This way I can use the AWS installed Zookeeper. The remote script is pretty
> much a facsimile of the Drill Install instructions.
> 
> If that option would work happy to share.
> 
> On Tue, Feb 13, 2018 at 9:22 AM, Brandon Gmail 
> wrote:
> 
>> Does anyone have an updated bootstrap script for drill on AWS EMR? Their
>> repository is over 3 years old, and I’m flailing at figuring this out on my
>> own. Any help would be appreciated.
>> 
>> Thanks,
>> Brandon
>> 

Re: Drill on AWS

[Francis McGregor-Macdonald]

Hi Brandon,

I recently went through this challenge and found it easier in the end to
install SSM with a bootstrap and then use ssm.send_command
with AWS-RunRemoteScript once the cluster was in place.

This way I can use the AWS installed Zookeeper. The remote script is pretty
much a facsimile of the Drill Install instructions.

If that option would work happy to share.

On Tue, Feb 13, 2018 at 9:22 AM, Brandon Gmail 
wrote:

> Does anyone have an updated bootstrap script for drill on AWS EMR? Their
> repository is over 3 years old, and I’m flailing at figuring this out on my
> own. Any help would be appreciated.
>
> Thanks,
> Brandon
>

Re: Documentation Update for Drill-4286

[Bridget Bevens]

Hi John,

I have not documented this feature yet, but it's on my to-do list. I believe 
there is still some testing in progress.
I'll be sure to include the content in the Configure section. If time permits, 
I'll work on creating an Administer Drill section.

Thanks,

Bridget




From: John Omernik 
Sent: Monday, February 12, 2018 12:43:36 PM
To: user
Subject: Documentation Update for Drill-4286

I see in 1.12 this feature was added("Have an ability to put server in
quiescent mode of operation")

https://urldefense.proofpoint.com/v2/url?u=https-3A__issues.apache.org_jira_browse_DRILL-2D4286=DwIBaQ=cskdkSMqhcnjZxdQVpwTXg=0XmzfjL9vt5bGxgotAi0Uv3orlbVZgZbc24AMF97-R8=ZZGueW8KOJFWYndv2DWSw_QK-2E2bhcj_yZhcXjPuOc=qo0QPC1TBOq5HjgNZgtyX9mn9aXKbB9OJ8LOqrTxQRY=

Was the documentation updated? I couldn't find it.  Perhaps we need a new
section on the Drill Docs page "Administrate Drill" for this and other
related items to how to administrate your Drill cluster (I could also see
the argument for putting it under configure drill)


John

Re: Documentation Update for Drill-4286

[John Omernik]

Ah cool. Thanks for the update!

On Mon, Feb 12, 2018 at 3:14 PM, Kunal Khatua  wrote:

> This made it into Drill 1.12, but there is some additional work to be
> done. We are hoping to have it completed in time for 1.13 release, along
> with documentation.
>
> -Original Message-
> From: John Omernik [mailto:j...@omernik.com]
> Sent: Monday, February 12, 2018 12:44 PM
> To: user 
> Subject: Documentation Update for Drill-4286
>
> I see in 1.12 this feature was added("Have an ability to put server in
> quiescent mode of operation")
>
> https://urldefense.proofpoint.com/v2/url?u=https-3A__issues.
> apache.org_jira_browse_DRILL-2D4286=DwIBaQ=cskdkSMqhcnjZxdQVpwTXg=-
> cT6otg6lpT_XkmYy7yg3A=PrOyVv1V67549FcefWPJBS2OsTgami-UA0o63UL7gwk=
> VrD0nSaVQysOqvIJjjEcmRcWME2mbMMZ5CRiywVla9o=
>
> Was the documentation updated? I couldn't find it.  Perhaps we need a new
> section on the Drill Docs page "Administrate Drill" for this and other
> related items to how to administrate your Drill cluster (I could also see
> the argument for putting it under configure drill)
>
>
> John
>

RE: Documentation Update for Drill-4286

[Kunal Khatua]

This made it into Drill 1.12, but there is some additional work to be done. We 
are hoping to have it completed in time for 1.13 release, along with 
documentation. 

-Original Message-
From: John Omernik [mailto:j...@omernik.com] 
Sent: Monday, February 12, 2018 12:44 PM
To: user 
Subject: Documentation Update for Drill-4286

I see in 1.12 this feature was added("Have an ability to put server in 
quiescent mode of operation")

https://urldefense.proofpoint.com/v2/url?u=https-3A__issues.apache.org_jira_browse_DRILL-2D4286=DwIBaQ=cskdkSMqhcnjZxdQVpwTXg=-cT6otg6lpT_XkmYy7yg3A=PrOyVv1V67549FcefWPJBS2OsTgami-UA0o63UL7gwk=VrD0nSaVQysOqvIJjjEcmRcWME2mbMMZ5CRiywVla9o=

Was the documentation updated? I couldn't find it.  Perhaps we need a new 
section on the Drill Docs page "Administrate Drill" for this and other related 
items to how to administrate your Drill cluster (I could also see the argument 
for putting it under configure drill)


John

Documentation Update for Drill-4286

[John Omernik]

I see in 1.12 this feature was added("Have an ability to put server in
quiescent mode of operation")

https://issues.apache.org/jira/browse/DRILL-4286

Was the documentation updated? I couldn't find it.  Perhaps we need a new
section on the Drill Docs page "Administrate Drill" for this and other
related items to how to administrate your Drill cluster (I could also see
the argument for putting it under configure drill)


John

Drill on AWS

[Brandon Gmail]

Does anyone have an updated bootstrap script for drill on AWS EMR? Their 
repository is over 3 years old, and I’m flailing at figuring this out on my 
own. Any help would be appreciated.

Thanks,
Brandon

Re: Unable to setup hive plugin in Drill 1.11.0

[Sorabh Hamirwasia]

Hi Anup,

>From the stack trace which you have shared it looks like you are trying to use 
>Hive2.1 with drill-1.11.0. This s not a supported combination[1]. There is a 
>PR[2] open for it in 1.13 though.


Also from the stack trace it's pointing towards an invalid field in HiveConf 
METASTORE_BATCH_RETRIEVE_OBJECTS_MAX which got introduced in hive-2.1 only.


java.lang.Thread.run(Thread.java:745) [na:1.8.0_72]Caused by:

java.lang.NoSuchFieldError: METASTORE_BATCH_RETRIEVE_OBJECTS_MAXat

org.apache.hadoop.hive.metastore.HiveMetaStoreClient.(HiveMetaStoreClient.java:222)

~[hive-metastore-2.1.1.jar:2.1.1]at

org.apache.hadoop.hive.metastore.HiveMetaStoreClient.(HiveMetaStoreClient.java:210)

~[hive-metastore-2.1.1.jar:2.1.1]at

org.apache.drill.exec.store.hive.DrillHiveMetaStoreClient.(DrillHiveMetaStoreClient.java:140)


Usually any error/exxception should get logged into drillbit.out as well. May 
be you can try seeing there.


[1]: https://github.com/apache/drill/blob/1.11.0/pom.xml#L51

[2]: https://github.com/apache/drill/pull/


Thanks,
Sorabh



From: Anup Tiwari 
Sent: Monday, February 12, 2018 9:21 AM
To: user@drill.apache.org
Subject: Re: Unable to setup hive plugin in Drill 1.11.0

I don't know where to look for logs as i have tried multiple time creating
hive plugin. But one time i can see below stack is printed in drillbit.log(i
don't know if it came due to plugin creation or not as i have tried multiple
time but nothing got printed in drillbit.log except below which is present in
logs only once) :-
Error
org.apache.drill.common.exceptions.ExecutionSetupException: Failure setting up
new storage plugin configuration for config org.apache.drill.exec.
store.hive.HiveStoragePluginConfig@f149f108at
org.apache.drill.exec.store.StoragePluginRegistryImpl.create(StoragePluginRegistryImpl.java:354)
~[drill-java-exec-1.11.0.jar:1.11.0]at
org.apache.drill.exec.store.StoragePluginRegistryImpl.createOrUpdate(StoragePluginRegistryImpl.java:238)
~[drill-java-exec-1.11.0.jar:1.11.0]at
org.apache.drill.exec.store.StoragePluginRegistryImpl.getPlugin(StoragePluginRegistryImpl.java:289)
~[drill-java-exec-1.11.0.jar:1.11.0]at
org.apache.drill.exec.server.rest.StorageResources.getStoragePluginJSON(StorageResources.java:101)
[drill-java-exec-1.11.0.jar:1.11.0]at
org.apache.drill.exec.server.rest.StorageResources.getStoragePlugin(StorageResources.java:115)
[drill-java-exec-1.11.0.jar:1.11.0]at
sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.8.0_72]
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
~[na:1.8.0_72]at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
~[na:1.8.0_72]at java.lang.reflect.Method.invoke(Method.java:498)
~[na:1.8.0_72]at
org.glassfish.jersey.server.model.internal.ResourceMethodInvocationHandlerFactory$1.invoke(ResourceMethodInvocationHandlerFactory.java
:81) [jersey-server-2.8.jar:na]at
org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher$1.run(AbstractJavaResourceMethodDispatcher.java:151)
[jersey-server-2.8.jar:na]at
org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.invoke(AbstractJavaResourceMethodDispatcher.java:171)
 [jersey-server-2.8.jar:na]at
org.glassfish.jersey.server.model.internal.JavaResourceMethodDispatcherProvider$TypeOutInvoker.doDispatch(JavaResourceMethodDispatcher
Provider.java:195) [jersey-server-2.8.jar:na]at
org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.dispatch(AbstractJavaResourceMethodDispatcher.java:104
) [jersey-server-2.8.jar:na]at
org.glassfish.jersey.server.model.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:387)
[jersey-server-2.8.jar:na]at
org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:331)
[jersey-server-2.8.jar:na]at
org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:103)
[jersey-server-2.8.jar:na]at
org.glassfish.jersey.server.ServerRuntime$1.run(ServerRuntime.java:269)
[jersey-server-2.8.jar:na]at
org.glassfish.jersey.internal.Errors$1.call(Errors.java:271)
[jersey-common-2.8.jar:na]at
org.glassfish.jersey.internal.Errors$1.call(Errors.java:267)
[jersey-common-2.8.jar:na]at
org.glassfish.jersey.internal.Errors.process(Errors.java:315)
[jersey-common-2.8.jar:na]at
org.glassfish.jersey.internal.Errors.process(Errors.java:297)
[jersey-common-2.8.jar:na]at
org.glassfish.jersey.internal.Errors.process(Errors.java:267)
[jersey-common-2.8.jar:na]at
org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:297)
[jersey-common-2.8.jar:na]at

Re: Unable to setup hive plugin in Drill 1.11.0

[Anup Tiwari]

I don't know where to look for logs as i have tried multiple time creating
hive plugin. But one time i can see below stack is printed in drillbit.log(i
don't know if it came due to plugin creation or not as i have tried multiple
time but nothing got printed in drillbit.log except below which is present in
logs only once) :-
Error
org.apache.drill.common.exceptions.ExecutionSetupException: Failure setting up
new storage plugin configuration for config org.apache.drill.exec.
store.hive.HiveStoragePluginConfig@f149f108at
org.apache.drill.exec.store.StoragePluginRegistryImpl.create(StoragePluginRegistryImpl.java:354)
~[drill-java-exec-1.11.0.jar:1.11.0]at
org.apache.drill.exec.store.StoragePluginRegistryImpl.createOrUpdate(StoragePluginRegistryImpl.java:238)
~[drill-java-exec-1.11.0.jar:1.11.0]at
org.apache.drill.exec.store.StoragePluginRegistryImpl.getPlugin(StoragePluginRegistryImpl.java:289)
~[drill-java-exec-1.11.0.jar:1.11.0]at
org.apache.drill.exec.server.rest.StorageResources.getStoragePluginJSON(StorageResources.java:101)
[drill-java-exec-1.11.0.jar:1.11.0]at
org.apache.drill.exec.server.rest.StorageResources.getStoragePlugin(StorageResources.java:115)
[drill-java-exec-1.11.0.jar:1.11.0]at
sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.8.0_72]
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
~[na:1.8.0_72]at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
~[na:1.8.0_72]at java.lang.reflect.Method.invoke(Method.java:498)
~[na:1.8.0_72]at
org.glassfish.jersey.server.model.internal.ResourceMethodInvocationHandlerFactory$1.invoke(ResourceMethodInvocationHandlerFactory.java
:81) [jersey-server-2.8.jar:na]at
org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher$1.run(AbstractJavaResourceMethodDispatcher.java:151)
[jersey-server-2.8.jar:na]at
org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.invoke(AbstractJavaResourceMethodDispatcher.java:171)
 [jersey-server-2.8.jar:na]at
org.glassfish.jersey.server.model.internal.JavaResourceMethodDispatcherProvider$TypeOutInvoker.doDispatch(JavaResourceMethodDispatcher
Provider.java:195) [jersey-server-2.8.jar:na]at
org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.dispatch(AbstractJavaResourceMethodDispatcher.java:104
) [jersey-server-2.8.jar:na]at
org.glassfish.jersey.server.model.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:387)
[jersey-server-2.8.jar:na]at
org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:331)
[jersey-server-2.8.jar:na]at
org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:103)
[jersey-server-2.8.jar:na]at
org.glassfish.jersey.server.ServerRuntime$1.run(ServerRuntime.java:269)
[jersey-server-2.8.jar:na]at
org.glassfish.jersey.internal.Errors$1.call(Errors.java:271)
[jersey-common-2.8.jar:na]at
org.glassfish.jersey.internal.Errors$1.call(Errors.java:267)
[jersey-common-2.8.jar:na]at
org.glassfish.jersey.internal.Errors.process(Errors.java:315)
[jersey-common-2.8.jar:na]at
org.glassfish.jersey.internal.Errors.process(Errors.java:297)
[jersey-common-2.8.jar:na]at
org.glassfish.jersey.internal.Errors.process(Errors.java:267)
[jersey-common-2.8.jar:na]at
org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:297)
[jersey-common-2.8.jar:na]at
org.glassfish.jersey.server.ServerRuntime.process(ServerRuntime.java:252)
[jersey-server-2.8.jar:na]at
org.glassfish.jersey.server.ApplicationHandler.handle(ApplicationHandler.java:1023)
[jersey-server-2.8.jar:na]at
org.glassfish.jersey.servlet.WebComponent.service(WebComponent.java:372)
[jersey-container-servlet-core-2.8.jar:na]at
org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:382)
[jersey-container-servlet-core-2.8.jar:na]at
org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:345)
[jersey-container-servlet-core-2.8.jar:na]at
org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:220)
[jersey-container-servlet-core-2.8.jar:na]at
org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:738)
[jetty-servlet-9.1.5.v20140505.jar:9.1.5.v20140505]at
org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:551)
[jetty-servlet-9.1.5.v20140505.jar:9.1.5.v20140505]at
org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:219)
[jetty-server-9.1.5.v20140505.jar:9.1.5.v20140505]at
org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:)
[jetty-server-9.1.5.v20140505.jar:9.1.5.v20140505]at

Unable to setup hive plugin in Drill 1.11.0

[Anup Tiwari]

Hi All,
Please find below information :-
Apache Drill Version : 1.11.0MySQL Percona : 5.6.35-81.0Apache Hive : 2.1.1
mysql-connector-java-5.1.44-bin.jar is present in 3rdparty jar
Hive Plugin info :-
{"type" : "hive","enabled" : true,"configProps" : {
  "hive.metastore.uris" : "thrift://prod-hadoop-xxx:9083",
  "hive.metastore.sasl.enabled" : "false",  "fs.default.name" :
"hdfs://prod-hadoop-xxx:9000"}  }

Error :
"result" : "error (unable to create/ update storage)"
Regards,
Anup Tiwari

Sent with Mixmax