Hi Anup. The API of Hive2.3 is changed, but not documented fully yet. So the difference should be found and resolved in Drill.
Please go ahead and create Jira [1] with description of your environment, settings, CTAS and query, which doesn't work. Thanks [1] https://issues.apache.org/jira/projects/DRILL/ Kind regards Vitalii On Sat, Mar 24, 2018 at 12:50 PM, Anup Tiwari <[email protected]> wrote: > I have not upgraded hive version but installed hive 2.3.2 on a server and > tried to read data and its working.Can we have any workaround to run drill > 1.13 > with hive 2.1 or up-gradation is the only option? > > > > > > On Sat, Mar 24, 2018 3:52 PM, Anup Tiwari [email protected] > wrote: > Sorry for delayed response as i didn't got time to test this. > @Vitalii, I have tried setting hive.metastore.client.capability.check=false > in > both ways which are :- > 1. "hive.metastore.uris": > "thrift://prod-hadoop-107.bom-prod.aws.games24x7.com:9083? > hive.metastore.client.capability.check=false", > in drill hive plugin and restarted metastore and tried to access hive > tables > via drill. > > 2. Added capability property in hive-site.xml and restarted metastore and > tried > to access hive tables via drill. > > Both ways didn't work. So does that mean Drill 1.13.0 version is > compatible with > Hive 2.3 and above? > > > > > > On Tue, Mar 20, 2018 6:28 PM, Vitalii Diravka [email protected] > wrote: > @Anup, it should. If it isn't back compatible, it is a Hive issue. > > > > > Hive Trift Metastore API was changed, but still isn't documented in > > cwiki.apache.org [1] > > *hive.metastore.client.capability.check *[2] property is true by default. > > Possibly changing this could help you. > > You can change it in Drill Hive plugin or in hive-site.xml > > Looks like, the issue will be the same for using hive-server2 2.3 version > > and hive-metastore 2.1 version. If so it is a Hive issue. > > > > > So you can try to change the property before updating to Hive 2.3 version. > > > > > [1] https://issues.apache.org/jira/browse/HIVE-15062 > > [2] > > https://issues.apache.org/jira/browse/HIVE-15062? > focusedCommentId=15659298&page=com.atlassian.jira. > plugin.system.issuetabpanels:comment-tabpanel#comment-15659298 > > > > > Kind regards > > Vitalii > > > > > On Tue, Mar 20, 2018 at 1:54 PM, Anup Tiwari <[email protected]> > > wrote: > > > > > > Please find below information :- > > > Apache Hadoop 2.7.3Apache Hive 2.1.1 > > > @Vitalii, For testing i can setup upgrade hive but upgrading hive will > > > take time > > > on our production server. Don't you think it should be back compatible? > > > > > > > > > > > > > > > On Tue, Mar 20, 2018 4:33 PM, Vitalii Diravka [email protected] > > > wrote: > > > Anup, > > > > > > > > > > > > > > > "get_table_req" method is present in ThriftHiveMetastore header of Apache > > > > > > Hive 2.3 version. > > > > > > I believe Hive upgrade will help you. Probably it is Hive's back > > > > > > compatibility issue. > > > > > > Please let us know, whether upgrade helps. > > > > > > > > > > > > > > > Kind regards > > > > > > Vitalii > > > > > > > > > > > > > > > On Tue, Mar 20, 2018 at 12:56 PM, Vitalii Diravka < > > > [email protected] > > > > > > wrote: > > >> > > > > > > > > > > > > > > > Hi Anup, > > >> > > > > > > > > >> > > > Maybe we missed something after updating onto hive-2.3 client versions. > > >> > > > > > > Could you provide the following info: > > >> > > > > > > * What is your hive-server and metastore versions? If it is not 2.3 > > >> > > > > > > version could you update onto this? > > >> > > > > > > * What is your hadoop distribution? > > >> > > > > > > > > >> > > > Kind regards > > >> > > > > > > Vitalii > > >> > > > > > > > > >> > > > On Tue, Mar 20, 2018 at 12:31 PM, Abhishek Girish <[email protected]> > > >> > > > > > > wrote: > > >> > > > > > > > > >> > > > Okay, that confirms that the Hive storage plugin is not configured > > >>> > > >> > > > correctly - you are unable to access any Hive table. What's your Hive > > >>> > > >> > > > server version? > > >>> > > >> > > > > > >>> > > > On Tue, Mar 20, 2018 at 3:39 PM, Anup Tiwari <[email protected]> > > >>> > > >> > > > wrote: > > >>> > > >> > > > > > >>> > > > > Hi, > > >>> > > >> > > > > Please find my reply :- > > >>> > > >> > > > > Can you do a 'use hive;` followed by 'show tables;' and see if table > > >>> > > >> > > > > 'cad' is listed? : Did and got empty set(No rows selected). > > >>> > > >> > > > > > > >>> > > >> > > > > If you try via hive shell, do you see it? : Yes > > >>> > > >> > > > > > > >>> > > >> > > > > can you check if this is impacting accessing all hive tables (may be > > >>> > > >> > > > > create a new one and try) or if this is specific to a certain table / > > >>> > > >> > > > > database in Hive? : Tried 2 tables but getting same error. I have not > > >>> > > >> > > > tried > > >>> > > >> > > > > creating anew one, will try that and let you know. > > >>> > > >> > > > > > > >>> > > >> > > > > > > >>> > > >> > > > > > > >>> > > >> > > > > > > >>> > > >> > > > > On Tue, Mar 20, 2018 3:19 PM, Abhishek Girish [email protected] > > >>> > > >> > > > wrote: > > >>> > > >> > > > > Down in the stack trace it's complaining that the table name 'cad' was > > >>> > > >> > > > not > > >>> > > >> > > > > > > >>> > > >> > > > > found; Can you do a 'use hive;` followed by 'show tables;' and see if > > >>> > > >> > > > table > > >>> > > >> > > > > > > >>> > > >> > > > > 'cad' is listed? > > >>> > > >> > > > > > > >>> > > >> > > > > > > >>> > > >> > > > > > > >>> > > >> > > > > > > >>> > > >> > > > > If you try via hive shell, do you see it? > > >>> > > >> > > > > > > >>> > > >> > > > > > > >>> > > >> > > > > > > >>> > > >> > > > > > > >>> > > >> > > > > Also, can you check if this is impacting accessing all hive tables (may > > >>> > > >> > > > be > > >>> > > >> > > > > > > >>> > > >> > > > > create a new one and try) or if this is specific to a certain table / > > >>> > > >> > > > > > > >>> > > >> > > > > database in Hive? > > >>> > > >> > > > > > > >>> > > >> > > > > > > >>> > > >> > > > > > > >>> > > >> > > > > > > >>> > > >> > > > > -Abhishek > > >>> > > >> > > > > > > >>> > > >> > > > > > > >>> > > >> > > > > > >>> > > > > > >> > > > > > >> > > > > > > > > > > > > > > > > > > Regards, > > > Anup Tiwari > > > > > > > Regards, > Anup Tiwari > > > Regards, > Anup Tiwari
