Thanks unmesha for the detailed article, I have set the required configurations correctly but still the error remains!.. I also see this warning in the trace [ WARN metastore.RetryingMetaStoreClient: MetaStoreClient lost connection. Attempting to reconnect.] don't know why this only occurs when I set the transaction configurations!
Thanks, Yogendra On Mon, Dec 1, 2014 at 11:49 AM, unmesha sreeveni <unmeshab...@gmail.com> wrote: > Hi yogendra, > > I have tried the same thing and I wrote a doc on ACID properties. > > > http://unmeshasreeveni.blogspot.in/2014/11/updatedeleteinsert-in-hive-0140.html > > Please follow that steps. > > let me know if that stucks you in any point > > On Mon, Dec 1, 2014 at 10:49 AM, yogendra reddy <yogendra...@gmail.com> > wrote: > >> Hi All, >> >> I'm caught up with the error pasted below after trying to use hive >> transaction feature.I have followed this wiki to set required >> configuration. >> https://cwiki.apache.org/confluence/display/Hive/Hive+Transactions#HiveTransactions-Configuration >> >> >> set hive.support.concurrency=true; >> set hive.exec.dynamic.partition.mode=nonstrict; >> set hive.txn.manager=org.apache.hadoop.hive.ql.lockmgr.DbTxnManager; >> set hive.compactor.initiator.on=true; >> set hive.compactor.worker.threads=1; >> >> After setting the above I just ran this command "describe formatted >> acidtest;" >> any pointers as to why this occurs? >> >> FAILED: Error in acquiring locks: Error communicating with the metastore >> 14/12/01 05:02:05 ERROR ql.Driver: FAILED: Error in acquiring locks: >> Error communicating with the metastore >> org.apache.hadoop.hive.ql.lockmgr.LockException: Error communicating with >> the metastore >> at >> org.apache.hadoop.hive.ql.lockmgr.DbLockManager.lock(DbLockManager.java:101) >> at >> org.apache.hadoop.hive.ql.lockmgr.DbTxnManager.acquireLocks(DbTxnManager.java:202) >> at >> org.apache.hadoop.hive.ql.Driver.acquireLocksAndOpenTxn(Driver.java:939) >> at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1166) >> at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1004) >> at org.apache.hadoop.hive.ql.Driver.run(Driver.java:994) >> at >> org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:247) >> at >> org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:199) >> at >> org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:410) >> at >> org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:783) >> at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:677) >> at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:616) >> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) >> at >> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) >> at >> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) >> at java.lang.reflect.Method.invoke(Method.java:606) >> at org.apache.hadoop.util.RunJar.run(RunJar.java:221) >> at org.apache.hadoop.util.RunJar.main(RunJar.java:136) >> Caused by: org.apache.thrift.TApplicationException: Internal error >> processing lock >> at >> org.apache.thrift.TApplicationException.read(TApplicationException.java:108) >> at >> org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:71) >> at >> org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.recv_lock(ThriftHiveMetastore.java:3781) >> at >> org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.lock(ThriftHiveMetastore.java:3768) >> at >> org.apache.hadoop.hive.metastore.HiveMetaStoreClient.lock(HiveMetaStoreClient.java:1736) >> at sun.reflect.GeneratedMethodAccessor3.invoke(Unknown Source) >> at >> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) >> at java.lang.reflect.Method.invoke(Method.java:606) >> at >> org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:90) >> at com.sun.proxy.$Proxy9.lock(Unknown Source) >> at >> org.apache.hadoop.hive.ql.lockmgr.DbLockManager.lock(DbLockManager.java:80) >> ... 17 more >> >> p.s : Before setting the transaction specific properties I was able to >> run hive queries successfully >> >> Thanks, >> Yogendra >> > > > > -- > *Thanks & Regards * > > > *Unmesha Sreeveni U.B* > *Hadoop, Bigdata Developer* > *Centre for Cyber Security | Amrita Vishwa Vidyapeetham* > http://www.unmeshasreeveni.blogspot.in/ > > >
