[
https://issues.apache.org/jira/browse/HIVE-11411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
shiqian.huang updated HIVE-11411:
---------------------------------
Description: in method progress(ExecDriverTaskHandle th) of class
HadoopJobExecHelper, hive lock heartbeating progress work with job tracking
progress. When job tracking progress got any exception, will bring lock time
out exception to big query job. (was: Transaction lock time out when can't
tracking job progress. hive 1.2
when hive client cann't connect to appmaster to tracking job progress and job
running more than 5mins, hive can't refresh lock heartbeat. then will get
exception
2015-07-30 17:23:30,161 ERROR [Thread-206]: metastore.RetryingHMSHandler
(RetryingHMSHandler.java:invoke(159)) - NoSuchLockException(message:No such
lock: 3645)
at
org.apache.hadoop.hive.metastore.txn.TxnHandler.heartbeatLock(TxnHandler.java:1710)
at
org.apache.hadoop.hive.metastore.txn.TxnHandler.heartbeat(TxnHandler.java:622)
at
org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.heartbeat(HiveMetaStore.java:5582)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at
org.apache.hadoop.hive.metastore.RetryingHMSHandler.invoke(RetryingHMSHandler.java:107)
at com.sun.proxy.$Proxy7.heartbeat(Unknown Source)
at
org.apache.hadoop.hive.metastore.HiveMetaStoreClient.heartbeat(HiveMetaStoreClient.java:1891)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at
org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:156)
at com.sun.proxy.$Proxy8.heartbeat(Unknown Source)
at
org.apache.hadoop.hive.ql.lockmgr.DbTxnManager.heartbeat(DbTxnManager.java:293)
at org.apache.hadoop.hive.ql.exec.Heartbeater.heartbeat(Heartbeater.java:81)
at
org.apache.hadoop.hive.ql.exec.mr.HadoopJobExecHelper.progress(HadoopJobExecHelper.java:242)
at
org.apache.hadoop.hive.ql.exec.mr.HadoopJobExecHelper.progress(HadoopJobExecHelper.java:549)
at org.apache.hadoop.hive.ql.exec.mr.ExecDriver.execute(ExecDriver.java:437)
at org.apache.hadoop.hive.ql.exec.mr.MapRedTask.execute(MapRedTask.java:137)
at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:160)
at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:88)
at org.apache.hadoop.hive.ql.exec.TaskRunner.run(TaskRunner.java:75)
I find the reason is ’if (initializing && rj.getJobState() == JobStatus.PREP)‘
throw exception when doesn't configure any hadoop slave host in /etc/hosts.
is it a bug?)
> Transaction lock time out when can't tracking job progress
> ----------------------------------------------------------
>
> Key: HIVE-11411
> URL: https://issues.apache.org/jira/browse/HIVE-11411
> Project: Hive
> Issue Type: Wish
> Affects Versions: 1.2.0
> Reporter: shiqian.huang
> Priority: Minor
>
> in method progress(ExecDriverTaskHandle th) of class HadoopJobExecHelper,
> hive lock heartbeating progress work with job tracking progress. When job
> tracking progress got any exception, will bring lock time out exception to
> big query job.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
