[
https://issues.apache.org/jira/browse/HIVE-16902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16050567#comment-16050567
]
Aihua Xu commented on HIVE-16902:
---------------------------------
Without this patch, the exception could happen when the log file never gets
created or the file could get removed outside Hive manually. We don't need
throw exception during file delete if the file doesn't exist.
> investigate "failed to remove operation log" errors
> ---------------------------------------------------
>
> Key: HIVE-16902
> URL: https://issues.apache.org/jira/browse/HIVE-16902
> Project: Hive
> Issue Type: Bug
> Components: Logging
> Affects Versions: 3.0.0
> Reporter: Aihua Xu
> Assignee: Aihua Xu
> Attachments: HIVE-16902.1.patch
>
>
> When we call {{set a=3;}} from beeline, the following exception is thrown.
> {noformat}
> [HiveServer2-Handler-Pool: Thread-46]: Failed to remove corresponding log
> file of operation: OperationHandle [opType=GET_TABLES,
> getHandleIdentifier()=50f58d7b-f935-4590-922f-de7051a34658]
> java.io.FileNotFoundException: File does not exist:
> /var/log/hive/operation_logs/7f613077-e29d-484a-96e1-43c81f9c0999/hive_20170531101400_28d52b7d-ffb9-4815-8c6c-662319628915
> at org.apache.commons.io.FileUtils.forceDelete(FileUtils.java:2275)
> at
> org.apache.hadoop.hive.ql.session.OperationLog$LogFile.remove(OperationLog.java:122)
> at
> org.apache.hadoop.hive.ql.session.OperationLog.close(OperationLog.java:90)
> at
> org.apache.hive.service.cli.operation.Operation.cleanupOperationLog(Operation.java:287)
> at
> org.apache.hive.service.cli.operation.MetadataOperation.close(MetadataOperation.java:58)
> at
> org.apache.hive.service.cli.operation.OperationManager.closeOperation(OperationManager.java:273)
> at
> org.apache.hive.service.cli.session.HiveSessionImpl.closeOperation(HiveSessionImpl.java:822)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:498)
> at
> org.apache.hive.service.cli.session.HiveSessionProxy.invoke(HiveSessionProxy.java:78)
> at
> org.apache.hive.service.cli.session.HiveSessionProxy.access$000(HiveSessionProxy.java:36)
> at
> org.apache.hive.service.cli.session.HiveSessionProxy$1.run(HiveSessionProxy.java:63)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:422)
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1857)
> at
> org.apache.hive.service.cli.session.HiveSessionProxy.invoke(HiveSessionProxy.java:59)
> at com.sun.proxy.$Proxy38.closeOperation(Unknown Source)
> at
> org.apache.hive.service.cli.CLIService.closeOperation(CLIService.java:475)
> at
> org.apache.hive.service.cli.thrift.ThriftCLIService.CloseOperation(ThriftCLIService.java:671)
> at
> org.apache.hive.service.rpc.thrift.TCLIService$Processor$CloseOperation.getResult(TCLIService.java:1677)
> at
> org.apache.hive.service.rpc.thrift.TCLIService$Processor$CloseOperation.getResult(TCLIService.java:1662)
> at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
> at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
> at
> org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge$Server$TUGIAssumingProcessor.process(HadoopThriftAuthBridge.java:605)
> at
> org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:286)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
