[ 
https://issues.apache.org/jira/browse/HIVE-25330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17381180#comment-17381180
 ] 

Pravin Sinha commented on HIVE-25330:
-------------------------------------

One such trace is this:
{code:java}
2021-07-09 03:34:30,643 ERROR org.apache.hadoop.hive.ql.exec.ReplCopyTask: 
[Thread-98208]: java.io.IOException: Filesystem closed
        at org.apache.hadoop.hdfs.DFSClient.checkOpen(DFSClient.java:477)
        at org.apache.hadoop.hdfs.DFSClient.getFileInfo(DFSClient.java:1685)
        at 
org.apache.hadoop.hdfs.DistributedFileSystem$29.doCall(DistributedFileSystem.java:1745)
        at 
org.apache.hadoop.hdfs.DistributedFileSystem$29.doCall(DistributedFileSystem.java:1742)
        at 
org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
        at 
org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:1757)
        at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:1738)
        at 
org.apache.hadoop.hive.ql.parse.repl.CopyUtils.doCopy(CopyUtils.java:154)
        at 
org.apache.hadoop.hive.ql.parse.repl.CopyUtils.copyAndVerify(CopyUtils.java:114)
        at 
org.apache.hadoop.hive.ql.exec.ReplCopyTask.execute(ReplCopyTask.java:155)
        at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:213)
        at 
org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:105)
        at 
org.apache.hadoop.hive.ql.exec.TaskRunner.run(TaskRunner.java:83){code}

> Make FS calls in CopyUtils retryable
> ------------------------------------
>
>                 Key: HIVE-25330
>                 URL: https://issues.apache.org/jira/browse/HIVE-25330
>             Project: Hive
>          Issue Type: Improvement
>            Reporter: Pravin Sinha
>            Assignee: Haymant Mangla
>            Priority: Major
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to