[
https://issues.apache.org/jira/browse/HDFS-10480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15312546#comment-15312546
]
Kihwal Lee edited comment on HDFS-10480 at 6/2/16 4:14 PM:
-----------------------------------------------------------
While debugging issues, I had to dump a huge fsimage to get the list of open
files. I was looking for files being open for a long time, so it was okay but
took a long time to get them. The list may surprise you if there are runaway
clients keeping renewing leases. I've seen something open for many months,
surviving multiple rolling upgrades. They also pose risk of data loss since
even the finalized blocks don't get re-replicated if the file is under
construction. If confirmed to be a "forgotten" file that is left open, the
admin can use {{hdfs debug recoverLease}} command to revoke the lease and close
the file.
was (Author: kihwal):
While debugging issues, I had to dump a huge fsimage to get the list of open
files. I was looking for files being open for a long time, so it was okay but
took a long time to get them. The list may surprise you if there are runaway
clients keeping renewing leases. I've seen something open for many months,
surviving multiple rolling upgrades. They also pose risk of data loss since
even the finalized blocks don't get re-replicated if the file is under
construction. If conformed to be a "forgotten" file that is left open, the
admin can use {{hdfs debug recoverLease}} command to revoke the lease and close
the file.
> Add an admin command to list currently open files
> -------------------------------------------------
>
> Key: HDFS-10480
> URL: https://issues.apache.org/jira/browse/HDFS-10480
> Project: Hadoop HDFS
> Issue Type: Bug
> Reporter: Kihwal Lee
>
> Currently there is a no easy way to obtain the list of active leases or files
> being written. It will be nice if we have an admin command to list open files
> and their lease holders.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
