[
https://issues.apache.org/jira/browse/HDFS-6604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Colin Patrick McCabe updated HDFS-6604:
---------------------------------------
Attachment: HDFS-6604.001.patch
The CacheCleaner thread is supposed to time out replicas that haven't been used
for a while (5 minutes by default). It looks like this thread has not been
timing out the non-mmapped entries as it should, due to a typo. This patch
should fix it.
We probably should also have the DN notify the client when a block that the
client is reading is unlinked. It could do this via the existing shared memory
segment code, in the same way we handle uncaching now.
> Disk space leak with shortcircuit
> ---------------------------------
>
> Key: HDFS-6604
> URL: https://issues.apache.org/jira/browse/HDFS-6604
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: hdfs-client
> Affects Versions: 2.4.0
> Environment: Centos 6.5 and distribution Hortonworks Data Platform
> v2.1
> Reporter: Giuseppe Reina
> Priority: Critical
> Attachments: HDFS-6604.001.patch
>
>
> When HDFS shortcircuit is enabled, the file descriptors of the deleted HDFS
> blocks are kept open until the cache is full. This prevents the operating
> system to free the space on disk.
> More details on the [mailing list
> thread|http://mail-archives.apache.org/mod_mbox/hbase-user/201406.mbox/%3CCAPjB-CA3RV=slhuhwue5cv3pc4+rffz10-tkydbfs9rt2de...@mail.gmail.com%3E]
--
This message was sent by Atlassian JIRA
(v6.2#6252)
