Weiwei Yang commented on HDFS-12196:

Hi [~vagarychen]

Thanks for raising up your concern. The reason I did not use LRUMap or Guava 
cache here because they both evict something when cache gets full. But in this 
case, I don't want to remove any thing from cache (become an incomplete result 
set) so I claim it as a fixed size list, once reaches its cap then pause 
further task executions.

This might be a bit over designed at present, given the truth we are not going 
to use the cache any time soon, I removed that part in v3 patch. Lets get the 
basic stuff working first. If moving on we need to implement anything similar, 
we can revisit this.

Thanks for sharing your thought, it is quite helpful. I have uploaded v3 patch. 
Please help to review. Thanks. 

> Ozone: DeleteKey-2: Implement container recycling service to delete stale 
> blocks at background
> ----------------------------------------------------------------------------------------------
>                 Key: HDFS-12196
>                 URL: https://issues.apache.org/jira/browse/HDFS-12196
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>          Components: ozone
>            Reporter: Weiwei Yang
>            Assignee: Weiwei Yang
>         Attachments: HDFS-12196-HDFS-7240.001.patch, 
> HDFS-12196-HDFS-7240.002.patch
> Implement a recycling service running on datanode to delete stale blocks.  
> The recycling service scans staled blocks for each container and delete 
> chunks and references periodically.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org

Reply via email to