[ 
https://issues.apache.org/jira/browse/HDFS-6093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13935770#comment-13935770
 ] 

Andrew Wang commented on HDFS-6093:
-----------------------------------

Hey Arpit,

So the confusing thing about these stats is how the pool and directive stats 
are only updated when the CacheReplicationMonitor runs (default every 5 mins). 
The datanode-level stats are updated on the heartbeat, so much more frequent. I 
think if you wait for a CRM run, it'll then show up in listPools.

I was considering lowering the default CRM interval for this reason, maybe to 1 
min or 30s, for this reason.

> Expose more caching information for debugging by users
> ------------------------------------------------------
>
>                 Key: HDFS-6093
>                 URL: https://issues.apache.org/jira/browse/HDFS-6093
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>          Components: caching
>    Affects Versions: 2.4.0
>            Reporter: Andrew Wang
>            Assignee: Andrew Wang
>         Attachments: hdfs-6093-1.patch
>
>
> When users submit a new cache directive, it's unclear if the NN has 
> recognized it and is actively trying to cache it, or if it's hung for some 
> other reason. It'd be nice to expose a "pending caching/uncaching" count the 
> same way we expose pending replication work.
> It'd also be nice to display the aggregate cache capacity and usage in 
> dfsadmin -report, since we already have have it as a metric and expose it 
> per-DN in report output.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Reply via email to