[
https://issues.apache.org/jira/browse/SOLR-7458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14514151#comment-14514151
]
Mark Miller commented on SOLR-7458:
-----------------------------------
Adding a bit of history: We used to get the size of a directory in hdfs by
running through the files and adding up the size for each. On a large cluster
with many cores, this was a huge performance issue. We had to switch to a
single call that was more like a df command.
That makes me think this impl will have the same type of problems. We may have
to look into doing cached responses or something.
> Expose HDFS Block Locality Metrics
> ----------------------------------
>
> Key: SOLR-7458
> URL: https://issues.apache.org/jira/browse/SOLR-7458
> Project: Solr
> Issue Type: Improvement
> Components: SolrCloud
> Reporter: Mike Drob
> Assignee: Mark Miller
> Labels: metrics
> Attachments: SOLR-7458.patch
>
>
> We should publish block locality metrics when using HDFS.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
