[jira] [Updated] (SOLR-7458) Expose HDFS Block Locality Metrics
[ https://issues.apache.org/jira/browse/SOLR-7458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mike Drob updated SOLR-7458: Attachment: SOLR-7458.part-2.patch Addendum patch against trunk. > Expose HDFS Block Locality Metrics > -- > > Key: SOLR-7458 > URL: https://issues.apache.org/jira/browse/SOLR-7458 > Project: Solr > Issue Type: Improvement > Components: SolrCloud >Reporter: Mike Drob >Assignee: Mark Miller > Labels: metrics > Fix For: 5.3, Trunk > > Attachments: Data Locality.png, SOLR-7458.part-2.patch, > SOLR-7458.patch, SOLR-7458.patch, SOLR-7458.patch, SOLR-7458.patch, > SOLR-7458.patch > > > We should publish block locality metrics when using HDFS. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Updated] (SOLR-7458) Expose HDFS Block Locality Metrics
[ https://issues.apache.org/jira/browse/SOLR-7458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mike Drob updated SOLR-7458: Attachment: SOLR-7458.patch > Expose HDFS Block Locality Metrics > -- > > Key: SOLR-7458 > URL: https://issues.apache.org/jira/browse/SOLR-7458 > Project: Solr > Issue Type: Improvement > Components: SolrCloud >Reporter: Mike Drob >Assignee: Mark Miller > Labels: metrics > Attachments: Data Locality.png, SOLR-7458.patch, SOLR-7458.patch, > SOLR-7458.patch, SOLR-7458.patch, SOLR-7458.patch > > > We should publish block locality metrics when using HDFS. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Updated] (SOLR-7458) Expose HDFS Block Locality Metrics
[ https://issues.apache.org/jira/browse/SOLR-7458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mike Drob updated SOLR-7458: Attachment: Data Locality.png So... It turns out that my problem where I thought it was not updating was completely unrelated. Attached is a screenshot for a 4.10.3 based patch showing what it looks like there. Will be the same in trunk, naturally, this is the one I happened to have available. I've got a new patch that also adds some testing, so I think we are getting close to wrapped up here. > Expose HDFS Block Locality Metrics > -- > > Key: SOLR-7458 > URL: https://issues.apache.org/jira/browse/SOLR-7458 > Project: Solr > Issue Type: Improvement > Components: SolrCloud >Reporter: Mike Drob >Assignee: Mark Miller > Labels: metrics > Attachments: Data Locality.png, SOLR-7458.patch, SOLR-7458.patch, > SOLR-7458.patch, SOLR-7458.patch > > > We should publish block locality metrics when using HDFS. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Updated] (SOLR-7458) Expose HDFS Block Locality Metrics
[ https://issues.apache.org/jira/browse/SOLR-7458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mike Drob updated SOLR-7458: Attachment: SOLR-7458.patch Not anything significant. I'll upload my latest patch that includes some log statements. > Expose HDFS Block Locality Metrics > -- > > Key: SOLR-7458 > URL: https://issues.apache.org/jira/browse/SOLR-7458 > Project: Solr > Issue Type: Improvement > Components: SolrCloud >Reporter: Mike Drob >Assignee: Mark Miller > Labels: metrics > Attachments: SOLR-7458.patch, SOLR-7458.patch, SOLR-7458.patch, > SOLR-7458.patch > > > We should publish block locality metrics when using HDFS. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Updated] (SOLR-7458) Expose HDFS Block Locality Metrics
[ https://issues.apache.org/jira/browse/SOLR-7458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mike Drob updated SOLR-7458: Attachment: SOLR-7458.patch Haven't had a chance to throw this up onto a real install and check the output, but wanted to make the patch available for review. > Expose HDFS Block Locality Metrics > -- > > Key: SOLR-7458 > URL: https://issues.apache.org/jira/browse/SOLR-7458 > Project: Solr > Issue Type: Improvement > Components: SolrCloud >Reporter: Mike Drob >Assignee: Mark Miller > Labels: metrics > Attachments: SOLR-7458.patch, SOLR-7458.patch, SOLR-7458.patch > > > We should publish block locality metrics when using HDFS. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Updated] (SOLR-7458) Expose HDFS Block Locality Metrics
[
https://issues.apache.org/jira/browse/SOLR-7458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mike Drob updated SOLR-7458:
Attachment: SOLR-7458.patch
Here's a version that caches the results for each file. We still have to do a
directory listing each time we get a JMX request, but that seems not too bad.
An alternative approach would be to update the cache only when we open a file
(i.e. {{new HdfsIndexInput()}}), but that had more intricate object life-cycle
implications so I decided to avoid it unless somebody else thought it might be
worthwhile.
> Expose HDFS Block Locality Metrics
> --
>
> Key: SOLR-7458
> URL: https://issues.apache.org/jira/browse/SOLR-7458
> Project: Solr
> Issue Type: Improvement
> Components: SolrCloud
>Reporter: Mike Drob
>Assignee: Mark Miller
> Labels: metrics
> Attachments: SOLR-7458.patch, SOLR-7458.patch
>
>
> We should publish block locality metrics when using HDFS.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Updated] (SOLR-7458) Expose HDFS Block Locality Metrics
[ https://issues.apache.org/jira/browse/SOLR-7458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Otis Gospodnetic updated SOLR-7458: --- Labels: metrics (was: ) > Expose HDFS Block Locality Metrics > -- > > Key: SOLR-7458 > URL: https://issues.apache.org/jira/browse/SOLR-7458 > Project: Solr > Issue Type: Improvement > Components: SolrCloud >Reporter: Mike Drob > Labels: metrics > Attachments: SOLR-7458.patch > > > We should publish block locality metrics when using HDFS. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Updated] (SOLR-7458) Expose HDFS Block Locality Metrics
[ https://issues.apache.org/jira/browse/SOLR-7458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mike Drob updated SOLR-7458: Attachment: SOLR-7458.patch Patch against trunk. > Expose HDFS Block Locality Metrics > -- > > Key: SOLR-7458 > URL: https://issues.apache.org/jira/browse/SOLR-7458 > Project: Solr > Issue Type: Improvement > Components: SolrCloud >Reporter: Mike Drob > Attachments: SOLR-7458.patch > > > We should publish block locality metrics when using HDFS. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
