[jira] [Updated] (OAK-4726) Add Metrics coverage to the Lucene Indexer
[ https://issues.apache.org/jira/browse/OAK-4726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chetan Mehrotra updated OAK-4726: - Fix Version/s: (was: 1.8) > Add Metrics coverage to the Lucene Indexer > -- > > Key: OAK-4726 > URL: https://issues.apache.org/jira/browse/OAK-4726 > Project: Jackrabbit Oak > Issue Type: Improvement > Components: lucene >Affects Versions: 1.5.8 >Reporter: Ian Boston >Assignee: Chetan Mehrotra > Attachments: OAK-4726.patch > > > Although there are some stats surrounding the Lucene indexing processes it > would be useful to have metrics style stats available. > Looking at the code, the implementations IndexWriter look like the right > place to add the metrics. These could be global aggregate metrics, ie one set > of metrics covering all IndexWriter implementations, or there could be > individual metrics for each Lucene index definition. The latter would be more > useful as it will allow detailed stats on individual metrics. > These metrics will only give information on the writer operations, and not > any Tokenizing operations. > Patch in the form of a pull request will flow. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Updated] (OAK-4726) Add Metrics coverage to the Lucene Indexer
[ https://issues.apache.org/jira/browse/OAK-4726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chetan Mehrotra updated OAK-4726: - Fix Version/s: (was: 1.5.17) (was: 1.6) 1.8 > Add Metrics coverage to the Lucene Indexer > -- > > Key: OAK-4726 > URL: https://issues.apache.org/jira/browse/OAK-4726 > Project: Jackrabbit Oak > Issue Type: Improvement > Components: lucene >Affects Versions: 1.5.8 >Reporter: Ian Boston >Assignee: Chetan Mehrotra > Fix For: 1.8 > > Attachments: OAK-4726.patch > > > Although there are some stats surrounding the Lucene indexing processes it > would be useful to have metrics style stats available. > Looking at the code, the implementations IndexWriter look like the right > place to add the metrics. These could be global aggregate metrics, ie one set > of metrics covering all IndexWriter implementations, or there could be > individual metrics for each Lucene index definition. The latter would be more > useful as it will allow detailed stats on individual metrics. > These metrics will only give information on the writer operations, and not > any Tokenizing operations. > Patch in the form of a pull request will flow. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (OAK-4726) Add Metrics coverage to the Lucene Indexer
[
https://issues.apache.org/jira/browse/OAK-4726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vikas Saurabh updated OAK-4726:
---
Attachment: OAK-4726.patch
[~chetanm], I've attached [~i...@tfd.co.uk]'s patch rebased atop trunk (and
some refactoring).
Currently, the stuff that gets measured are text extraction stats and
{{DefaultIndexWriter}} opearations. I haven't added any more stats (although
you now have hybrid in place so may be that should get some love too).
The stats as they show up on AEM jmx console look like:
||Attribute Name||Attribute Value||
|Mean|63.379560001489786|
|Max|1935.220386|
|Min|0.003552|
|StdDev|250.87315515958988|
|999thPercentile|1935.220386|
|95thPercentile|308.244552|
|99thPercentile|1935.220386|
|98thPercentile|1070.906412|
|75thPercentile|5.721004|
|50thPercentile|0.026448|
|DurationUnit|milliseconds|
|Count|89|
|MeanRate|0.38123632645532535|
|OneMinuteRate|0.06876635442830437|
|FifteenMinuteRate|0.23484700091005226|
|FiveMinuteRate|0.24990742284539616|
|RateUnit|events/second||
That's for {{org.apache.jackrabbit.oak:
"org.apache.jackrabbit.oak.plugins.index.lucene.writer.DefaultIndexWriter-:data-close"
(Metrics)}}. There are others for other operations too.
[~i...@tfd.co.uk], can you also please take a look in case I missed/messed up
something.
> Add Metrics coverage to the Lucene Indexer
> --
>
> Key: OAK-4726
> URL: https://issues.apache.org/jira/browse/OAK-4726
> Project: Jackrabbit Oak
> Issue Type: Improvement
> Components: lucene
>Affects Versions: 1.5.8
>Reporter: Ian Boston
>Assignee: Chetan Mehrotra
> Fix For: 1.6, 1.5.17
>
> Attachments: OAK-4726.patch
>
>
> Although there are some stats surrounding the Lucene indexing processes it
> would be useful to have metrics style stats available.
> Looking at the code, the implementations IndexWriter look like the right
> place to add the metrics. These could be global aggregate metrics, ie one set
> of metrics covering all IndexWriter implementations, or there could be
> individual metrics for each Lucene index definition. The latter would be more
> useful as it will allow detailed stats on individual metrics.
> These metrics will only give information on the writer operations, and not
> any Tokenizing operations.
> Patch in the form of a pull request will flow.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (OAK-4726) Add Metrics coverage to the Lucene Indexer
[ https://issues.apache.org/jira/browse/OAK-4726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexander Saar updated OAK-4726: Fix Version/s: 1.5.17 > Add Metrics coverage to the Lucene Indexer > -- > > Key: OAK-4726 > URL: https://issues.apache.org/jira/browse/OAK-4726 > Project: Jackrabbit Oak > Issue Type: Improvement > Components: lucene >Affects Versions: 1.5.8 >Reporter: Ian Boston >Assignee: Chetan Mehrotra > Fix For: 1.6, 1.5.17 > > > Although there are some stats surrounding the Lucene indexing processes it > would be useful to have metrics style stats available. > Looking at the code, the implementations IndexWriter look like the right > place to add the metrics. These could be global aggregate metrics, ie one set > of metrics covering all IndexWriter implementations, or there could be > individual metrics for each Lucene index definition. The latter would be more > useful as it will allow detailed stats on individual metrics. > These metrics will only give information on the writer operations, and not > any Tokenizing operations. > Patch in the form of a pull request will flow. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (OAK-4726) Add Metrics coverage to the Lucene Indexer
[ https://issues.apache.org/jira/browse/OAK-4726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chetan Mehrotra updated OAK-4726: - Fix Version/s: 1.6 > Add Metrics coverage to the Lucene Indexer > -- > > Key: OAK-4726 > URL: https://issues.apache.org/jira/browse/OAK-4726 > Project: Jackrabbit Oak > Issue Type: Improvement > Components: lucene >Affects Versions: 1.5.8 >Reporter: Ian Boston >Assignee: Chetan Mehrotra > Fix For: 1.6 > > > Although there are some stats surrounding the Lucene indexing processes it > would be useful to have metrics style stats available. > Looking at the code, the implementations IndexWriter look like the right > place to add the metrics. These could be global aggregate metrics, ie one set > of metrics covering all IndexWriter implementations, or there could be > individual metrics for each Lucene index definition. The latter would be more > useful as it will allow detailed stats on individual metrics. > These metrics will only give information on the writer operations, and not > any Tokenizing operations. > Patch in the form of a pull request will flow. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
