https://bugzilla.wikimedia.org/show_bug.cgi?id=61384

            Bug ID: 61384
           Summary: Elasticsearch ganglia monitor broken for Logstash due
                    to lack of stats groups
           Product: Wikimedia
           Version: wmf-deployment
          Hardware: All
                OS: All
            Status: NEW
          Severity: normal
          Priority: Unprioritized
         Component: Logstash
          Assignee: wikibugs-l@lists.wikimedia.org
          Reporter: bda...@wikimedia.org
                CC: aschulz4...@gmail.com, bda...@wikimedia.org,
                    g...@wikimedia.org, o...@wikimedia.org
       Web browser: ---
   Mobile Platform: ---

The kibana interface doesn't tag searches with stats groups [0] and the ganglia
monitoring script assumes otherwise:

[PYTHON] Can't call the metric_init function in the python module
[elasticsearch
_monitoring].

Traceback (most recent call last):
  File "/usr/lib/ganglia/python_modules/elasticsearch_monitoring.py", line 511,
in metric_init
    for group in load(url)['_all']['total']['search']['groups']:
KeyError: 'groups'


When queried on the logstash elasticsearch nodes the relevant section of the
_stats/search request looks like this:

    "_all" : {
      "primaries" : {
        "search" : {
          "open_contexts" : 0,
          "query_total" : 10317,
          "query_time" : "1.6h",
          "query_time_in_millis" : 5915635,
          "query_current" : 0,
          "fetch_total" : 7731,
          "fetch_time" : "23.5s",
          "fetch_time_in_millis" : 23525,
          "fetch_current" : 0
        }
      },
      "total" : {
        "search" : {
          "open_contexts" : 0,
          "query_total" : 19499,
          "query_time" : "3.1h",
          "query_time_in_millis" : 11201005,
          "query_current" : 0,
          "fetch_total" : 14517,
          "fetch_time" : "42.8s",
          "fetch_time_in_millis" : 42819,
          "fetch_current" : 0
        }
      }
    }


[0]:
http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/search.html#stats-groups

-- 
You are receiving this mail because:
You are the assignee for the bug.
You are on the CC list for the bug.
_______________________________________________
Wikibugs-l mailing list
Wikibugs-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikibugs-l

Reply via email to